2023-06-09T04:23:44.264 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T04:23:44.265 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_xiubli@teuthology --name xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --archive /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299737 -- /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299737/orig.config.yaml 2023-06-09T04:23:44.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T04:23:44.394 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299737 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7299737' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSNZhRT7K6h9vKF//fa0NGlgEvXUQbuloHxceuVDpusLQlbUlGxSCFGz9KZGI8Z5pLZZNda/wqEluFgYZATOXw= smithi081.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEk7T3OiwyWrLlUy4TfwZaiCSLTvZz3lqu6Ij+bgcgRL tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-09_04:16:27 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-09T04:23:44.395 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-09T04:23:44.395 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-09T04:23:44.396 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-09T04:23:44.397 INFO:teuthology.task.internal:Checking packages... 2023-06-09T04:23:44.425 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-09T04:23:44.425 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-09T04:23:44.425 INFO:teuthology.packaging:ref: None 2023-06-09T04:23:44.426 INFO:teuthology.packaging:tag: None 2023-06-09T04:23:44.426 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:44.426 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:23:44.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:44.577 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:23:44.577 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-09T04:23:44.586 INFO:teuthology.task.internal:no buildpackages task found 2023-06-09T04:23:44.586 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-09T04:23:44.629 INFO:teuthology.task.internal:Saving configuration 2023-06-09T04:23:44.644 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-09T04:23:44.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T04:23:44.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:34.755332', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDOksOnYaMCphkjj8j51nbibZVLjcqaRlIElun76c9SN'} 2023-06-09T04:23:44.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:34.757225', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEk7T3OiwyWrLlUy4TfwZaiCSLTvZz3lqu6Ij+bgcgRL'} 2023-06-09T04:23:44.705 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-09T04:23:44.713 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-09T04:23:44.713 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-09T04:23:44.713 INFO:teuthology.run_tasks:Running task console_log... 2023-06-09T04:23:44.801 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fadd876c040>, signals=[15]) 2023-06-09T04:23:44.802 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-09T04:23:44.809 INFO:teuthology.task.internal:Opening connections... 2023-06-09T04:23:44.810 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:23:44.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:44.891 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:23:44.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:44.968 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-09T04:23:44.975 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2023-06-09T04:23:44.980 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2023-06-09T04:23:44.980 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-06-09T04:23:45.031 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-09T04:23:45.031 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T04:23:45.032 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T04:23:45.033 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T04:23:45.033 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T04:23:45.033 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2023-06-09T04:23:45.033 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-06-09T04:23:45.062 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-06-09T04:23:45.067 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-06-09T04:23:45.067 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-06-09T04:23:45.111 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-09T04:23:45.112 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2023-06-09T04:23:45.112 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2023-06-09T04:23:45.112 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-09T04:23:45.112 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T04:23:45.113 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2023-06-09T04:23:45.114 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-06-09T04:23:45.136 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-09T04:23:45.151 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-09T04:23:45.171 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-09T04:23:45.171 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:45.174 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:45.178 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-09T04:23:45.205 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-09T04:23:45.205 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:45.222 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:45.236 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-09T04:23:45.308 INFO:teuthology.run_tasks:Running task kernel... 2023-06-09T04:23:45.327 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-09T04:23:45.328 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-09T04:23:45.329 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:45.329 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:45.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:45.334 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2023-06-09T04:23:45.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:45.336 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-06-09T04:23:45.380 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-56-generic 2023-06-09T04:23:45.381 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.15.0-56-generic 2023-06-09T04:23:45.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2023-06-09T04:23:45.384 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2023-06-09T04:23:45.384 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2023-06-09T04:23:45.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2023-06-09T04:23:45.500 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2023-06-09T04:23:45.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-06-09T04:23:45.819 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-09T04:23:45.820 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-09T04:23:45.822 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-09T04:23:45.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-09T04:23:45.867 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-09T04:23:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-09T04:23:46.223 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-09T04:23:46.228 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [234 kB] 2023-06-09T04:23:46.239 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-09T04:23:46.244 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [234 kB] 2023-06-09T04:23:46.360 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [419 kB] 2023-06-09T04:23:46.379 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [672 kB] 2023-06-09T04:23:46.474 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [455 kB] 2023-06-09T04:23:46.489 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [455 kB] 2023-06-09T04:23:46.529 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [672 kB] 2023-06-09T04:23:46.586 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [419 kB] 2023-06-09T04:23:46.586 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [122 kB] 2023-06-09T04:23:46.601 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [122 kB] 2023-06-09T04:23:46.612 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-09T04:23:46.614 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [349 kB] 2023-06-09T04:23:46.627 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-09T04:23:46.629 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-09T04:23:46.630 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [182 kB] 2023-06-09T04:23:46.634 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [349 kB] 2023-06-09T04:23:46.648 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [182 kB] 2023-06-09T04:23:46.656 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-09T04:23:46.656 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-09T04:23:46.658 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-09T04:23:46.658 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [350 kB] 2023-06-09T04:23:46.660 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [52.6 kB] 2023-06-09T04:23:46.674 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.8 kB] 2023-06-09T04:23:46.675 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [52.6 kB] 2023-06-09T04:23:46.678 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-09T04:23:46.680 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-09T04:23:46.680 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-09T04:23:46.684 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-09T04:23:46.684 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-09T04:23:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-09T04:23:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [350 kB] 2023-06-09T04:23:46.692 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-09T04:23:46.693 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.8 kB] 2023-06-09T04:23:46.695 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-09T04:23:46.713 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [732 kB] 2023-06-09T04:23:46.727 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [732 kB] 2023-06-09T04:23:46.843 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [920 kB] 2023-06-09T04:23:46.859 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [920 kB] 2023-06-09T04:23:46.920 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [129 kB] 2023-06-09T04:23:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [129 kB] 2023-06-09T04:23:47.290 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-09T04:23:47.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-09T04:23:47.302 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-09T04:23:47.309 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-09T04:23:47.311 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-09T04:23:47.314 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-09T04:23:47.323 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-09T04:23:47.325 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-09T04:23:47.454 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [622 kB] 2023-06-09T04:23:47.472 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [622 kB] 2023-06-09T04:23:47.494 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [194 kB] 2023-06-09T04:23:47.506 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.0 kB] 2023-06-09T04:23:47.507 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-09T04:23:47.509 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-09T04:23:47.509 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-09T04:23:47.510 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-09T04:23:47.511 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [194 kB] 2023-06-09T04:23:47.511 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-09T04:23:47.512 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-09T04:23:47.523 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.0 kB] 2023-06-09T04:23:47.524 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-09T04:23:47.525 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-09T04:23:47.527 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-09T04:23:47.528 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-09T04:23:47.528 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-09T04:23:47.529 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-09T04:23:47.538 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-09T04:23:47.555 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-09T04:23:47.702 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-09T04:23:47.720 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-09T04:23:47.784 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-09T04:23:47.803 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-09T04:23:47.809 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-09T04:23:47.865 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-09T04:23:47.908 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-09T04:23:47.927 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-09T04:23:47.959 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-09T04:23:47.978 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-09T04:23:52.079 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 6,697 kB in 2s (2,839 kB/s) 2023-06-09T04:23:52.411 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 6,697 kB in 2s (2,814 kB/s) 2023-06-09T04:23:53.297 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:23:53.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-09T04:23:53.373 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:23:53.529 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-09T04:23:53.529 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-09T04:23:53.659 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:23:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:23:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:23:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:23:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-09T04:23:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2023-06-09T04:23:53.660 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:23:53.661 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-06-09T04:23:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-09T04:23:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-09T04:23:53.661 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-09T04:23:53.662 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-06-09T04:23:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-09T04:23:53.662 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-06-09T04:23:53.662 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2023-06-09T04:23:53.709 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-06-09T04:23:53.709 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-09T04:23:53.709 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-09T04:23:53.709 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-09T04:23:53.710 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-06-09T04:23:53.710 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-09T04:23:53.759 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 201 not upgraded. 2023-06-09T04:23:53.759 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 114 MB of archives. 2023-06-09T04:23:53.759 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-09T04:23:53.759 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-09T04:23:54.165 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:23:54.183 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-09T04:23:54.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-09T04:23:54.247 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:23:54.295 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-09T04:23:54.425 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2023-06-09T04:23:54.426 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2023-06-09T04:23:54.581 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:23:54.582 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:23:54.582 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:23:54.582 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:23:54.583 INFO:teuthology.orchestra.run.smithi018.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-09T04:23:54.583 INFO:teuthology.orchestra.run.smithi018.stdout: python2.7-minimal 2023-06-09T04:23:54.583 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:23:54.583 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2023-06-09T04:23:54.583 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-09T04:23:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-09T04:23:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-09T04:23:54.585 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2023-06-09T04:23:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-09T04:23:54.585 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2023-06-09T04:23:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: thermald 2023-06-09T04:23:54.632 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2023-06-09T04:23:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-09T04:23:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-09T04:23:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-09T04:23:54.634 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2023-06-09T04:23:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-09T04:23:54.684 INFO:teuthology.orchestra.run.smithi018.stdout:3 upgraded, 5 newly installed, 0 to remove and 201 not upgraded. 2023-06-09T04:23:54.684 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 114 MB of archives. 2023-06-09T04:23:54.684 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-09T04:23:54.685 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-09T04:23:55.113 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-09T04:23:55.114 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-09T04:23:55.114 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-09T04:23:55.118 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-09T04:23:55.214 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-09T04:23:55.235 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-09T04:23:55.257 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-09T04:23:55.658 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 114 MB in 2s (74.0 MB/s) 2023-06-09T04:23:55.839 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-09T04:23:56.077 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-09T04:23:56.077 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-09T04:23:56.077 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-09T04:23:56.209 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-09T04:23:56.231 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-09T04:23:56.628 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 114 MB in 2s (71.6 MB/s) 2023-06-09T04:23:56.831 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-09T04:23:57.939 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-09T04:23:57.943 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:23:58.020 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:23:58.836 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-09T04:23:58.840 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:23:58.978 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:00.313 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-09T04:24:00.335 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:24:00.425 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:01.350 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-09T04:24:01.370 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:24:01.408 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:01.512 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-09T04:24:01.534 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:24:01.625 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:02.540 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-09T04:24:02.561 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:24:02.623 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-09T04:24:07.946 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-09T04:24:08.311 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-09T04:24:08.433 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-09T04:24:08.744 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-09T04:24:08.766 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-09T04:24:08.810 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-09T04:24:09.463 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-09T04:24:09.606 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-09T04:24:09.914 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-09T04:24:10.043 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-09T04:24:10.337 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-09T04:24:10.349 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-09T04:24:10.387 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-09T04:24:14.769 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-09T04:24:14.805 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:24:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:16.327 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-09T04:24:16.347 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-09T04:24:16.386 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:17.408 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-09T04:24:17.523 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-09T04:24:17.881 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-09T04:24:18.003 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:18.103 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-09T04:24:18.225 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:19.562 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-09T04:24:19.562 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-09T04:24:19.562 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-09T04:24:19.562 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:19.751 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:19.891 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-09T04:24:20.030 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-09T04:24:20.406 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-09T04:24:20.527 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-09T04:24:20.757 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:21.428 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:22.106 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-09T04:24:22.106 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-09T04:24:22.107 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-09T04:24:22.107 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:22.292 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:22.821 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-09T04:24:22.930 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-09T04:24:23.056 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:23.125 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-09T04:24:23.126 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:23.744 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:25.194 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-09T04:24:25.320 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-09T04:24:25.588 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-09T04:24:25.680 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-09T04:24:25.680 INFO:teuthology.orchestra.run.smithi018.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:37.713 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-09T04:24:37.714 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2023-06-09T04:24:37.720 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:24:37.735 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2023-06-09T04:24:38.099 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-09T04:24:38.122 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:38.451 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-09T04:24:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-09T04:24:38.521 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-09T04:24:38.527 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-09T04:24:38.715 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-09T04:24:38.716 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-09T04:24:38.716 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-09T04:24:38.782 INFO:teuthology.orchestra.run.smithi081.stdout:done 2023-06-09T04:24:39.239 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2023-06-09T04:24:39.257 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2023-06-09T04:24:39.258 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2023-06-09T04:24:39.258 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2023-06-09T04:24:39.258 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2023-06-09T04:24:39.258 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 20 2023-06-09T04:24:39.258 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2023-06-09T04:24:39.258 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.73.71 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2023-06-09T04:24:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2023-06-09T04:24:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2023-06-09T04:24:39.260 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-09T04:24:39.260 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-09T04:24:39.260 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-09T04:24:39.260 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-09T04:24:39.261 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2023-06-09T04:24:39.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2023-06-09T04:24:39.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-06-09T04:24:39.686 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-09T04:24:39.687 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-09T04:24:39.760 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-09T04:24:39.842 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-09T04:24:40.524 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-09T04:24:40.524 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub' 2023-06-09T04:24:40.553 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:24:40.599 INFO:teuthology.orchestra.run.smithi018.stdout:Generating grub configuration file ... 2023-06-09T04:24:40.902 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-09T04:24:40.921 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:40.932 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:24:40.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-09T04:24:41.005 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:24:41.178 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-09T04:24:41.178 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-09T04:24:41.237 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-09T04:24:41.243 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-09T04:24:41.312 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-09T04:24:41.317 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-09T04:24:41.327 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-09T04:24:41.327 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:24:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:24:41.327 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:24:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:24:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-09T04:24:41.328 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-09T04:24:41.329 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:24:41.363 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 201 not upgraded. 2023-06-09T04:24:41.364 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2023-06-09T04:24:41.380 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2023-06-09T04:24:41.380 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2023-06-09T04:24:41.380 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2023-06-09T04:24:41.380 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2023-06-09T04:24:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 20 2023-06-09T04:24:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2023-06-09T04:24:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2023-06-09T04:24:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2023-06-09T04:24:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.73.71 2023-06-09T04:24:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-09T04:24:41.382 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-09T04:24:41.382 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2023-06-09T04:24:41.382 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2023-06-09T04:24:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2023-06-09T04:24:41.382 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2023-06-09T04:24:41.382 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-06-09T04:24:41.427 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.YDT4wcAFU1 2023-06-09T04:24:41.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.YDT4wcAFU1 2023-06-09T04:24:41.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.YDT4wcAFU1 2023-06-09T04:24:41.514 INFO:teuthology.orchestra.run.smithi018.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-09T04:24:41.514 INFO:teuthology.orchestra.run.smithi018.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-09T04:24:41.514 INFO:teuthology.orchestra.run.smithi018.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-09T04:24:41.553 INFO:teuthology.orchestra.run.smithi018.stdout:done 2023-06-09T04:24:41.596 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.YDT4wcAFU1 is 10KB 2023-06-09T04:24:41.608 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.YDT4wcAFU1 2023-06-09T04:24:41.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-09T04:24:41.667 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:24:41.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-09T04:24:41.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-09T04:24:41.744 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-09T04:24:41.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2023-06-09T04:24:42.009 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2023-06-09T04:24:42.027 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2023-06-09T04:24:42.028 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2023-06-09T04:24:42.028 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2023-06-09T04:24:42.028 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2023-06-09T04:24:42.028 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 20 2023-06-09T04:24:42.028 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2023-06-09T04:24:42.028 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2023-06-09T04:24:42.029 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2023-06-09T04:24:42.029 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.73.71 2023-06-09T04:24:42.029 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-09T04:24:42.029 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-09T04:24:42.029 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2023-06-09T04:24:42.029 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2023-06-09T04:24:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2023-06-09T04:24:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2023-06-09T04:24:42.030 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-09T04:24:42.030 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-09T04:24:42.031 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-09T04:24:42.031 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-09T04:24:42.031 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2023-06-09T04:24:42.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2023-06-09T04:24:42.165 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2023-06-09T04:24:42.403 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-09T04:24:42.403 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-09T04:24:42.476 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-09T04:24:42.557 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-09T04:24:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:24:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:24:42.934 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-06-09T04:24:43.100 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-09T04:24:43.105 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:43.379 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-09T04:24:43.384 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-09T04:24:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-09T04:24:43.426 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-09T04:24:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-09T04:24:43.540 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-09T04:24:43.541 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-09T04:24:43.561 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-06-09T04:24:43.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-06-09T04:24:43.669 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:24:43.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-09T04:24:43.737 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:24:43.909 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2023-06-09T04:24:43.910 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2023-06-09T04:24:44.051 INFO:teuthology.orchestra.run.smithi018.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-09T04:24:44.051 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:24:44.051 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:24:44.051 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:24:44.052 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:24:44.052 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-09T04:24:44.052 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-09T04:24:44.053 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:24:44.089 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 0 newly installed, 0 to remove and 201 not upgraded. 2023-06-09T04:24:44.091 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2023-06-09T04:24:44.147 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2023-06-09T04:24:44.147 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2023-06-09T04:24:44.147 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2023-06-09T04:24:44.147 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 20 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.73.71 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-09T04:24:44.148 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-09T04:24:44.149 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2023-06-09T04:24:44.149 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2023-06-09T04:24:44.149 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2023-06-09T04:24:44.149 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2023-06-09T04:24:44.149 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2023-06-09T04:24:44.191 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.GEyYLuvoWM 2023-06-09T04:24:44.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GEyYLuvoWM 2023-06-09T04:24:44.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.GEyYLuvoWM 2023-06-09T04:24:44.371 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.GEyYLuvoWM is 10KB 2023-06-09T04:24:44.383 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.GEyYLuvoWM 2023-06-09T04:24:44.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-09T04:24:44.443 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:24:44.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-09T04:24:44.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-09T04:24:44.528 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-09T04:24:44.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo update-grub 2023-06-09T04:24:45.942 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:24:45.943 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:24:45.948 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2023-06-09T04:24:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-09T04:24:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-09T04:24:46.471 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-09T04:24:46.477 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-09T04:24:46.520 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-09T04:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-09T04:24:46.646 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-09T04:24:46.646 INFO:teuthology.orchestra.run.smithi018.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-09T04:24:46.646 INFO:teuthology.orchestra.run.smithi018.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-09T04:24:46.657 INFO:teuthology.orchestra.run.smithi018.stderr:done 2023-06-09T04:24:46.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2023-06-09T04:25:13.596 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-09T04:25:13.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-09T04:25:13.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:25:16.708 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-09T04:25:16.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-06-09T04:25:16.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:25:32.020 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-06-09T04:25:35.092 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-09T04:26:02.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-09T04:26:02.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:26:05.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-06-09T04:26:05.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:26:20.400 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-06-09T04:26:23.476 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-09T04:26:50.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-09T04:26:50.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:26:50.662 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-06-09T04:26:51.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-09T04:26:51.264 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-73-generic"... 2023-06-09T04:26:51.264 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-06-09T04:26:51.310 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-73-generic 2023-06-09T04:26:51.311 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-09T04:26:51.311 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T04:26:51.311 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T04:26:52.312 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-09T04:26:52.313 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-09T04:26:52.397 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2023-06-09T04:26:52.420 DEBUG:teuthology.parallel:result is None 2023-06-09T04:26:53.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-06-09T04:26:53.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:26:53.681 DEBUG:teuthology.orchestra.run.smithi018:> true 2023-06-09T04:26:54.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-06-09T04:26:54.311 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-73-generic"... 2023-06-09T04:26:54.311 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2023-06-09T04:26:54.359 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-73-generic 2023-06-09T04:26:54.360 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-09T04:26:54.360 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T04:26:54.360 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T04:26:55.361 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-09T04:26:55.362 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-09T04:26:55.450 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2023-06-09T04:26:55.489 DEBUG:teuthology.parallel:result is None 2023-06-09T04:26:55.489 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-09T04:26:55.497 INFO:teuthology.task.internal:Creating test directory... 2023-06-09T04:26:55.498 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:26:55.500 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:26:55.506 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-09T04:26:55.546 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-09T04:26:55.594 INFO:teuthology.task.internal:Creating archive directory... 2023-06-09T04:26:55.595 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:26:55.597 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:26:55.621 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-09T04:26:55.645 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-09T04:26:55.646 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:26:55.648 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:26:55.670 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:26:55.680 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:26:55.690 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:26:55.698 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:26:55.700 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-09T04:26:55.711 INFO:teuthology.task.internal:Configuring sudo... 2023-06-09T04:26:55.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:26:55.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:26:55.758 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-09T04:26:55.772 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-09T04:26:55.772 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:26:55.780 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:26:55.806 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:26:55.831 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:26:55.879 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:26:55.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:26:55.944 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:26:55.950 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:26:55.998 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:26:55.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:26:56.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2023-06-09T04:26:56.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-06-09T04:26:56.197 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-09T04:26:56.205 INFO:teuthology.task.internal:Starting timer... 2023-06-09T04:26:56.206 INFO:teuthology.run_tasks:Running task pcp... 2023-06-09T04:26:56.256 INFO:teuthology.run_tasks:Running task selinux... 2023-06-09T04:26:56.317 DEBUG:teuthology.task.selinux:Excluding smithi018: OS 'ubuntu' does not support SELinux 2023-06-09T04:26:56.317 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2023-06-09T04:26:56.318 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-09T04:26:56.318 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-09T04:26:56.318 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-09T04:26:56.318 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-09T04:26:56.363 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-09T04:26:56.369 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-09T04:26:56.545 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-09T04:26:56.565 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-09T04:26:56.567 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-09T04:34:31.893 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2023-06-09T04:34:31.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-06-09T04:34:31.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:34:31.977 DEBUG:teuthology.orchestra.run.smithi018:> true 2023-06-09T04:34:32.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-06-09T04:34:32.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:34:32.163 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-06-09T04:34:32.292 INFO:teuthology.run_tasks:Running task clock... 2023-06-09T04:34:32.306 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-09T04:34:32.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:34:32.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:34:32.309 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:34:32.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:34:32.338 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-09T04:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Command line: ntpd -gq 2023-06-09T04:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: ---------------------------------------------------- 2023-06-09T04:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: ntp-4 is maintained by Network Time Foundation, 2023-06-09T04:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-09T04:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: corporation. Support and training for ntp-4 are 2023-06-09T04:34:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: available at https://www.nwtime.org/support 2023-06-09T04:34:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: ---------------------------------------------------- 2023-06-09T04:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: proto: precision = 0.046 usec (-24) 2023-06-09T04:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: basedate set to 2022-02-04 2023-06-09T04:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: gps base set to 2022-02-06 (week 2196) 2023-06-09T04:34:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:34:32.341 INFO:teuthology.orchestra.run.smithi018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:34:32.342 INFO:teuthology.orchestra.run.smithi018.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:34:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T04:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T04:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T04:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listen normally on 3 ens1f0 172.21.15.18:123 2023-06-09T04:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listen normally on 4 lo [::1]:123 2023-06-09T04:34:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1362%4]:123 2023-06-09T04:34:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:32 ntpd[27234]: Listening on routing socket on fd #22 for interface updates 2023-06-09T04:34:32.369 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-09T04:34:32.369 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Command line: ntpd -gq 2023-06-09T04:34:32.369 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: ---------------------------------------------------- 2023-06-09T04:34:32.369 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: ntp-4 is maintained by Network Time Foundation, 2023-06-09T04:34:32.369 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-09T04:34:32.370 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: corporation. Support and training for ntp-4 are 2023-06-09T04:34:32.370 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: available at https://www.nwtime.org/support 2023-06-09T04:34:32.370 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: ---------------------------------------------------- 2023-06-09T04:34:32.371 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: proto: precision = 0.043 usec (-24) 2023-06-09T04:34:32.371 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: basedate set to 2022-02-04 2023-06-09T04:34:32.371 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: gps base set to 2022-02-06 (week 2196) 2023-06-09T04:34:32.371 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:34:32.372 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:34:32.372 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:34:32.373 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:34:32.373 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T04:34:32.373 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T04:34:32.373 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T04:34:32.373 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2023-06-09T04:34:32.374 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listen normally on 4 lo [::1]:123 2023-06-09T04:34:32.374 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2023-06-09T04:34:32.374 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:32 ntpd[27372]: Listening on routing socket on fd #22 for interface updates 2023-06-09T04:34:33.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:33 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:33.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:33 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:33.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:33 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:33.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:33 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:33.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:33 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:33.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:33 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:35.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:35 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:35 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:35 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:35 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:35 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:35.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:35 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:35.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:35.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:35.374 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:35 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:36.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:36 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:36.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:36 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:36.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:36 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:36.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:36 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:36.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:36 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:36.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:36 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:37.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:37.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:37 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:37.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:37.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:37.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:37.373 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:37 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:38.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:38 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:38.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:38 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:38.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:38 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:38.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:38 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:38.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:38 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:38.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:38 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:39.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.339 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:39.340 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:39.341 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:39.341 INFO:teuthology.orchestra.run.smithi018.stdout: 9 Jun 04:34:39 ntpd[27234]: ntpd: time slew -0.000833 s 2023-06-09T04:34:39.341 INFO:teuthology.orchestra.run.smithi018.stdout:ntpd: time slew -0.000833s 2023-06-09T04:34:39.342 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T04:34:39.342 INFO:teuthology.orchestra.run.smithi018.stderr: 9 Jun 04:34:39 ntpd[27234]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T04:34:39.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:39.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:39.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:39 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T04:34:39.427 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2023-06-09T04:34:39.427 INFO:teuthology.orchestra.run.smithi018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:39.428 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:41.369 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:34:41.370 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:34:41.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:34:41.371 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:34:41.371 INFO:teuthology.orchestra.run.smithi081.stdout: 9 Jun 04:34:41 ntpd[27372]: ntpd: time slew -0.002300 s 2023-06-09T04:34:41.371 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew -0.002300s 2023-06-09T04:34:41.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T04:34:41.372 INFO:teuthology.orchestra.run.smithi081.stderr: 9 Jun 04:34:41 ntpd[27372]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T04:34:41.505 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T04:34:41.506 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2023-06-09T04:34:41.506 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:41.506 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:41.506 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:41.506 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-09T04:34:41.507 INFO:teuthology.run_tasks:Running task install... 2023-06-09T04:34:41.515 DEBUG:teuthology.task.install:project ceph 2023-06-09T04:34:41.516 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-09T04:34:41.516 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-09T04:34:41.516 INFO:teuthology.task.install:Using flavor: default 2023-06-09T04:34:41.522 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-09T04:34:41.522 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-09T04:34:41.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2023-06-09T04:34:41.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2023-06-09T04:34:41.590 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-09T04:34:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-09T04:34:41.621 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T04:34:41.621 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T04:34:41.622 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T04:34:41.622 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T04:34:41.623 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:34:41.636 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T04:34:41.636 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T04:34:41.637 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T04:34:41.637 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T04:34:41.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:34:41.769 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default/ 2023-06-09T04:34:41.769 INFO:teuthology.task.install.deb:Package version is 18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:34:41.877 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default/ 2023-06-09T04:34:41.877 INFO:teuthology.task.install.deb:Package version is 18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:34:41.954 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:34:41.955 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T04:34:41.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2023-06-09T04:34:42.061 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:34:42.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T04:34:42.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-06-09T04:34:42.136 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-09T04:34:42.145 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-09T04:34:42.162 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-09T04:34:42.236 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-09T04:34:42.267 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-09T04:34:42.277 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-09T04:34:42.307 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-09T04:34:42.348 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-09T04:34:42.358 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-09T04:34:42.363 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy InRelease 2023-06-09T04:34:42.388 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-06-09T04:34:42.404 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-09T04:34:42.435 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2023-06-09T04:34:42.440 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-09T04:34:42.445 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-09T04:34:42.486 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2023-06-09T04:34:42.505 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 28.5 kB in 0s (79.5 kB/s) 2023-06-09T04:34:42.522 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-09T04:34:42.533 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-06-09T04:34:42.662 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.5 kB in 0s (69.8 kB/s) 2023-06-09T04:34:43.282 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:34:43.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4313-ga02638f8-1jammy cephadm=18.0.0-4313-ga02638f8-1jammy ceph-mds=18.0.0-4313-ga02638f8-1jammy ceph-mgr=18.0.0-4313-ga02638f8-1jammy ceph-common=18.0.0-4313-ga02638f8-1jammy ceph-fuse=18.0.0-4313-ga02638f8-1jammy ceph-test=18.0.0-4313-ga02638f8-1jammy ceph-volume=18.0.0-4313-ga02638f8-1jammy radosgw=18.0.0-4313-ga02638f8-1jammy python3-rados=18.0.0-4313-ga02638f8-1jammy python3-rgw=18.0.0-4313-ga02638f8-1jammy python3-cephfs=18.0.0-4313-ga02638f8-1jammy python3-rbd=18.0.0-4313-ga02638f8-1jammy libcephfs2=18.0.0-4313-ga02638f8-1jammy libcephfs-dev=18.0.0-4313-ga02638f8-1jammy librados2=18.0.0-4313-ga02638f8-1jammy librbd1=18.0.0-4313-ga02638f8-1jammy rbd-fuse=18.0.0-4313-ga02638f8-1jammy python3-cephfs=18.0.0-4313-ga02638f8-1jammy cephfs-shell=18.0.0-4313-ga02638f8-1jammy cephfs-top=18.0.0-4313-ga02638f8-1jammy cephfs-mirror=18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:34:43.361 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:34:43.448 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:34:43.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4313-ga02638f8-1jammy cephadm=18.0.0-4313-ga02638f8-1jammy ceph-mds=18.0.0-4313-ga02638f8-1jammy ceph-mgr=18.0.0-4313-ga02638f8-1jammy ceph-common=18.0.0-4313-ga02638f8-1jammy ceph-fuse=18.0.0-4313-ga02638f8-1jammy ceph-test=18.0.0-4313-ga02638f8-1jammy ceph-volume=18.0.0-4313-ga02638f8-1jammy radosgw=18.0.0-4313-ga02638f8-1jammy python3-rados=18.0.0-4313-ga02638f8-1jammy python3-rgw=18.0.0-4313-ga02638f8-1jammy python3-cephfs=18.0.0-4313-ga02638f8-1jammy python3-rbd=18.0.0-4313-ga02638f8-1jammy libcephfs2=18.0.0-4313-ga02638f8-1jammy libcephfs-dev=18.0.0-4313-ga02638f8-1jammy librados2=18.0.0-4313-ga02638f8-1jammy librbd1=18.0.0-4313-ga02638f8-1jammy rbd-fuse=18.0.0-4313-ga02638f8-1jammy python3-cephfs=18.0.0-4313-ga02638f8-1jammy cephfs-shell=18.0.0-4313-ga02638f8-1jammy cephfs-top=18.0.0-4313-ga02638f8-1jammy cephfs-mirror=18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:34:43.525 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:34:43.538 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2023-06-09T04:34:43.538 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2023-06-09T04:34:43.699 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-09T04:34:43.699 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-09T04:34:43.702 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:34:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:34:43.702 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:34:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:34:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-09T04:34:43.703 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-09T04:34:43.704 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:34:43.705 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2023-06-09T04:34:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T04:34:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-09T04:34:43.705 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-09T04:34:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-09T04:34:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-09T04:34:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-09T04:34:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-09T04:34:43.706 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T04:34:43.707 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-09T04:34:43.708 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-09T04:34:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T04:34:43.709 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2023-06-09T04:34:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-09T04:34:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-09T04:34:43.709 INFO:teuthology.orchestra.run.smithi018.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-09T04:34:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-09T04:34:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-09T04:34:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-09T04:34:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: python3-watchdog 2023-06-09T04:34:43.710 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2023-06-09T04:34:43.710 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2023-06-09T04:34:43.813 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2023-06-09T04:34:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T04:34:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T04:34:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T04:34:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-09T04:34:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-09T04:34:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-09T04:34:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-09T04:34:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-09T04:34:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-09T04:34:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-09T04:34:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-09T04:34:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-09T04:34:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-09T04:34:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: socat xmlstarlet 2023-06-09T04:34:43.858 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:34:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:34:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:34:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:34:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-09T04:34:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-09T04:34:43.860 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-09T04:34:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-09T04:34:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-09T04:34:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-09T04:34:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-09T04:34:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-09T04:34:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T04:34:43.864 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-06-09T04:34:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: python3-watchdog 2023-06-09T04:34:43.865 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-06-09T04:34:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2023-06-09T04:34:43.874 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 115 newly installed, 0 to remove and 189 not upgraded. 2023-06-09T04:34:43.874 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 175 MB of archives. 2023-06-09T04:34:43.875 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 792 MB of additional disk space will be used. 2023-06-09T04:34:43.875 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-09T04:34:43.892 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-09T04:34:43.901 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-09T04:34:43.942 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-09T04:34:43.951 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-09T04:34:43.956 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4313-ga02638f8-1jammy [3,402 kB] 2023-06-09T04:34:43.966 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-06-09T04:34:43.967 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T04:34:43.967 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T04:34:43.967 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T04:34:43.968 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-09T04:34:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-09T04:34:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-09T04:34:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-09T04:34:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-09T04:34:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-09T04:34:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-09T04:34:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-09T04:34:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-09T04:34:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-09T04:34:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-09T04:34:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-09T04:34:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-09T04:34:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-09T04:34:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-09T04:34:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-09T04:34:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T04:34:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-09T04:34:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T04:34:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-09T04:34:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-09T04:34:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-09T04:34:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-09T04:34:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-09T04:34:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: socat xmlstarlet 2023-06-09T04:34:43.976 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-09T04:34:43.979 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-09T04:34:44.025 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-09T04:34:44.029 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-09T04:34:44.040 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-09T04:34:44.078 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-09T04:34:44.119 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-09T04:34:44.154 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 115 newly installed, 0 to remove and 189 not upgraded. 2023-06-09T04:34:44.155 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 175 MB of archives. 2023-06-09T04:34:44.155 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 792 MB of additional disk space will be used. 2023-06-09T04:34:44.155 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-09T04:34:44.156 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4313-ga02638f8-1jammy [3,093 kB] 2023-06-09T04:34:44.193 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-09T04:34:44.195 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-09T04:34:44.195 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-09T04:34:44.198 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-09T04:34:44.199 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-09T04:34:44.199 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-09T04:34:44.235 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-09T04:34:44.237 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-09T04:34:44.250 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4313-ga02638f8-1jammy [657 kB] 2023-06-09T04:34:44.252 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-09T04:34:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4313-ga02638f8-1jammy [3,402 kB] 2023-06-09T04:34:44.256 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-09T04:34:44.259 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-09T04:34:44.271 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4313-ga02638f8-1jammy [343 kB] 2023-06-09T04:34:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-09T04:34:44.283 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4313-ga02638f8-1jammy [23.0 kB] 2023-06-09T04:34:44.283 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4313-ga02638f8-1jammy [170 kB] 2023-06-09T04:34:44.289 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4313-ga02638f8-1jammy [49.0 kB] 2023-06-09T04:34:44.290 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4313-ga02638f8-1jammy [318 kB] 2023-06-09T04:34:44.302 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4313-ga02638f8-1jammy [5,872 kB] 2023-06-09T04:34:44.311 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-09T04:34:44.314 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-09T04:34:44.316 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-09T04:34:44.316 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-09T04:34:44.321 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T04:34:44.322 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-09T04:34:44.323 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-09T04:34:44.362 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-09T04:34:44.415 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-09T04:34:44.418 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-09T04:34:44.474 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-09T04:34:44.475 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-09T04:34:44.476 INFO:teuthology.orchestra.run.smithi018.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-09T04:34:44.477 INFO:teuthology.orchestra.run.smithi018.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-09T04:34:44.478 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-09T04:34:44.480 INFO:teuthology.orchestra.run.smithi018.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-09T04:34:44.486 INFO:teuthology.orchestra.run.smithi018.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-09T04:34:44.487 INFO:teuthology.orchestra.run.smithi018.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-09T04:34:44.490 INFO:teuthology.orchestra.run.smithi018.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-09T04:34:44.504 INFO:teuthology.orchestra.run.smithi018.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4313-ga02638f8-1jammy [102 kB] 2023-06-09T04:34:44.507 INFO:teuthology.orchestra.run.smithi018.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4313-ga02638f8-1jammy [429 kB] 2023-06-09T04:34:44.520 INFO:teuthology.orchestra.run.smithi018.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4313-ga02638f8-1jammy [21.9 MB] 2023-06-09T04:34:44.521 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-09T04:34:44.526 INFO:teuthology.orchestra.run.smithi018.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-09T04:34:44.596 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-09T04:34:44.607 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-09T04:34:44.612 INFO:teuthology.orchestra.run.smithi018.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-09T04:34:44.615 INFO:teuthology.orchestra.run.smithi018.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-09T04:34:44.631 INFO:teuthology.orchestra.run.smithi018.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-09T04:34:44.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-09T04:34:44.735 INFO:teuthology.orchestra.run.smithi018.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-09T04:34:44.736 INFO:teuthology.orchestra.run.smithi018.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-09T04:34:44.738 INFO:teuthology.orchestra.run.smithi018.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-09T04:34:44.738 INFO:teuthology.orchestra.run.smithi018.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T04:34:44.739 INFO:teuthology.orchestra.run.smithi018.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-09T04:34:44.740 INFO:teuthology.orchestra.run.smithi018.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-09T04:34:44.760 INFO:teuthology.orchestra.run.smithi018.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-09T04:34:44.796 INFO:teuthology.orchestra.run.smithi018.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-09T04:34:44.819 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-09T04:34:44.828 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-09T04:34:44.832 INFO:teuthology.orchestra.run.smithi018.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-09T04:34:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-09T04:34:44.943 INFO:teuthology.orchestra.run.smithi018.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-09T04:34:44.943 INFO:teuthology.orchestra.run.smithi018.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-09T04:34:44.945 INFO:teuthology.orchestra.run.smithi018.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-09T04:34:44.946 INFO:teuthology.orchestra.run.smithi018.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-09T04:34:44.947 INFO:teuthology.orchestra.run.smithi018.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-09T04:34:44.949 INFO:teuthology.orchestra.run.smithi018.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-09T04:34:44.949 INFO:teuthology.orchestra.run.smithi018.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-09T04:34:44.951 INFO:teuthology.orchestra.run.smithi018.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-09T04:34:44.958 INFO:teuthology.orchestra.run.smithi018.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-09T04:34:44.996 INFO:teuthology.orchestra.run.smithi018.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-09T04:34:45.026 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-09T04:34:45.072 INFO:teuthology.orchestra.run.smithi018.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-09T04:34:45.077 INFO:teuthology.orchestra.run.smithi018.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-09T04:34:45.109 INFO:teuthology.orchestra.run.smithi018.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-09T04:34:45.120 INFO:teuthology.orchestra.run.smithi018.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-09T04:34:45.121 INFO:teuthology.orchestra.run.smithi018.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-09T04:34:45.134 INFO:teuthology.orchestra.run.smithi018.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-09T04:34:45.141 INFO:teuthology.orchestra.run.smithi018.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-09T04:34:45.142 INFO:teuthology.orchestra.run.smithi018.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T04:34:45.144 INFO:teuthology.orchestra.run.smithi018.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-09T04:34:45.144 INFO:teuthology.orchestra.run.smithi018.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-09T04:34:45.182 INFO:teuthology.orchestra.run.smithi018.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-09T04:34:45.221 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-09T04:34:45.244 INFO:teuthology.orchestra.run.smithi018.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-09T04:34:45.328 INFO:teuthology.orchestra.run.smithi018.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-09T04:34:45.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-09T04:34:45.358 INFO:teuthology.orchestra.run.smithi018.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-09T04:34:45.360 INFO:teuthology.orchestra.run.smithi018.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4313-ga02638f8-1jammy [6,825 kB] 2023-06-09T04:34:45.363 INFO:teuthology.orchestra.run.smithi018.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-09T04:34:45.365 INFO:teuthology.orchestra.run.smithi018.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-09T04:34:45.516 INFO:teuthology.orchestra.run.smithi018.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4313-ga02638f8-1jammy [226 kB] 2023-06-09T04:34:45.522 INFO:teuthology.orchestra.run.smithi018.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4313-ga02638f8-1jammy [114 kB] 2023-06-09T04:34:45.526 INFO:teuthology.orchestra.run.smithi018.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4313-ga02638f8-1jammy [1,469 kB] 2023-06-09T04:34:45.579 INFO:teuthology.orchestra.run.smithi018.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4313-ga02638f8-1jammy [9,851 kB] 2023-06-09T04:34:45.588 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-09T04:34:45.595 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-09T04:34:45.597 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-09T04:34:45.608 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-09T04:34:45.609 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-09T04:34:45.610 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-09T04:34:45.613 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-09T04:34:45.615 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-09T04:34:45.616 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-09T04:34:45.781 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-09T04:34:45.934 INFO:teuthology.orchestra.run.smithi018.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4313-ga02638f8-1jammy [31.6 MB] 2023-06-09T04:34:46.197 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4313-ga02638f8-1jammy [3,093 kB] 2023-06-09T04:34:46.211 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-09T04:34:46.221 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-09T04:34:46.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-09T04:34:46.230 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-09T04:34:46.248 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T04:34:46.251 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-09T04:34:46.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-09T04:34:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-09T04:34:46.309 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-09T04:34:46.314 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-09T04:34:46.566 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-09T04:34:46.649 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-09T04:34:46.739 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-09T04:34:46.796 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-09T04:34:46.917 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-09T04:34:46.976 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4313-ga02638f8-1jammy [657 kB] 2023-06-09T04:34:47.004 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-09T04:34:47.022 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-09T04:34:47.051 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-09T04:34:47.063 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-09T04:34:47.101 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4313-ga02638f8-1jammy [343 kB] 2023-06-09T04:34:47.101 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-09T04:34:47.108 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-09T04:34:47.168 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4313-ga02638f8-1jammy [23.0 kB] 2023-06-09T04:34:47.172 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4313-ga02638f8-1jammy [170 kB] 2023-06-09T04:34:47.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4313-ga02638f8-1jammy [49.0 kB] 2023-06-09T04:34:47.212 INFO:teuthology.orchestra.run.smithi018.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4313-ga02638f8-1jammy [3,594 B] 2023-06-09T04:34:47.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4313-ga02638f8-1jammy [318 kB] 2023-06-09T04:34:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4313-ga02638f8-1jammy [5,872 kB] 2023-06-09T04:34:47.296 INFO:teuthology.orchestra.run.smithi018.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4313-ga02638f8-1jammy [810 kB] 2023-06-09T04:34:47.301 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-09T04:34:47.312 INFO:teuthology.orchestra.run.smithi018.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4313-ga02638f8-1jammy [2,160 kB] 2023-06-09T04:34:47.353 INFO:teuthology.orchestra.run.smithi018.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4313-ga02638f8-1jammy [211 kB] 2023-06-09T04:34:47.357 INFO:teuthology.orchestra.run.smithi018.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4313-ga02638f8-1jammy [124 kB] 2023-06-09T04:34:47.359 INFO:teuthology.orchestra.run.smithi018.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4313-ga02638f8-1jammy [1,840 kB] 2023-06-09T04:34:47.382 INFO:teuthology.orchestra.run.smithi018.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4313-ga02638f8-1jammy [8,615 kB] 2023-06-09T04:34:47.717 INFO:teuthology.orchestra.run.smithi018.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4313-ga02638f8-1jammy [3,726 B] 2023-06-09T04:34:47.718 INFO:teuthology.orchestra.run.smithi018.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4313-ga02638f8-1jammy [40.9 MB] 2023-06-09T04:34:48.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4313-ga02638f8-1jammy [102 kB] 2023-06-09T04:34:48.065 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4313-ga02638f8-1jammy [429 kB] 2023-06-09T04:34:48.114 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-09T04:34:48.116 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-09T04:34:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-09T04:34:48.120 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T04:34:48.120 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-09T04:34:48.121 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4313-ga02638f8-1jammy [21.9 MB] 2023-06-09T04:34:48.122 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-09T04:34:48.164 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-09T04:34:48.168 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-09T04:34:48.168 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-09T04:34:48.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-09T04:34:48.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-09T04:34:48.648 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-09T04:34:48.681 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-09T04:34:48.709 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-09T04:34:48.760 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-09T04:34:48.779 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-09T04:34:48.809 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-09T04:34:48.938 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-09T04:34:48.969 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-09T04:34:48.989 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-09T04:34:48.997 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-09T04:34:49.201 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-09T04:34:49.664 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-09T04:34:49.669 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-09T04:34:49.725 INFO:teuthology.orchestra.run.smithi018.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4313-ga02638f8-1jammy [231 kB] 2023-06-09T04:34:49.729 INFO:teuthology.orchestra.run.smithi018.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4313-ga02638f8-1jammy [214 kB] 2023-06-09T04:34:49.734 INFO:teuthology.orchestra.run.smithi018.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4313-ga02638f8-1jammy [23.8 kB] 2023-06-09T04:34:49.734 INFO:teuthology.orchestra.run.smithi018.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4313-ga02638f8-1jammy [13.2 kB] 2023-06-09T04:34:49.735 INFO:teuthology.orchestra.run.smithi018.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4313-ga02638f8-1jammy [28.4 kB] 2023-06-09T04:34:49.736 INFO:teuthology.orchestra.run.smithi018.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4313-ga02638f8-1jammy [11.6 MB] 2023-06-09T04:34:49.796 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-09T04:34:49.843 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-09T04:34:49.844 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T04:34:49.849 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-09T04:34:49.851 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-09T04:34:49.867 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-09T04:34:49.874 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-09T04:34:49.935 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-09T04:34:50.100 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-09T04:34:50.124 INFO:teuthology.orchestra.run.smithi018.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4313-ga02638f8-1jammy [82.1 kB] 2023-06-09T04:34:50.270 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-09T04:34:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4313-ga02638f8-1jammy [6,825 kB] 2023-06-09T04:34:50.548 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-09T04:34:50.573 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-09T04:34:50.689 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 175 MB in 6s (27.8 MB/s) 2023-06-09T04:34:50.786 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4313-ga02638f8-1jammy [226 kB] 2023-06-09T04:34:50.795 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4313-ga02638f8-1jammy [114 kB] 2023-06-09T04:34:50.799 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4313-ga02638f8-1jammy [1,469 kB] 2023-06-09T04:34:50.807 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T04:34:50.875 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4313-ga02638f8-1jammy [9,851 kB] 2023-06-09T04:34:50.903 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-09T04:34:50.909 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-09T04:34:50.955 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-09T04:34:51.258 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T04:34:51.285 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-09T04:34:51.324 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-09T04:34:51.467 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4313-ga02638f8-1jammy [31.6 MB] 2023-06-09T04:34:51.652 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T04:34:51.679 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-09T04:34:51.719 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-09T04:34:52.030 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-09T04:34:52.046 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-09T04:34:52.114 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-09T04:34:52.425 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-09T04:34:52.452 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-09T04:34:52.491 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-09T04:34:52.837 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T04:34:52.864 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-09T04:34:52.903 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-09T04:34:53.240 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T04:34:53.267 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-09T04:34:53.286 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4313-ga02638f8-1jammy [3,594 B] 2023-06-09T04:34:53.287 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4313-ga02638f8-1jammy [810 kB] 2023-06-09T04:34:53.303 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4313-ga02638f8-1jammy [2,160 kB] 2023-06-09T04:34:53.306 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-09T04:34:53.341 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4313-ga02638f8-1jammy [211 kB] 2023-06-09T04:34:53.345 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4313-ga02638f8-1jammy [124 kB] 2023-06-09T04:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4313-ga02638f8-1jammy [1,840 kB] 2023-06-09T04:34:53.421 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4313-ga02638f8-1jammy [8,615 kB] 2023-06-09T04:34:53.668 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T04:34:53.695 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-09T04:34:53.743 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:34:53.819 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4313-ga02638f8-1jammy [3,726 B] 2023-06-09T04:34:53.820 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4313-ga02638f8-1jammy [40.9 MB] 2023-06-09T04:34:54.188 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T04:34:54.214 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-09T04:34:54.254 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:34:54.574 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T04:34:54.601 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-09T04:34:54.641 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:34:54.978 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-09T04:34:55.005 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-09T04:34:55.044 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-09T04:34:55.372 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librados2. 2023-06-09T04:34:55.399 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../011-librados2_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:55.489 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:55.825 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4313-ga02638f8-1jammy [231 kB] 2023-06-09T04:34:55.830 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4313-ga02638f8-1jammy [214 kB] 2023-06-09T04:34:55.834 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4313-ga02638f8-1jammy [23.8 kB] 2023-06-09T04:34:55.835 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4313-ga02638f8-1jammy [13.2 kB] 2023-06-09T04:34:55.890 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4313-ga02638f8-1jammy [28.4 kB] 2023-06-09T04:34:55.891 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4313-ga02638f8-1jammy [11.6 MB] 2023-06-09T04:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librbd1. 2023-06-09T04:34:55.943 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../012-librbd1_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:55.983 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:56.378 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T04:34:56.393 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:56.436 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:56.450 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4313-ga02638f8-1jammy [82.1 kB] 2023-06-09T04:34:56.713 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rados. 2023-06-09T04:34:56.740 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:56.780 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:56.991 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 175 MB in 12s (14.0 MB/s) 2023-06-09T04:34:57.096 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T04:34:57.108 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T04:34:57.135 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:34:57.174 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:57.182 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-09T04:34:57.187 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-09T04:34:57.220 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-09T04:34:57.410 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T04:34:57.427 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:57.469 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:57.506 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T04:34:57.532 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-09T04:34:57.573 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-09T04:34:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T04:34:57.815 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:34:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T04:34:57.918 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-09T04:34:57.959 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-09T04:34:58.141 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T04:34:58.157 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-09T04:34:58.190 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-09T04:34:58.287 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-09T04:34:58.313 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-09T04:34:58.395 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-09T04:34:58.469 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T04:34:58.485 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:58.527 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:58.707 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-09T04:34:58.733 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-09T04:34:58.765 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-09T04:34:58.813 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T04:34:58.840 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-09T04:34:58.871 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-09T04:34:59.068 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T04:34:59.094 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-09T04:34:59.152 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-09T04:34:59.199 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librgw2. 2023-06-09T04:34:59.226 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../021-librgw2_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:59.265 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:59.488 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T04:34:59.514 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-09T04:34:59.554 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-09T04:34:59.768 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T04:34:59.784 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:34:59.828 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:34:59.950 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T04:34:59.976 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-09T04:35:00.016 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:35:00.089 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-09T04:35:00.116 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-09T04:35:00.156 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-09T04:35:00.387 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T04:35:00.412 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-09T04:35:00.453 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:35:00.475 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T04:35:00.502 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:00.575 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:00.798 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T04:35:00.824 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-09T04:35:00.864 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:35:00.979 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-common. 2023-06-09T04:35:01.005 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:01.045 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:01.193 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-09T04:35:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-09T04:35:01.250 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-09T04:35:01.520 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2023-06-09T04:35:01.546 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librados2_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:01.612 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:02.049 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2023-06-09T04:35:02.075 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-librbd1_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:02.115 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:02.459 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-base. 2023-06-09T04:35:02.486 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:02.501 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T04:35:02.524 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:02.535 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:02.559 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:02.820 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2023-06-09T04:35:02.835 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:02.878 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:03.257 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T04:35:03.271 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-09T04:35:03.283 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:03.298 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-09T04:35:03.323 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:03.338 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-09T04:35:03.567 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T04:35:03.582 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:03.617 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:03.640 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cheroot. 2023-06-09T04:35:03.667 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-09T04:35:03.707 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-09T04:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-09T04:35:04.062 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-09T04:35:04.101 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-09T04:35:04.128 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T04:35:04.154 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:04.211 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:04.346 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-09T04:35:04.373 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-09T04:35:04.404 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-09T04:35:04.540 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T04:35:04.566 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-09T04:35:04.606 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-09T04:35:04.707 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-09T04:35:04.753 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-09T04:35:04.774 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-09T04:35:04.851 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T04:35:04.876 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:04.917 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:05.076 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempora. 2023-06-09T04:35:05.103 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-09T04:35:05.143 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-09T04:35:05.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T04:35:05.243 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-09T04:35:05.278 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-09T04:35:05.513 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-portend. 2023-06-09T04:35:05.539 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-09T04:35:05.573 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2023-06-09T04:35:05.587 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-09T04:35:05.599 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-librgw2_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:05.639 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:06.142 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T04:35:06.157 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:06.174 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-09T04:35:06.200 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:06.201 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-09T04:35:06.240 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-09T04:35:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-09T04:35:06.546 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-09T04:35:06.568 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T04:35:06.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-09T04:35:06.595 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-09T04:35:06.634 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-09T04:35:06.889 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T04:35:06.916 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:06.956 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:07.047 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T04:35:07.074 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-09T04:35:07.121 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-09T04:35:07.384 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2023-06-09T04:35:07.410 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:07.451 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:07.499 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T04:35:07.526 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-09T04:35:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-09T04:35:07.877 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T04:35:07.904 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-09T04:35:07.943 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-09T04:35:08.255 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-mako. 2023-06-09T04:35:08.282 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-09T04:35:08.321 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-09T04:35:08.657 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2023-06-09T04:35:08.683 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T04:35:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:08.710 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T04:35:08.732 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:08.749 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:35:09.019 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T04:35:09.046 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-09T04:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-09T04:35:09.355 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webob. 2023-06-09T04:35:09.382 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-09T04:35:09.411 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-09T04:35:09.421 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-09T04:35:09.438 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-09T04:35:09.469 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-09T04:35:09.755 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2023-06-09T04:35:09.782 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-09T04:35:09.782 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T04:35:09.810 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-09T04:35:09.822 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-09T04:35:09.852 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-09T04:35:10.142 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-09T04:35:10.160 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T04:35:10.168 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-09T04:35:10.187 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-09T04:35:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-09T04:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-09T04:35:10.494 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-09T04:35:10.521 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-09T04:35:10.561 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-09T04:35:10.563 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-paste. 2023-06-09T04:35:10.590 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-09T04:35:10.629 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-09T04:35:10.822 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-09T04:35:10.837 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-09T04:35:10.880 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-09T04:35:10.966 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T04:35:10.982 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-09T04:35:11.024 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-09T04:35:11.158 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2023-06-09T04:35:11.184 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-09T04:35:11.225 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-09T04:35:11.327 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T04:35:11.354 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-09T04:35:11.393 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-09T04:35:11.528 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2023-06-09T04:35:11.554 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-09T04:35:11.594 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-09T04:35:11.663 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T04:35:11.690 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-09T04:35:11.721 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-09T04:35:11.880 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-09T04:35:11.907 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-09T04:35:11.947 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-09T04:35:12.007 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T04:35:12.034 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-09T04:35:12.074 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-09T04:35:12.216 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T04:35:12.232 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-09T04:35:12.266 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-09T04:35:12.420 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-certifi. 2023-06-09T04:35:12.447 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-09T04:35:12.486 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-09T04:35:12.595 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T04:35:12.622 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-09T04:35:12.661 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-09T04:35:12.823 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-idna. 2023-06-09T04:35:12.850 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-09T04:35:12.889 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-09T04:35:12.965 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T04:35:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-09T04:35:13.031 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-09T04:35:13.201 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-urllib3. 2023-06-09T04:35:13.228 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-09T04:35:13.267 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-09T04:35:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T04:35:13.291 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-09T04:35:13.326 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-09T04:35:13.595 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests. 2023-06-09T04:35:13.620 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2023-06-09T04:35:13.622 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-09T04:35:13.647 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-09T04:35:13.661 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-09T04:35:13.687 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-09T04:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T04:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-09T04:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-09T04:35:14.024 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T04:35:14.050 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T04:35:14.090 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:35:14.317 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T04:35:14.334 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:14.375 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:14.393 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T04:35:14.419 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-09T04:35:14.479 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-09T04:35:14.721 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2023-06-09T04:35:14.747 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-09T04:35:14.779 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-09T04:35:14.780 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T04:35:14.807 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:14.847 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:15.107 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T04:35:15.124 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T04:35:15.133 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-09T04:35:15.140 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-09T04:35:15.174 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-09T04:35:15.177 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-09T04:35:15.477 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T04:35:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-09T04:35:15.543 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-09T04:35:15.846 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2023-06-09T04:35:15.873 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-09T04:35:15.912 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-09T04:35:16.203 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T04:35:16.224 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T04:35:16.230 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:16.240 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-09T04:35:16.269 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:16.282 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-09T04:35:16.569 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T04:35:16.595 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-09T04:35:16.635 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-09T04:35:16.665 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T04:35:16.691 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:16.731 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:16.938 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T04:35:16.965 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-09T04:35:17.005 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-09T04:35:17.334 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T04:35:17.360 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-09T04:35:17.576 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T04:35:17.603 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:17.634 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:17.791 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-09T04:35:18.421 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2023-06-09T04:35:18.447 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-09T04:35:18.487 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-09T04:35:18.824 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2023-06-09T04:35:18.851 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-09T04:35:18.891 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-09T04:35:19.160 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2023-06-09T04:35:19.187 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-09T04:35:19.227 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-09T04:35:19.538 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph. 2023-06-09T04:35:19.564 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../061-ceph_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:19.738 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2023-06-09T04:35:19.765 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-09T04:35:19.805 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-09T04:35:19.940 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T04:35:19.967 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:20.006 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:20.116 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T04:35:20.143 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-09T04:35:20.183 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-09T04:35:20.326 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T04:35:20.353 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:20.401 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:20.494 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T04:35:20.520 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:20.779 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephadm. 2023-06-09T04:35:20.806 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../064-cephadm_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:20.846 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:20.966 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T04:35:20.992 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:21.032 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:21.148 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T04:35:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-09T04:35:21.215 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-09T04:35:21.352 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T04:35:21.378 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-09T04:35:21.418 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-09T04:35:21.738 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T04:35:21.759 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-09T04:35:21.764 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:21.786 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-09T04:35:21.804 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:21.826 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-09T04:35:22.166 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T04:35:22.193 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:22.233 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:22.856 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-babel. 2023-06-09T04:35:22.884 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-09T04:35:22.914 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-09T04:35:23.145 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T04:35:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:23.211 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:23.218 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T04:35:23.244 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-09T04:35:23.275 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-09T04:35:23.587 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T04:35:23.603 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:23.637 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:23.924 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T04:35:23.951 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-09T04:35:23.990 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-09T04:35:24.293 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T04:35:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T04:35:24.359 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T04:35:24.662 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-routes. 2023-06-09T04:35:24.689 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-09T04:35:24.729 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-09T04:35:24.981 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2023-06-09T04:35:24.996 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-ceph_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:25.065 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T04:35:25.093 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:25.132 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:25.319 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T04:35:25.346 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:25.386 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:25.543 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-09T04:35:25.559 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-09T04:35:25.601 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-09T04:35:25.747 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T04:35:25.774 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:25.814 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:26.105 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T04:35:26.133 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-09T04:35:26.172 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-09T04:35:26.209 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2023-06-09T04:35:26.236 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-cephadm_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:26.275 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:26.534 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-09T04:35:26.561 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-09T04:35:26.587 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T04:35:26.600 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-09T04:35:26.613 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-09T04:35:26.653 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-09T04:35:26.937 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T04:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-09T04:35:26.972 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-09T04:35:26.988 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-09T04:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-09T04:35:27.031 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-09T04:35:27.744 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T04:35:27.773 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:27.811 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:28.070 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2023-06-09T04:35:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-09T04:35:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-09T04:35:28.473 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T04:35:28.500 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-09T04:35:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-09T04:35:28.731 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T04:35:28.758 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-09T04:35:28.797 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-09T04:35:28.885 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T04:35:28.911 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:28.951 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:29.100 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T04:35:29.128 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-09T04:35:29.166 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-09T04:35:29.280 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T04:35:29.306 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-09T04:35:29.346 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-09T04:35:29.503 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T04:35:29.531 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-09T04:35:29.569 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-09T04:35:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T04:35:29.659 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T04:35:29.699 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T04:35:29.864 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T04:35:29.892 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-09T04:35:29.930 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-09T04:35:30.211 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2023-06-09T04:35:30.237 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-09T04:35:30.277 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-09T04:35:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T04:35:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-09T04:35:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-09T04:35:30.614 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T04:35:30.640 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:30.680 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:30.713 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T04:35:30.741 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-09T04:35:30.780 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-09T04:35:31.041 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T04:35:31.057 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-09T04:35:31.091 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-09T04:35:31.142 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-09T04:35:31.169 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-09T04:35:31.208 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-09T04:35:31.386 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T04:35:31.413 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-09T04:35:31.452 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-09T04:35:31.729 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T04:35:31.756 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-09T04:35:31.796 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-09T04:35:32.150 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-09T04:35:32.158 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T04:35:32.175 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:32.176 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-09T04:35:32.216 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-09T04:35:32.216 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:32.494 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T04:35:32.522 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-09T04:35:32.552 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-09T04:35:32.619 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T04:35:32.646 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-09T04:35:32.686 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-09T04:35:32.880 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T04:35:32.908 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-09T04:35:32.947 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-09T04:35:33.216 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package jq. 2023-06-09T04:35:33.232 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-09T04:35:33.274 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-09T04:35:33.378 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T04:35:33.406 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:33.445 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:33.527 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package socat. 2023-06-09T04:35:33.554 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-09T04:35:33.593 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-09T04:35:33.905 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T04:35:33.921 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-09T04:35:33.963 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-09T04:35:34.342 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-test. 2023-06-09T04:35:34.370 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:34.398 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T04:35:34.408 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:34.425 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-09T04:35:34.464 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-09T04:35:34.742 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T04:35:34.770 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-09T04:35:34.809 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-09T04:35:35.112 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T04:35:35.128 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-09T04:35:35.162 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-09T04:35:35.457 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T04:35:35.484 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-09T04:35:35.523 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-09T04:35:35.946 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T04:35:35.973 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-09T04:35:36.012 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-09T04:35:36.332 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T04:35:36.359 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-09T04:35:36.398 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-09T04:35:36.462 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T04:35:36.490 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:36.520 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-volume (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:36.677 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T04:35:36.704 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-09T04:35:36.743 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-09T04:35:36.992 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T04:35:37.008 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:37.042 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-mirror (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:37.047 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T04:35:37.074 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-09T04:35:37.113 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-09T04:35:37.369 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T04:35:37.397 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-09T04:35:37.436 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-09T04:35:37.705 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T04:35:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:37.763 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-shell (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:37.777 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T04:35:37.793 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:37.827 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:38.024 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T04:35:38.040 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:38.082 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-top (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:38.138 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T04:35:38.166 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-09T04:35:38.205 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-09T04:35:38.293 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T04:35:38.309 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:38.343 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:38.550 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T04:35:38.577 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-09T04:35:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-09T04:35:38.721 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T04:35:38.749 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-09T04:35:38.788 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-09T04:35:38.886 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2023-06-09T04:35:38.901 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-09T04:35:38.936 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-09T04:35:39.134 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T04:35:39.150 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-09T04:35:39.155 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2023-06-09T04:35:39.171 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-09T04:35:39.192 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-09T04:35:39.213 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-09T04:35:39.550 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T04:35:39.565 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-09T04:35:39.608 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-09T04:35:39.662 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-09T04:35:39.690 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-09T04:35:39.728 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-09T04:35:39.946 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2023-06-09T04:35:39.961 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:40.004 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:40.034 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T04:35:40.062 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T04:35:40.100 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T04:35:40.395 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T04:35:40.423 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-09T04:35:40.461 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-09T04:35:40.773 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T04:35:40.801 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-09T04:35:40.839 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-09T04:35:41.201 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-py. 2023-06-09T04:35:41.229 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-09T04:35:41.268 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-09T04:35:41.596 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pygments. 2023-06-09T04:35:41.623 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-09T04:35:41.662 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-09T04:35:42.000 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T04:35:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:42.066 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:42.150 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T04:35:42.178 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-09T04:35:42.216 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-09T04:35:42.396 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T04:35:42.412 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:42.454 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-mirror (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:42.502 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-toml. 2023-06-09T04:35:42.530 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-09T04:35:42.569 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-09T04:35:42.724 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T04:35:42.751 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-09T04:35:42.790 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-09T04:35:42.872 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T04:35:42.899 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-09T04:35:42.938 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-09T04:35:43.051 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T04:35:43.067 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:43.109 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-shell (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:43.242 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T04:35:43.259 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-09T04:35:43.300 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-09T04:35:43.371 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T04:35:43.398 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4313-ga02638f8-1jammy_all.deb ... 2023-06-09T04:35:43.437 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-top (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:43.586 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T04:35:43.614 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-09T04:35:43.652 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-09T04:35:43.681 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T04:35:43.698 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:43.731 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T04:35:44.104 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-09T04:35:44.143 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-09T04:35:44.415 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package radosgw. 2023-06-09T04:35:44.443 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../113-radosgw_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:44.482 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T04:35:44.497 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-09T04:35:44.540 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-09T04:35:44.960 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-09T04:35:44.987 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-09T04:35:45.026 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-09T04:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T04:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:45.292 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:45.354 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T04:35:45.381 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T04:35:45.421 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T04:35:45.573 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-09T04:35:45.766 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T04:35:45.793 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-09T04:35:45.822 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-09T04:35:45.833 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-09T04:35:45.949 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-09T04:35:46.144 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T04:35:46.171 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-09T04:35:46.210 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-09T04:35:46.220 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-09T04:35:46.549 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-09T04:35:46.555 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2023-06-09T04:35:46.583 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-09T04:35:46.630 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-09T04:35:46.933 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2023-06-09T04:35:46.961 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-09T04:35:47.000 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-09T04:35:47.031 INFO:teuthology.orchestra.run.smithi018.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-09T04:35:47.218 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:47.471 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T04:35:47.498 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-09T04:35:47.537 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-09T04:35:47.786 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user cephadm....done 2023-06-09T04:35:47.840 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2023-06-09T04:35:47.868 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-09T04:35:47.907 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-09T04:35:47.941 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-09T04:35:48.210 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T04:35:48.226 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-09T04:35:48.237 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-09T04:35:48.276 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-09T04:35:48.485 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-09T04:35:48.611 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-09T04:35:48.630 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T04:35:48.657 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-09T04:35:48.696 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-09T04:35:48.871 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T04:35:48.965 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T04:35:48.982 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-09T04:35:49.049 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-09T04:35:49.113 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-09T04:35:49.223 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-09T04:35:49.550 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-09T04:35:49.737 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2023-06-09T04:35:49.764 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-radosgw_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:49.803 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:49.918 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-09T04:35:50.186 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-09T04:35:50.459 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-09T04:35:50.522 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T04:35:50.538 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4313-ga02638f8-1jammy_amd64.deb ... 2023-06-09T04:35:50.581 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:50.714 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-09T04:35:50.957 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-09T04:35:51.068 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-09T04:35:51.232 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-09T04:35:51.344 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-09T04:35:51.479 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-09T04:35:51.492 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:51.757 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-09T04:35:51.785 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-09T04:35:51.910 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-09T04:35:52.099 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-09T04:35:52.186 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-09T04:35:52.437 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-09T04:35:52.596 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-09T04:35:52.689 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:52.904 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-09T04:35:53.173 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2023-06-09T04:35:53.265 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-09T04:35:53.329 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-09T04:35:53.391 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-09T04:35:53.605 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-09T04:35:53.667 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-09T04:35:53.864 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-09T04:35:53.935 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-09T04:35:53.965 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-09T04:35:54.200 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T04:35:54.269 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-09T04:35:54.434 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-09T04:35:54.561 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-09T04:35:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-09T04:35:54.963 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-09T04:35:55.230 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-09T04:35:55.248 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-09T04:35:55.365 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-09T04:35:55.491 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-09T04:35:55.499 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-09T04:35:55.725 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-09T04:35:55.809 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-09T04:35:55.985 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-09T04:35:56.494 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-09T04:35:56.504 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-09T04:35:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:56.913 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-09T04:35:57.023 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-09T04:35:57.132 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-09T04:35:57.206 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-09T04:35:57.375 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-09T04:35:57.524 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-09T04:35:57.609 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-09T04:35:57.735 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-09T04:35:57.892 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-09T04:35:58.103 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-09T04:35:58.134 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-09T04:35:58.229 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-09T04:35:58.260 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:35:58.497 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-09T04:35:58.562 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-idna (3.3-1) ... 2023-06-09T04:35:58.773 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-09T04:35:58.879 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-09T04:35:59.058 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-09T04:35:59.676 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-09T04:35:59.928 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-09T04:36:00.054 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-09T04:36:00.135 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:36:00.180 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-09T04:36:00.269 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-09T04:36:00.472 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-09T04:36:00.529 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-09T04:36:00.655 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-09T04:36:00.789 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-09T04:36:00.890 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-09T04:36:01.099 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-09T04:36:01.133 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-09T04:36:01.342 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-09T04:36:01.552 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-09T04:36:01.585 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:36:01.711 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-09T04:36:01.837 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-09T04:36:01.845 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-09T04:36:02.146 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-09T04:36:02.146 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-09T04:36:02.389 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-09T04:36:02.472 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-09T04:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-09T04:36:02.715 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-09T04:36:02.824 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:02.916 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-09T04:36:03.168 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1) ... 2023-06-09T04:36:03.435 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-09T04:36:03.493 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-09T04:36:03.561 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-09T04:36:03.845 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-09T04:36:03.947 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-09T04:36:04.265 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-09T04:36:04.574 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-09T04:36:04.674 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:36:04.792 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-09T04:36:04.833 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-09T04:36:05.043 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-09T04:36:05.170 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-09T04:36:05.209 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-09T04:36:05.296 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-09T04:36:05.470 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-09T04:36:05.579 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-09T04:36:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-09T04:36:05.848 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-09T04:36:05.981 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-09T04:36:06.083 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:36:06.183 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-09T04:36:06.240 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-09T04:36:06.309 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-09T04:36:06.499 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:36:06.625 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-09T04:36:06.628 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-09T04:36:06.879 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-09T04:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-09T04:36:07.138 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-09T04:36:07.294 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-09T04:36:07.389 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-09T04:36:07.632 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-09T04:36:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-09T04:36:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-09T04:36:07.931 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-09T04:36:07.976 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-09T04:36:08.207 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-09T04:36:08.277 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-09T04:36:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-09T04:36:08.475 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-09T04:36:08.698 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-09T04:36:08.910 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T04:36:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-09T04:36:09.202 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-09T04:36:09.217 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-09T04:36:09.605 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-09T04:36:09.626 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-09T04:36:09.739 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:09.861 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-09T04:36:09.865 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:09.988 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-09T04:36:10.077 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:10.203 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:10.312 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:10.381 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-09T04:36:10.413 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-09T04:36:10.615 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-09T04:36:10.715 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:10.816 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:10.850 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-09T04:36:10.942 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:10.976 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-09T04:36:11.164 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:36:11.164 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:36:11.302 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-09T04:36:11.620 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-09T04:36:11.685 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:11.811 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:11.912 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-top (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:12.013 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-09T04:36:12.021 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-09T04:36:12.172 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-09T04:36:12.465 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-09T04:36:12.724 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-09T04:36:12.976 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-09T04:36:13.276 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:13.352 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T04:36:13.402 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:13.528 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:13.654 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-09T04:36:13.780 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-shell (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:13.890 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:14.006 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-09T04:36:14.132 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:14.258 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:14.408 INFO:teuthology.orchestra.run.smithi018.stdout:Adding group ceph....done 2023-06-09T04:36:14.452 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:14.579 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:14.713 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:14.768 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user ceph....done 2023-06-09T04:36:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-09T04:36:14.920 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties....done 2023-06-09T04:36:14.932 INFO:teuthology.orchestra.run.smithi018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T04:36:15.074 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T04:36:15.133 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:15.259 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:15.437 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T04:36:15.518 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:36:15.733 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-mirror (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:16.101 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:16.227 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:16.287 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:16.413 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:16.523 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-top (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:16.526 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:36:16.526 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:36:16.624 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-09T04:36:17.263 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:17.607 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T04:36:17.878 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.004 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.123 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.130 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.256 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.346 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:36:18.346 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:36:18.382 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-shell (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.492 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.875 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:18.967 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2023-06-09T04:36:19.096 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:36:19.096 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:36:19.303 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2023-06-09T04:36:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2023-06-09T04:36:19.485 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T04:36:19.601 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:19.621 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T04:36:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:36:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:36:19.961 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T04:36:20.461 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:20.477 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-mirror (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:20.587 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:20.594 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:20.720 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:20.738 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:20.968 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:36:20.968 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:36:20.978 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:36:20.978 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:36:21.506 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:21.632 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:21.681 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:21.758 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:21.909 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-volume (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:22.020 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T04:36:22.036 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-09T04:36:22.508 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:22.725 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:36:22.725 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:36:23.112 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-09T04:36:23.243 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:23.449 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:36:23.450 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:36:23.573 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:36:23.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T04:36:23.631 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:36:23.810 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2023-06-09T04:36:23.810 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2023-06-09T04:36:23.953 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:23.971 INFO:teuthology.orchestra.run.smithi018.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-09T04:36:23.971 INFO:teuthology.orchestra.run.smithi018.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-09T04:36:23.972 INFO:teuthology.orchestra.run.smithi018.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:36:23.972 INFO:teuthology.orchestra.run.smithi018.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:36:23.972 INFO:teuthology.orchestra.run.smithi018.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-09T04:36:23.973 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:36:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:36:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:36:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:36:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-09T04:36:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-09T04:36:23.974 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:36:23.974 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2023-06-09T04:36:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-09T04:36:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-09T04:36:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-09T04:36:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-09T04:36:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:36:23.975 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2023-06-09T04:36:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-09T04:36:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-09T04:36:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: libengine-pkcs11-openssl 2023-06-09T04:36:24.009 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2023-06-09T04:36:24.010 INFO:teuthology.orchestra.run.smithi018.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-09T04:36:24.011 INFO:teuthology.orchestra.run.smithi018.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-09T04:36:24.011 INFO:teuthology.orchestra.run.smithi018.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-09T04:36:24.011 INFO:teuthology.orchestra.run.smithi018.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-09T04:36:24.011 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-09T04:36:24.011 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-09T04:36:24.012 INFO:teuthology.orchestra.run.smithi018.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:36:24.012 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2023-06-09T04:36:24.012 INFO:teuthology.orchestra.run.smithi018.stdout: libssl3 2023-06-09T04:36:24.192 INFO:teuthology.orchestra.run.smithi018.stdout:1 upgraded, 39 newly installed, 0 to remove and 188 not upgraded. 2023-06-09T04:36:24.193 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 54.6 MB of archives. 2023-06-09T04:36:24.193 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-09T04:36:24.193 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-09T04:36:24.248 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:36:24.248 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:36:24.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-09T04:36:24.763 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:24.881 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:24.927 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-09T04:36:24.962 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-09T04:36:24.964 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-09T04:36:24.969 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-09T04:36:24.972 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-09T04:36:24.973 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-09T04:36:24.976 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-09T04:36:24.979 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-09T04:36:25.032 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:25.144 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-09T04:36:25.144 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-09T04:36:25.241 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:36:25.242 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:36:25.388 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-09T04:36:25.733 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:25.884 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:26.010 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:26.161 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.0.0-4313-ga02638f8-1jammy) ... 2023-06-09T04:36:26.288 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-09T04:36:26.525 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-09T04:36:26.529 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-09T04:36:26.530 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-09T04:36:26.536 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-09T04:36:26.537 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-09T04:36:26.547 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-09T04:36:26.551 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-09T04:36:26.568 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-09T04:36:26.733 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-09T04:36:27.455 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-09T04:36:27.456 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-09T04:36:27.482 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-09T04:36:27.560 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-09T04:36:27.568 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-09T04:36:27.570 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-09T04:36:27.571 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-09T04:36:27.572 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-09T04:36:27.598 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-09T04:36:27.601 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-09T04:36:27.715 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-09T04:36:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:36:28.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T04:36:28.194 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-06-09T04:36:28.322 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-09T04:36:28.369 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-06-09T04:36:28.369 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-06-09T04:36:28.405 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-09T04:36:28.405 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-09T04:36:28.406 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-09T04:36:28.495 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-09T04:36:28.500 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-09T04:36:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-09T04:36:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-09T04:36:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:36:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:36:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-09T04:36:28.525 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:36:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-09T04:36:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-09T04:36:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-09T04:36:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-09T04:36:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-09T04:36:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:36:28.527 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-06-09T04:36:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-09T04:36:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-09T04:36:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-09T04:36:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-09T04:36:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:36:28.528 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-06-09T04:36:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-09T04:36:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-09T04:36:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: libengine-pkcs11-openssl 2023-06-09T04:36:28.561 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-06-09T04:36:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-09T04:36:28.562 INFO:teuthology.orchestra.run.smithi081.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-09T04:36:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-09T04:36:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-09T04:36:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-09T04:36:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-09T04:36:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:36:28.564 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-06-09T04:36:28.564 INFO:teuthology.orchestra.run.smithi081.stdout: libssl3 2023-06-09T04:36:28.613 INFO:teuthology.orchestra.run.smithi081.stdout:1 upgraded, 39 newly installed, 0 to remove and 188 not upgraded. 2023-06-09T04:36:28.614 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 54.6 MB of archives. 2023-06-09T04:36:28.614 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-09T04:36:28.614 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-09T04:36:28.712 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-09T04:36:28.770 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-09T04:36:28.784 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-09T04:36:28.785 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-09T04:36:28.788 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-09T04:36:28.789 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-09T04:36:28.790 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-09T04:36:28.792 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-09T04:36:28.793 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-09T04:36:28.828 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-09T04:36:28.829 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-09T04:36:28.879 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-09T04:36:28.956 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-09T04:36:28.958 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-09T04:36:29.295 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-09T04:36:29.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-09T04:36:29.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-09T04:36:29.300 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-09T04:36:29.300 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-09T04:36:29.305 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-09T04:36:29.306 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-09T04:36:29.314 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-09T04:36:29.349 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-09T04:36:29.381 INFO:teuthology.orchestra.run.smithi018.stdout:Preconfiguring packages ... 2023-06-09T04:36:29.508 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-09T04:36:29.509 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-09T04:36:29.529 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-09T04:36:29.542 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2023-06-09T04:36:29.562 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-09T04:36:29.567 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-09T04:36:29.567 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-09T04:36:29.568 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-09T04:36:29.568 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-09T04:36:29.581 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-09T04:36:29.583 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-09T04:36:29.645 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package flex. 2023-06-09T04:36:29.709 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172966 files and directories currently installed.) 2023-06-09T04:36:29.714 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-09T04:36:29.752 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-09T04:36:29.818 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-09T04:36:29.835 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-09T04:36:29.836 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-09T04:36:29.836 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-09T04:36:29.854 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-09T04:36:29.855 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-09T04:36:29.953 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-09T04:36:29.954 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-09T04:36:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-09T04:36:30.347 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2023-06-09T04:36:30.499 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 54.6 MB in 1s (39.4 MB/s) 2023-06-09T04:36:30.500 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-09T04:36:30.605 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package flex. 2023-06-09T04:36:30.697 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172966 files and directories currently installed.) 2023-06-09T04:36:30.703 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-09T04:36:30.803 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-09T04:36:30.943 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-09T04:36:31.394 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-09T04:36:31.468 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package bison. 2023-06-09T04:36:31.575 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173039 files and directories currently installed.) 2023-06-09T04:36:31.581 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-09T04:36:31.584 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-09T04:36:31.628 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-09T04:36:31.996 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T04:36:32.002 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-09T04:36:32.024 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-09T04:36:32.071 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-09T04:36:32.391 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package dump. 2023-06-09T04:36:32.419 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-09T04:36:32.457 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking dump (0.4b47-3) ... 2023-06-09T04:36:32.519 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package bison. 2023-06-09T04:36:32.624 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173039 files and directories currently installed.) 2023-06-09T04:36:32.629 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-09T04:36:32.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-09T04:36:32.769 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package indent. 2023-06-09T04:36:32.797 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-09T04:36:32.835 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-09T04:36:33.074 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T04:36:33.102 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-09T04:36:33.104 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T04:36:33.122 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-09T04:36:33.140 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-09T04:36:33.171 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-09T04:36:33.427 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package dump. 2023-06-09T04:36:33.454 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-09T04:36:33.458 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T04:36:33.485 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking dump (0.4b47-3) ... 2023-06-09T04:36:33.487 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-09T04:36:33.525 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-09T04:36:33.747 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package indent. 2023-06-09T04:36:33.775 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-09T04:36:33.786 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T04:36:33.814 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-09T04:36:33.814 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-09T04:36:33.852 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-09T04:36:34.074 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T04:36:34.102 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-09T04:36:34.141 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-09T04:36:34.285 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-09T04:36:34.313 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-09T04:36:34.351 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:34.428 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T04:36:34.456 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-09T04:36:34.486 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-09T04:36:34.603 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-09T04:36:34.620 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-09T04:36:34.661 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:34.731 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T04:36:34.759 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-09T04:36:34.798 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-09T04:36:34.897 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjson-perl. 2023-06-09T04:36:34.915 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-09T04:36:34.956 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-09T04:36:35.159 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-09T04:36:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-09T04:36:35.226 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:35.242 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-09T04:36:35.259 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-09T04:36:35.292 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-09T04:36:35.478 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-09T04:36:35.506 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-09T04:36:35.545 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:35.764 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjson-perl. 2023-06-09T04:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-09T04:36:35.823 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-09T04:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-09T04:36:36.171 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-09T04:36:36.212 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-09T04:36:36.986 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T04:36:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:36:37.053 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T04:36:37.350 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:36:37.388 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:37.833 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T04:36:37.862 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-09T04:36:37.900 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:36:38.080 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T04:36:38.108 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:36:38.155 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:38.186 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T04:36:38.215 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-09T04:36:38.244 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-09T04:36:38.441 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T04:36:38.469 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:36:38.508 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:38.572 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T04:36:38.600 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-09T04:36:38.638 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-09T04:36:38.836 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T04:36:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-09T04:36:38.902 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:36:39.000 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T04:36:39.028 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:39.066 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:39.330 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T04:36:39.358 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-09T04:36:39.405 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-09T04:36:39.462 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T04:36:39.490 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:39.528 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:36:39.758 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T04:36:39.786 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-09T04:36:39.825 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-09T04:36:39.830 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T04:36:39.847 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:39.889 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:36:40.150 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T04:36:40.167 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-09T04:36:40.170 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T04:36:40.198 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:40.208 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-09T04:36:40.236 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:40.631 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T04:36:40.659 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:40.706 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:36:40.736 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T04:36:40.765 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-09T04:36:40.803 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-09T04:36:41.050 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T04:36:41.078 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:41.117 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:36:41.181 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package modemmanager. 2023-06-09T04:36:41.209 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-09T04:36:41.247 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:36:41.361 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T04:36:41.389 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-09T04:36:41.428 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-09T04:36:41.895 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package network-manager. 2023-06-09T04:36:41.924 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-09T04:36:41.970 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-09T04:36:42.015 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T04:36:42.043 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-09T04:36:42.090 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-09T04:36:42.501 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package modemmanager. 2023-06-09T04:36:42.529 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-09T04:36:42.576 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:36:42.619 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ppp. 2023-06-09T04:36:42.647 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-09T04:36:42.942 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-09T04:36:43.265 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T04:36:43.292 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager. 2023-06-09T04:36:43.293 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-09T04:36:43.320 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-09T04:36:43.332 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-09T04:36:43.367 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-09T04:36:43.584 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T04:36:43.612 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-09T04:36:43.651 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-09T04:36:43.929 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T04:36:43.945 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-09T04:36:43.979 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client-common (238) ... 2023-06-09T04:36:44.000 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ppp. 2023-06-09T04:36:44.027 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-09T04:36:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-09T04:36:44.403 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-09T04:36:44.431 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:44.469 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:44.621 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T04:36:44.637 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-09T04:36:44.679 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-09T04:36:44.941 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T04:36:44.968 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-09T04:36:45.007 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-09T04:36:45.024 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T04:36:45.052 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-09T04:36:45.118 INFO:teuthology.orchestra.run.smithi018.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T04:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-common (238) ... 2023-06-09T04:36:45.269 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T04:36:45.296 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-09T04:36:45.327 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-common (238) ... 2023-06-09T04:36:45.606 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-14. 2023-06-09T04:36:45.631 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-09T04:36:45.635 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:45.647 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:45.675 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:45.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:46.286 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T04:36:46.314 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-09T04:36:46.371 INFO:teuthology.orchestra.run.smithi081.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T04:36:46.400 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-common (238) ... 2023-06-09T04:36:46.885 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-14. 2023-06-09T04:36:46.913 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-09T04:36:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql. 2023-06-09T04:36:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-09T04:36:46.955 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:46.993 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql (14+238) ... 2023-06-09T04:36:47.237 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T04:36:47.265 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-09T04:36:47.303 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client (14+238) ... 2023-06-09T04:36:47.530 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T04:36:47.547 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-09T04:36:47.588 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-09T04:36:47.891 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package tcl8.6. 2023-06-09T04:36:47.920 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-09T04:36:47.958 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-09T04:36:48.244 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package tcl. 2023-06-09T04:36:48.273 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-09T04:36:48.315 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-09T04:36:48.491 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql. 2023-06-09T04:36:48.507 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-09T04:36:48.549 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql (14+238) ... 2023-06-09T04:36:48.663 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T04:36:48.692 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-09T04:36:48.730 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-09T04:36:48.793 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T04:36:48.809 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-09T04:36:48.851 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client (14+238) ... 2023-06-09T04:36:49.087 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T04:36:49.088 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T04:36:49.105 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-09T04:36:49.114 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-09T04:36:49.142 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-09T04:36:49.153 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-09T04:36:49.514 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl8.6. 2023-06-09T04:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T04:36:49.542 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-09T04:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-09T04:36:49.581 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-09T04:36:49.605 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-09T04:36:49.884 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl. 2023-06-09T04:36:49.891 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client-common (238) ... 2023-06-09T04:36:49.911 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-09T04:36:49.956 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-09T04:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-09T04:36:50.304 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T04:36:50.331 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-09T04:36:50.354 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:50.370 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-09T04:36:50.480 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-09T04:36:50.606 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-09T04:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:50.775 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T04:36:50.792 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-09T04:36:50.841 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-09T04:36:51.196 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T04:36:51.236 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T04:36:51.265 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-09T04:36:51.287 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-09T04:36:51.311 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-09T04:36:51.606 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-common (238) ... 2023-06-09T04:36:51.665 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:36:51.665 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:36:51.793 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-09T04:36:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-09T04:36:52.044 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:52.170 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-09T04:36:52.182 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-09T04:36:52.283 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-09T04:36:52.296 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-09T04:36:52.409 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-09T04:36:52.422 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:36:52.535 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-09T04:36:52.661 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:52.787 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-09T04:36:52.902 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T04:36:52.913 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-09T04:36:52.978 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-09T04:36:53.358 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:36:53.358 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:36:53.543 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-09T04:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up dump (0.4b47-3) ... 2023-06-09T04:36:53.764 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T04:36:53.821 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:36:53.898 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-09T04:36:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-09T04:36:54.001 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-09T04:36:54.073 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-09T04:36:54.127 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-09T04:36:54.174 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-09T04:36:54.253 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-09T04:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-09T04:36:54.400 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-09T04:36:54.479 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:54.605 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-09T04:36:54.649 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-09T04:36:54.731 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-09T04:36:55.295 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-09T04:36:55.328 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-09T04:36:55.454 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up dump (0.4b47-3) ... 2023-06-09T04:36:55.471 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-09T04:36:55.548 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T04:36:55.588 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:55.614 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:36:55.689 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-09T04:36:55.740 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-09T04:36:55.841 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-09T04:36:55.849 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client (14+238) ... 2023-06-09T04:36:55.942 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-09T04:36:55.984 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-09T04:36:56.060 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-09T04:36:56.150 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-09T04:36:56.220 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-09T04:36:56.346 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-09T04:36:56.455 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:36:56.456 INFO:teuthology.orchestra.run.smithi018.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T04:36:56.456 INFO:teuthology.orchestra.run.smithi018.stdout:which means they are currently configured by ifupdown: 2023-06-09T04:36:56.456 INFO:teuthology.orchestra.run.smithi018.stdout:- ens1f0 2023-06-09T04:36:56.456 INFO:teuthology.orchestra.run.smithi018.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T04:36:56.456 INFO:teuthology.orchestra.run.smithi018.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T04:36:56.456 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:36:56.522 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-09T04:36:56.577 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T04:36:56.648 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-09T04:36:56.909 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client (14+238) ... 2023-06-09T04:36:56.910 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T04:36:57.027 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-09T04:36:57.267 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T04:36:57.531 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:36:57.531 INFO:teuthology.orchestra.run.smithi081.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T04:36:57.531 INFO:teuthology.orchestra.run.smithi081.stdout:which means they are currently configured by ifupdown: 2023-06-09T04:36:57.531 INFO:teuthology.orchestra.run.smithi081.stdout:- enp3s0f1 2023-06-09T04:36:57.531 INFO:teuthology.orchestra.run.smithi081.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T04:36:57.532 INFO:teuthology.orchestra.run.smithi081.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T04:36:57.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:36:57.662 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T04:36:57.811 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:58.000 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T04:36:58.114 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-09T04:36:58.240 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-common (238) ... 2023-06-09T04:36:58.361 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T04:36:59.045 INFO:teuthology.orchestra.run.smithi018.stdout:Adding user postgres to group ssl-cert 2023-06-09T04:36:59.160 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-09T04:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T04:36:59.298 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-09T04:36:59.415 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-09T04:36:59.434 INFO:teuthology.orchestra.run.smithi018.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T04:36:59.434 INFO:teuthology.orchestra.run.smithi018.stdout:Removing obsolete dictionary files: 2023-06-09T04:36:59.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-common (238) ... 2023-06-09T04:37:00.062 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T04:37:00.449 INFO:teuthology.orchestra.run.smithi081.stdout:Adding user postgres to group ssl-cert 2023-06-09T04:37:00.500 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:37:00.683 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:00.683 INFO:teuthology.orchestra.run.smithi081.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T04:37:00.845 INFO:teuthology.orchestra.run.smithi018.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-09T04:37:00.861 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-09T04:37:00.891 INFO:teuthology.orchestra.run.smithi081.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T04:37:00.891 INFO:teuthology.orchestra.run.smithi081.stdout:Removing obsolete dictionary files: 2023-06-09T04:37:00.900 INFO:teuthology.orchestra.run.smithi018.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T04:37:00.900 INFO:teuthology.orchestra.run.smithi018.stdout:This user must also own the server process. 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout:The default text search configuration will be set to "english". 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout:Data page checksums are disabled. 2023-06-09T04:37:00.901 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:00.902 INFO:teuthology.orchestra.run.smithi018.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-09T04:37:00.902 INFO:teuthology.orchestra.run.smithi018.stdout:creating subdirectories ... ok 2023-06-09T04:37:00.902 INFO:teuthology.orchestra.run.smithi018.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T04:37:00.915 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default max_connections ... 100 2023-06-09T04:37:00.933 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default shared_buffers ... 128MB 2023-06-09T04:37:00.940 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default time zone ... Etc/UTC 2023-06-09T04:37:00.941 INFO:teuthology.orchestra.run.smithi018.stdout:creating configuration files ... ok 2023-06-09T04:37:01.059 INFO:teuthology.orchestra.run.smithi018.stdout:running bootstrap script ... ok 2023-06-09T04:37:01.475 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T04:37:01.723 INFO:teuthology.orchestra.run.smithi018.stdout:performing post-bootstrap initialization ... ok 2023-06-09T04:37:01.843 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-09T04:37:02.167 INFO:teuthology.orchestra.run.smithi081.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-09T04:37:02.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-09T04:37:02.222 INFO:teuthology.orchestra.run.smithi081.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T04:37:02.222 INFO:teuthology.orchestra.run.smithi081.stdout:This user must also own the server process. 2023-06-09T04:37:02.222 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout:The default text search configuration will be set to "english". 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout:Data page checksums are disabled. 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-09T04:37:02.223 INFO:teuthology.orchestra.run.smithi081.stdout:creating subdirectories ... ok 2023-06-09T04:37:02.224 INFO:teuthology.orchestra.run.smithi081.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T04:37:02.237 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default max_connections ... 100 2023-06-09T04:37:02.253 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default shared_buffers ... 128MB 2023-06-09T04:37:02.260 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default time zone ... Etc/UTC 2023-06-09T04:37:02.261 INFO:teuthology.orchestra.run.smithi081.stdout:creating configuration files ... ok 2023-06-09T04:37:02.374 INFO:teuthology.orchestra.run.smithi081.stdout:running bootstrap script ... ok 2023-06-09T04:37:02.386 INFO:teuthology.orchestra.run.smithi018.stdout:syncing data to disk ... ok 2023-06-09T04:37:02.780 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T04:37:03.435 INFO:teuthology.orchestra.run.smithi081.stdout:performing post-bootstrap initialization ... ok 2023-06-09T04:37:04.121 INFO:teuthology.orchestra.run.smithi081.stdout:syncing data to disk ... ok 2023-06-09T04:37:04.518 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T04:37:05.590 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:37:05.699 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-09T04:37:05.809 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql (14+238) ... 2023-06-09T04:37:05.935 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:37:06.060 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:37:06.913 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T04:37:07.232 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-09T04:37:07.297 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-09T04:37:07.415 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-09T04:37:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql (14+238) ... 2023-06-09T04:37:07.634 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-09T04:37:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-09T04:37:08.010 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:37:08.010 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:37:08.554 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T04:37:08.787 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-09T04:37:08.856 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-09T04:37:08.895 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-09T04:37:09.016 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-09T04:37:09.522 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:37:09.524 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:10.160 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-09T04:37:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-09T04:37:10.887 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:37:10.889 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:10.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:37:11.032 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2023-06-09T04:37:11.051 INFO:teuthology.orchestra.run.smithi018.stdout:18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:37:11.052 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:37:11.052 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313-ga02638f8-1jammy is installed. 2023-06-09T04:37:11.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:37:11.279 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2023-06-09T04:37:11.298 INFO:teuthology.orchestra.run.smithi081.stdout:18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:37:11.299 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313-ga02638f8-1jammy 2023-06-09T04:37:11.299 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313-ga02638f8-1jammy is installed. 2023-06-09T04:37:11.299 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-09T04:37:11.300 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:11.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:37:11.315 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:11.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:37:11.356 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-09T04:37:11.357 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:11.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:37:11.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:37:11.425 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:11.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:37:11.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:37:11.498 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-09T04:37:11.499 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:11.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:37:11.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:37:11.565 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:11.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:37:11.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:37:11.631 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-09T04:37:11.631 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:11.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:37:11.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:37:11.698 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:11.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:37:11.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:37:11.765 INFO:teuthology.run_tasks:Running task ceph... 2023-06-09T04:37:11.830 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-09T04:37:11.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2023-06-09T04:37:11.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-06-09T04:37:11.845 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-09T04:37:11.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:37:11.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:37:11.899 INFO:tasks.ceph:Creating extra log directories... 2023-06-09T04:37:11.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:37:11.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:37:11.961 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-09T04:37:11.961 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-09T04:37:11.961 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-09T04:37:11.961 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:11.962 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:37:11.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:12.074 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:12.075 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:37:12.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:12.158 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-09T04:37:12.159 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-09T04:37:12.159 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299737', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7299737', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSNZhRT7K6h9vKF//fa0NGlgEvXUQbuloHxceuVDpusLQlbUlGxSCFGz9KZGI8Z5pLZZNda/wqEluFgYZATOXw=', 'smithi081.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEk7T3OiwyWrLlUy4TfwZaiCSLTvZz3lqu6Ij+bgcgRL'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-09_04:16:27', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-09T04:37:12.160 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:37:12.162 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:37:12.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:37:12.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:37:12.259 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:12.259 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:37:12.270 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:37:12.270 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2023-06-09T04:37:12.318 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:37:12.319 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:12.319 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 883 Links: 1 2023-06-09T04:37:12.319 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:12.319 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2023-06-09 04:31:09.986308219 +0000 2023-06-09T04:37:12.319 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2023-06-09 04:31:09.982308255 +0000 2023-06-09T04:37:12.320 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2023-06-09 04:31:09.982308255 +0000 2023-06-09T04:37:12.320 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2023-06-09T04:37:12.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:37:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2023-06-09T04:37:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2023-06-09T04:37:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000320354 s, 1.6 MB/s 2023-06-09T04:37:12.374 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:37:12.423 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2023-06-09T04:37:12.470 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:37:12.470 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:12.470 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-06-09T04:37:12.470 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:12.471 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2023-06-09 04:31:10.990299251 +0000 2023-06-09T04:37:12.471 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2023-06-09 04:31:10.618302574 +0000 2023-06-09T04:37:12.471 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2023-06-09 04:31:10.618302574 +0000 2023-06-09T04:37:12.471 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2023-06-09T04:37:12.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:37:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2023-06-09T04:37:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2023-06-09T04:37:12.525 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000201286 s, 2.5 MB/s 2023-06-09T04:37:12.525 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:37:12.575 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2023-06-09T04:37:12.622 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:37:12.622 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:12.623 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-06-09T04:37:12.623 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:12.623 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2023-06-09 04:31:11.590293891 +0000 2023-06-09T04:37:12.623 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2023-06-09 04:31:11.214297250 +0000 2023-06-09T04:37:12.623 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2023-06-09 04:31:11.214297250 +0000 2023-06-09T04:37:12.623 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2023-06-09T04:37:12.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:37:12.676 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2023-06-09T04:37:12.677 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2023-06-09T04:37:12.677 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000296698 s, 1.7 MB/s 2023-06-09T04:37:12.678 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:37:12.727 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2023-06-09T04:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-06-09T04:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2023-06-09 04:31:12.174288676 +0000 2023-06-09T04:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2023-06-09 04:31:11.806291963 +0000 2023-06-09T04:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2023-06-09 04:31:11.806291963 +0000 2023-06-09T04:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2023-06-09T04:37:12.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:37:12.828 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2023-06-09T04:37:12.829 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2023-06-09T04:37:12.829 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000309175 s, 1.7 MB/s 2023-06-09T04:37:12.830 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:37:12.879 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:12.880 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:12.880 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:37:12.885 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:37:12.886 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-06-09T04:37:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 879 Links: 1 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-09 04:31:10.341282251 +0000 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-09 04:31:09.993285359 +0000 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-09 04:31:09.993285359 +0000 2023-06-09T04:37:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-09T04:37:12.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:37:12.986 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-09T04:37:12.986 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-09T04:37:12.986 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000390452 s, 1.3 MB/s 2023-06-09T04:37:12.987 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:37:13.037 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-06-09T04:37:13.083 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:37:13.083 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:13.083 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-06-09T04:37:13.083 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:13.083 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-09 04:31:10.937276927 +0000 2023-06-09T04:37:13.084 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-09 04:31:10.561280286 +0000 2023-06-09T04:37:13.084 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-09 04:31:10.561280286 +0000 2023-06-09T04:37:13.084 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-09T04:37:13.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:37:13.138 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-09T04:37:13.138 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-09T04:37:13.138 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000415303 s, 1.2 MB/s 2023-06-09T04:37:13.140 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:37:13.189 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-06-09T04:37:13.235 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:37:13.235 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:13.235 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 917 Links: 1 2023-06-09T04:37:13.236 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:13.236 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-09 04:31:11.565271318 +0000 2023-06-09T04:37:13.236 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-09 04:31:11.169274855 +0000 2023-06-09T04:37:13.236 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-09 04:31:11.169274855 +0000 2023-06-09T04:37:13.236 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-09T04:37:13.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:37:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-09T04:37:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-09T04:37:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000344903 s, 1.5 MB/s 2023-06-09T04:37:13.291 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:37:13.341 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-06-09T04:37:13.387 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:37:13.387 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:37:13.388 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 933 Links: 1 2023-06-09T04:37:13.388 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:37:13.388 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-06-09 04:31:12.137266208 +0000 2023-06-09T04:37:13.388 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-06-09 04:31:11.793269281 +0000 2023-06-09T04:37:13.388 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-06-09 04:31:11.793269281 +0000 2023-06-09T04:37:13.388 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-06-09T04:37:13.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:37:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-06-09T04:37:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-06-09T04:37:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000285475 s, 1.8 MB/s 2023-06-09T04:37:13.443 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:37:13.493 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:13.493 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:37:13.493 INFO:tasks.ceph:Generating config... 2023-06-09T04:37:13.495 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-09T04:37:13.495 INFO:tasks.ceph:[client] debug client = 20 2023-06-09T04:37:13.495 INFO:tasks.ceph:[client] debug ms = 1 2023-06-09T04:37:13.495 INFO:tasks.ceph:[client] pid file = 2023-06-09T04:37:13.496 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-09T04:37:13.496 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-09T04:37:13.496 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-09T04:37:13.496 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-09T04:37:13.496 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-09T04:37:13.497 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-09T04:37:13.497 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-09T04:37:13.497 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-09T04:37:13.497 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-09T04:37:13.497 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-09T04:37:13.498 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-09T04:37:13.498 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-09T04:37:13.498 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-09T04:37:13.498 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-09T04:37:13.498 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-09T04:37:13.498 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-09T04:37:13.499 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-09T04:37:13.499 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-09T04:37:13.499 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-09T04:37:13.499 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-09T04:37:13.499 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-09T04:37:13.500 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-09T04:37:13.500 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-09T04:37:13.500 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-09T04:37:13.500 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-09T04:37:13.500 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-09T04:37:13.501 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-09T04:37:13.501 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-09T04:37:13.501 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-09T04:37:13.501 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-09T04:37:13.501 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-09T04:37:13.502 INFO:tasks.ceph:Setting up mon.a... 2023-06-09T04:37:13.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:13.537 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2023-06-09T04:37:13.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-09T04:37:13.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:37:13.686 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.b', '172.21.15.81'), ('mon.c', '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]')] 2023-06-09T04:37:13.686 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-09T04:37:13.687 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:13.688 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:37:13.738 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --add b 172.21.15.81 --addv c '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:13.825 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:13.825 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid eb85c981-43c8-4596-9c30-77e5bafdb8a3 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = pacific 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:fsid eb85c981-43c8-4596-9c30-77e5bafdb8a3 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2023-06-09T04:37:13.826381+0000 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:created 2023-06-09T04:37:13.826381+0000 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 16 (pacific) 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2023-06-09T04:37:13.826 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2023-06-09T04:37:13.827 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2023-06-09T04:37:13.827 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] mon.c 2023-06-09T04:37:13.827 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-09T04:37:13.828 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:37:13.874 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID eb85c981-43c8-4596-9c30-77e5bafdb8a3... 2023-06-09T04:37:13.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:37:13.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:37:13.948 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2023-06-09T04:37:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:37:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2023-06-09T04:37:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:37:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2023-06-09T04:37:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = eb85c981-43c8-4596-9c30-77e5bafdb8a3 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2023-06-09T04:37:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2023-06-09T04:37:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2023-06-09T04:37:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:37:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2023-06-09T04:37:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2023-06-09T04:37:13.959 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2023-06-09T04:37:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2023-06-09T04:37:13.961 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.962 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.963 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2023-06-09T04:37:13.964 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2023-06-09T04:37:13.965 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2023-06-09T04:37:13.966 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2023-06-09T04:37:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2023-06-09T04:37:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2023-06-09T04:37:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2023-06-09T04:37:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2023-06-09T04:37:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2023-06-09T04:37:13.969 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-06-09T04:37:13.969 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-06-09T04:37:13.969 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.970 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-06-09T04:37:13.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-06-09T04:37:13.972 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:37:13.973 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.974 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.18,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = eb85c981-43c8-4596-9c30-77e5bafdb8a3 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-06-09T04:37:13.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:37:13.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.978 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-09T04:37:13.979 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-06-09T04:37:13.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:13.981 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-06-09T04:37:13.982 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:37:13.983 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:37:13.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-06-09T04:37:13.985 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-06-09T04:37:13.986 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-06-09T04:37:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-06-09T04:37:13.988 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-06-09T04:37:13.989 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-06-09T04:37:13.989 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-06-09T04:37:13.989 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-09T04:37:13.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-09T04:37:14.059 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-09T04:37:14.060 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:14.060 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-09T04:37:14.065 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:14.065 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-09T04:37:14.114 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:37:14.115 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:14.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:37:14.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:37:14.182 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:14.183 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:14.234 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:37:14.234 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:14.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:37:14.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:37:14.258 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:14.258 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:14.303 INFO:tasks.ceph:Setting up mon nodes... 2023-06-09T04:37:14.303 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-09T04:37:14.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:37:14.347 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:37:14.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:37:14.393 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:37:14.409 INFO:tasks.ceph:Setting up mds nodes... 2023-06-09T04:37:14.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:37:14.450 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:37:14.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-09T04:37:14.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:37:14.591 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:37:14.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-09T04:37:14.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:37:14.693 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:37:14.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-09T04:37:14.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:37:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:37:14.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-09T04:37:14.893 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-09T04:37:14.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-09T04:37:14.931 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-09T04:37:14.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-09T04:37:15.013 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-09T04:37:15.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-09T04:37:15.058 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-09T04:37:15.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-09T04:37:15.147 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-09T04:37:15.156 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-09T04:37:15.157 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:37:15.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:15.171 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:15.171 INFO:tasks.ceph:role: osd.0 2023-06-09T04:37:15.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:37:15.171 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:37:15.227 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:15.228 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:15.228 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:15.229 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:15.229 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:15.251 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2023-06-09T04:37:15.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2023-06-09T04:37:15.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:15.308 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:15.359 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:15.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:15.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:15.412 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:15.412 INFO:tasks.ceph:role: osd.1 2023-06-09T04:37:15.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:37:15.413 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:37:15.468 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:15.469 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:15.470 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:15.495 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2023-06-09T04:37:15.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2023-06-09T04:37:15.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:15.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:15.608 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:15.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:15.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:15.661 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:15.661 INFO:tasks.ceph:role: osd.2 2023-06-09T04:37:15.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:37:15.661 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:37:15.713 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:15.714 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:15.714 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:15.714 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:15.714 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:15.714 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:15.714 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:15.715 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:15.715 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:15.715 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:15.737 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2023-06-09T04:37:15.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2023-06-09T04:37:15.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:15.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:15.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:15.847 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:15.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:15.906 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:15.907 INFO:tasks.ceph:role: osd.3 2023-06-09T04:37:15.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:37:15.907 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:37:15.962 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:15.962 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:15.963 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:15.963 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:15.963 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:15.985 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2023-06-09T04:37:15.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2023-06-09T04:37:15.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:16.044 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:16.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:16.097 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:16.205+0000 7fcff310b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-09T04:37:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:16.205+0000 7fcff310b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-09T04:37:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:16.205+0000 7fcff310b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:37:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:16.205+0000 7fcff310b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:37:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:16.205+0000 7fcff310b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:37:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:16.205+0000 7fcff310b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-09T04:37:19.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-09T04:37:19.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:19.297+0000 7f95e5947640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-09T04:37:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:19.297+0000 7f95e5947640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-09T04:37:19.299 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:19.297+0000 7f95e5947640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:37:19.299 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:19.297+0000 7f95e5947640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:37:19.299 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:19.297+0000 7f95e5947640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:37:19.299 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:19.297+0000 7f95e5947640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-09T04:37:22.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-09T04:37:22.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:22.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:22.441+0000 7f72569b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-09T04:37:22.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:22.441+0000 7f72569b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-09T04:37:22.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:22.441+0000 7f72569b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:37:22.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:22.441+0000 7f72569b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:37:22.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:22.441+0000 7f72569b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:37:22.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:22.441+0000 7f72569b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-09T04:37:25.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-09T04:37:25.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:25.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:25.581+0000 7fb97c7b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-09T04:37:25.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:25.581+0000 7fb97c7b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-09T04:37:25.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:25.581+0000 7fb97c7b6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:37:25.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:25.581+0000 7fb97c7b6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:37:25.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:25.581+0000 7fb97c7b6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:37:25.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:25.581+0000 7fb97c7b6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-09T04:37:28.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-09T04:37:28.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:28.634 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:28.634 INFO:tasks.ceph:role: osd.4 2023-06-09T04:37:28.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:37:28.634 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:37:28.695 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:28.695 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:28.695 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:28.696 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:28.696 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:29.146 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-09T04:37:29.148 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-09T04:37:29.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:29.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:29.315 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:29.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:29.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:29.369 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:29.370 INFO:tasks.ceph:role: osd.5 2023-06-09T04:37:29.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:37:29.370 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:37:29.430 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:29.430 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:29.430 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:29.431 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:29.897 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-09T04:37:29.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-09T04:37:29.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:30.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:30.036 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:30.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:30.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:30.088 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:30.088 INFO:tasks.ceph:role: osd.6 2023-06-09T04:37:30.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:37:30.089 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:30.150 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:30.151 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:30.151 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:30.631 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-09T04:37:30.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-09T04:37:30.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:30.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:30.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:30.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:30.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:37:30.842 INFO:tasks.ceph:role: osd.7 2023-06-09T04:37:30.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:37:30.843 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:37:30.907 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:37:30.907 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:37:30.907 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:37:30.907 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:37:30.907 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:37:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:37:30.908 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:37:30.908 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:37:30.908 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:37:30.908 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:37:31.338 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-06-09T04:37:31.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-06-09T04:37:31.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:31.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:31.475 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:37:31.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:31.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:31.602+0000 7fae6b195640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-09T04:37:31.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:31.606+0000 7fae6b195640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-09T04:37:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:31.606+0000 7fae6b195640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:37:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:31.606+0000 7fae6b195640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:37:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:31.606+0000 7fae6b195640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:37:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:31.610+0000 7fae6b195640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-09T04:37:34.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-09T04:37:34.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:34.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:34.730+0000 7f8b951f5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-09T04:37:34.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:34.730+0000 7f8b951f5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-09T04:37:34.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:34.730+0000 7f8b951f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:37:34.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:34.734+0000 7f8b951f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:37:34.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:34.734+0000 7f8b951f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:37:34.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:34.734+0000 7f8b951f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-09T04:37:37.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-09T04:37:37.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:37.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:37.874+0000 7f8a47568640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-09T04:37:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:37.874+0000 7f8a47568640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-09T04:37:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:37.874+0000 7f8a47568640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:37:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:37.874+0000 7f8a47568640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:37:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:37.874+0000 7f8a47568640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:37:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:37.874+0000 7f8a47568640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-09T04:37:40.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-09T04:37:40.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:41.030+0000 7ff75420e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-09T04:37:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:41.030+0000 7ff75420e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-09T04:37:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:41.030+0000 7ff75420e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:37:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:41.030+0000 7ff75420e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:37:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:41.030+0000 7ff75420e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:37:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:41.030+0000 7ff75420e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-09T04:37:42.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:42.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:44.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-09T04:37:44.067 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-09T04:37:44.068 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-09T04:37:44.082 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-09T04:37:44.137 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-09T04:37:44.194 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-09T04:37:44.249 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-09T04:37:44.305 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-09T04:37:44.357 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-09T04:37:44.414 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-09T04:37:44.427 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-09T04:37:44.482 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-09T04:37:44.534 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-09T04:37:44.585 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-09T04:37:44.637 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-09T04:37:44.690 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-09T04:37:44.741 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.741 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-09T04:37:44.747 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:44.747 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-09T04:37:44.794 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.794 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-09T04:37:44.799 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:44.799 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-09T04:37:44.846 INFO:tasks.ceph:Adding keys to all mons... 2023-06-09T04:37:44.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:37:44.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:37:44.892 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2023-06-09T04:37:44.892 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJkaUG/FBAA2ZRcJcIjZ9JQsjvUbEbIHA== 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJkY27vGhAA0nxXnaRtr10QAXQjtNMbPg== 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJkOv9VIxAAKkMVVTLufhySpH5T0NTbqw== 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB8rIJknHdbDBAAvM8QVbLDKr9g2fZ2+E/5ow== 2023-06-09T04:37:44.893 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB/rIJk2ejYERAAw5lKwKEqs50wYfcQ5+LEAg== 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCCrIJkFKqDGhAAf5EaQXXRSuzDzqTZZawrtg== 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCFrIJkO2zQIhAAeOVev4wa7Una2jmeWJQYaw== 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJkZAdiFxAAVgfRKBoV8Se1VMZqQlV1SA== 2023-06-09T04:37:44.894 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJk8J5HKRAAGUSPBb3ugYx1WAGw/2UgAg== 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJk4j/oMRAAzprOovcXEwRH7uKCPfVloA== 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCLrIJkdKMwJBAASjDcKa+9iBj4D2POnaJWuQ== 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2023-06-09T04:37:44.895 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCOrIJkrOr1KxAAh5CnBhdbBNs1agWVJo+LJA== 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCRrIJkqCJzNBAAm2zyQsxxam2Vtx6tNIUq+w== 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQCVrIJkyDEMAhAAbIkTMG09bNz0Kd2pl80pUQ== 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJkXeKQNxAAUUixr/B2ThUEYZZrYvhzkw== 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:[client.2] 2023-06-09T04:37:44.896 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB7rIJkk0HeABAA0JDyRxeb6DbMh/duoq4e1Q== 2023-06-09T04:37:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2023-06-09T04:37:44.897 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB7rIJkD8JvAxAAiWQkEnTuOchQ/KVu81Ip5A== 2023-06-09T04:37:44.897 INFO:teuthology.orchestra.run.smithi018.stdout:[client.3] 2023-06-09T04:37:44.897 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB7rIJkyLK0CBAAq4DcDQONemGIdmqe5CaLeg== 2023-06-09T04:37:44.900 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-06-09T04:37:44.900 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJkaUG/FBAA2ZRcJcIjZ9JQsjvUbEbIHA== 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJkY27vGhAA0nxXnaRtr10QAXQjtNMbPg== 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJkOv9VIxAAKkMVVTLufhySpH5T0NTbqw== 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8rIJknHdbDBAAvM8QVbLDKr9g2fZ2+E/5ow== 2023-06-09T04:37:44.901 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB/rIJk2ejYERAAw5lKwKEqs50wYfcQ5+LEAg== 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCCrIJkFKqDGhAAf5EaQXXRSuzDzqTZZawrtg== 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCFrIJkO2zQIhAAeOVev4wa7Una2jmeWJQYaw== 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-06-09T04:37:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJkZAdiFxAAVgfRKBoV8Se1VMZqQlV1SA== 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJk8J5HKRAAGUSPBb3ugYx1WAGw/2UgAg== 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJk4j/oMRAAzprOovcXEwRH7uKCPfVloA== 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCLrIJkdKMwJBAASjDcKa+9iBj4D2POnaJWuQ== 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-06-09T04:37:44.903 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCOrIJkrOr1KxAAh5CnBhdbBNs1agWVJo+LJA== 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCRrIJkqCJzNBAAm2zyQsxxam2Vtx6tNIUq+w== 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCVrIJkyDEMAhAAbIkTMG09bNz0Kd2pl80pUQ== 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB6rIJkXeKQNxAAUUixr/B2ThUEYZZrYvhzkw== 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2023-06-09T04:37:44.904 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB7rIJkk0HeABAA0JDyRxeb6DbMh/duoq4e1Q== 2023-06-09T04:37:44.905 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2023-06-09T04:37:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB7rIJkD8JvAxAAiWQkEnTuOchQ/KVu81Ip5A== 2023-06-09T04:37:44.905 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2023-06-09T04:37:44.905 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB7rIJkyLK0CBAAq4DcDQONemGIdmqe5CaLeg== 2023-06-09T04:37:44.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:44.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:44.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:45.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:37:45.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:37:45.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:45.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:46.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:37:46.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:37:46.382 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-09T04:37:46.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-09T04:37:46.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:46.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-09T04:37:46.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-09T04:37:46.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:46.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-09T04:37:46.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-09T04:37:46.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:37:46.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-09T04:37:46.822 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:46.824 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:37:46.870 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-09T04:37:46.870 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-09T04:37:46.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-09T04:37:46.873 INFO:tasks.ceph.mon.a:Started 2023-06-09T04:37:46.873 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-09T04:37:46.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-09T04:37:46.912 INFO:tasks.ceph.mon.b:Started 2023-06-09T04:37:46.912 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-09T04:37:46.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-09T04:37:46.914 INFO:tasks.ceph.mon.c:Started 2023-06-09T04:37:46.914 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-09T04:37:46.915 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-09T04:37:46.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-09T04:37:46.917 INFO:tasks.ceph.mgr.y:Started 2023-06-09T04:37:46.918 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-09T04:37:46.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-09T04:37:46.920 INFO:tasks.ceph.mgr.x:Started 2023-06-09T04:37:46.920 INFO:tasks.ceph:Setting crush tunables to default 2023-06-09T04:37:46.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2023-06-09T04:37:47.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 Processor -- start 2023-06-09T04:37:47.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 -- start start 2023-06-09T04:37:47.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5815f100 con 0x7fbe5806c8f0 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5815f3e0 con 0x7fbe5815b840 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5feab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815ff80 con 0x7fbe5806c520 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5e448640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5d446640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbe5806c8f0 0x7fbe5815f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39162/0 (socket says 172.21.15.18:39162) 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5d446640 1 -- 172.21.15.18:0/588895873 learned_addr learned my addr 172.21.15.18:0/588895873 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5e448640 1 -- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 msgr2=0x7fbe5815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5e448640 1 -- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 msgr2=0x7fbe5815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:37:47.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5e448640 1 --2- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:37:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5e448640 1 --2- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:37:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 msgr2=0x7fbe580cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T04:37:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 msgr2=0x7fbe580cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:37:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:37:47.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.037+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:37:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5e448640 1 --2- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5e448640 1 -- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 msgr2=0x7fbe5815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5e448640 1 -- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 msgr2=0x7fbe5815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5e448640 1 --2- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 msgr2=0x7fbe580cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 msgr2=0x7fbe580cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:37:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:37:47.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5e448640 1 --2- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-09T04:37:47.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.241+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-09T04:37:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.257+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243152871 0 0) 0x7fbe5815f100 con 0x7fbe5806c8f0 2023-06-09T04:37:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.257+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe44003530 con 0x7fbe5806c8f0 2023-06-09T04:37:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.257+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901164534 0 0) 0x7fbe44003530 con 0x7fbe5806c8f0 2023-06-09T04:37:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.257+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 msgr2=0x7fbe580cddc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.257+0000 7fbe5cc45640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe580cddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.257+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 msgr2=0x7fbe5815bcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 --2- 172.21.15.18:0/588895873 >> v2:172.21.15.18:3300/0 conn(0x7fbe5815b840 0x7fbe5815bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5815c3a0 con 0x7fbe5806c8f0 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fbe48001680 con 0x7fbe5806c8f0 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 >> v1:172.21.15.18:6789/0 conn(0x7fbe5806c8f0 legacy=0x7fbe5815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe44003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44003fb0 0x7fbe440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe44004d10 0x7fbe44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815f3e0 con 0x7fbe44004d10 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5815ff80 con 0x7fbe44003fb0 2023-06-09T04:37:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4400bbd0 con 0x7fbe5806c520 2023-06-09T04:37:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe44003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5d446640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44003fb0 0x7fbe440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5e448640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe44004d10 0x7fbe44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44003fb0 msgr2=0x7fbe440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe44003fb0 0x7fbe440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe44004d10 msgr2=0x7fbe44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe44004d10 0x7fbe44005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.261+0000 7fbe5dc47640 1 -- 172.21.15.18:0/588895873 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44003530 con 0x7fbe5806c520 2023-06-09T04:37:47.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe44003980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400e8d0 tx=0x7fbe5401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3db51a1d860981 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe540a6660 con 0x7fbe5806c520 2023-06-09T04:37:47.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540a67c0 con 0x7fbe5806c520 2023-06-09T04:37:47.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5cc45640 1 -- 172.21.15.18:0/588895873 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe540a6bb0 con 0x7fbe5806c520 2023-06-09T04:37:47.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5feab640 1 -- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 msgr2=0x7fbe44003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5feab640 1 --2- 172.21.15.18:0/588895873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe5806c520 0x7fbe44003980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400e8d0 tx=0x7fbe5401c860 comp rx=0 tx=0).stop 2023-06-09T04:37:47.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5e448640 1 -- 172.21.15.18:0/588895873 reap_dead start 2023-06-09T04:37:47.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5feab640 1 -- 172.21.15.18:0/588895873 shutdown_connections 2023-06-09T04:37:47.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5feab640 1 -- 172.21.15.18:0/588895873 >> 172.21.15.18:0/588895873 conn(0x7fbe580b0b10 msgr2=0x7fbe580ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5feab640 1 -- 172.21.15.18:0/588895873 shutdown_connections 2023-06-09T04:37:47.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.269+0000 7fbe5feab640 1 -- 172.21.15.18:0/588895873 wait complete. 2023-06-09T04:37:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 Processor -- start 2023-06-09T04:37:47.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 -- start start 2023-06-09T04:37:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 0x7fbe581626d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe580ab910 0x7fbe580abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 0x7fbe580b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58157350 con 0x7fbe580b3740 2023-06-09T04:37:47.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580ac2c0 con 0x7fbe5806c520 2023-06-09T04:37:47.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5feab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580b40f0 con 0x7fbe580ab910 2023-06-09T04:37:47.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 0x7fbe580b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5dc47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 0x7fbe581626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5dc47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 0x7fbe581626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33298/0 (socket says 172.21.15.18:33298) 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 0x7fbe580b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53118/0 (socket says 172.21.15.18:53118) 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5dc47640 1 -- 172.21.15.18:0/218796480 learned_addr learned my addr 172.21.15.18:0/218796480 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5d446640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe580ab910 0x7fbe580abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 -- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe580ab910 msgr2=0x7fbe580abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe580ab910 0x7fbe580abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 -- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 msgr2=0x7fbe581626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 0x7fbe581626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5e448640 1 -- 172.21.15.18:0/218796480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580ac560 con 0x7fbe580b3740 2023-06-09T04:37:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.273+0000 7fbe5dc47640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 0x7fbe581626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.277+0000 7fbe5e448640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 0x7fbe580b3bb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe58070210 tx=0x7fbe500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.277+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50016930 con 0x7fbe580b3740 2023-06-09T04:37:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000f040 con 0x7fbe580b3740 2023-06-09T04:37:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe580ac840 con 0x7fbe580b3740 2023-06-09T04:37:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50016cf0 con 0x7fbe580b3740 2023-06-09T04:37:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe580ace00 con 0x7fbe580b3740 2023-06-09T04:37:47.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbe50020700 con 0x7fbe580b3740 2023-06-09T04:37:47.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbe50015660 con 0x7fbe580b3740 2023-06-09T04:37:47.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.281+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5806d7a0 con 0x7fbe580b3740 2023-06-09T04:37:47.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.285+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbe50020be0 con 0x7fbe580b3740 2023-06-09T04:37:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.349+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbe580cf280 con 0x7fbe580b3740 2023-06-09T04:37:47.356 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe4e7fc640 1 -- 172.21.15.18:0/218796480 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbe50020d80 con 0x7fbe580b3740 2023-06-09T04:37:47.356 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2023-06-09T04:37:47.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 msgr2=0x7fbe580b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 0x7fbe580b3bb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe58070210 tx=0x7fbe500045e0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 shutdown_connections 2023-06-09T04:37:47.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe580b3740 0x7fbe580b3bb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe580ab910 0x7fbe580abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 --2- 172.21.15.18:0/218796480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe5806c520 0x7fbe581626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.353+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 >> 172.21.15.18:0/218796480 conn(0x7fbe580b0b10 msgr2=0x7fbe580c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.357+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 shutdown_connections 2023-06-09T04:37:47.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:47.357+0000 7fbe5feab640 1 -- 172.21.15.18:0/218796480 wait complete. 2023-06-09T04:37:47.376 INFO:tasks.ceph:check_enable_crimson: False 2023-06-09T04:37:47.376 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-09T04:37:47.376 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:47.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-09T04:37:47.387 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:47.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-09T04:37:47.444 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:47.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-09T04:37:47.464 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:47.461+0000 7f7309b38180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:37:47.467 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:47.466+0000 7fe6d81cc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:37:47.475 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:37:47.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-09T04:37:47.533 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:47.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-09T04:37:47.546 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:47.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-09T04:37:47.602 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:47.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-09T04:37:47.653 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:37:47.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-09T04:37:47.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 356c0f63-ad8a-4ac6-b443-15726a83e608 0 2023-06-09T04:37:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.862+0000 7fa50d494640 1 Processor -- start 2023-06-09T04:37:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.862+0000 7fa50d494640 1 -- start start 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa508158510 0x7fa508163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50815bea0 con 0x7fa50815cbd0 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5080caf20 con 0x7fa5080cb5d0 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080b1340 con 0x7fa508158510 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa506ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa5080cb5d0 0x7fa5080cb9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60360/0 (socket says 172.21.15.81:60360) 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa506ffd640 1 -- 172.21.15.81:0/3984012518 learned_addr learned my addr 172.21.15.81:0/3984012518 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-06-09T04:37:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa5077fe640 1 --2- 172.21.15.81:0/3984012518 >> v2:172.21.15.81:3300/0 conn(0x7fa508158510 0x7fa508163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa505ffb640 1 -- 172.21.15.81:0/3984012518 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184870185 0 0) 0x7fa5080caf20 con 0x7fa5080cb5d0 2023-06-09T04:37:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa505ffb640 1 -- 172.21.15.81:0/3984012518 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f0003530 con 0x7fa5080cb5d0 2023-06-09T04:37:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa5077fe640 1 -- 172.21.15.81:0/3984012518 >> v1:172.21.15.81:6789/0 conn(0x7fa5080cb5d0 legacy=0x7fa5080cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa5077fe640 1 -- 172.21.15.81:0/3984012518 >> v1:172.21.15.18:6789/0 conn(0x7fa50815cbd0 legacy=0x7fa5080b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa5077fe640 1 -- 172.21.15.81:0/3984012518 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50815c0f0 con 0x7fa508158510 2023-06-09T04:37:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa5077fe640 1 --2- 172.21.15.81:0/3984012518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa508158510 0x7fa508163230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80097c0 tx=0x7fa4f801c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b1352ce1706d51 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa505ffb640 1 -- 172.21.15.81:0/3984012518 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80ab600 con 0x7fa508158510 2023-06-09T04:37:47.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa505ffb640 1 -- 172.21.15.81:0/3984012518 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f80a7050 con 0x7fa508158510 2023-06-09T04:37:47.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa505ffb640 1 -- 172.21.15.81:0/3984012518 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80ab980 con 0x7fa508158510 2023-06-09T04:37:47.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- 172.21.15.81:0/3984012518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa508158510 msgr2=0x7fa508163230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 --2- 172.21.15.81:0/3984012518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa508158510 0x7fa508163230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80097c0 tx=0x7fa4f801c2f0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- 172.21.15.81:0/3984012518 shutdown_connections 2023-06-09T04:37:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 --2- 172.21.15.81:0/3984012518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa508158510 0x7fa508163230 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- 172.21.15.81:0/3984012518 >> 172.21.15.81:0/3984012518 conn(0x7fa50806cdd0 msgr2=0x7fa50806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- 172.21.15.81:0/3984012518 shutdown_connections 2023-06-09T04:37:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.866+0000 7fa50d494640 1 -- 172.21.15.81:0/3984012518 wait complete. 2023-06-09T04:37:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 Processor -- start 2023-06-09T04:37:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- start start 2023-06-09T04:37:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5080cb5d0 0x7fa508154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa508158510 0x7fa5080c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 0x7fa5080c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080c46e0 con 0x7fa508158510 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080b0990 con 0x7fa50815cbd0 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080c9150 con 0x7fa5080cb5d0 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 0x7fa5080c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5080cb5d0 0x7fa508154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa5077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 0x7fa5080c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46020/0 (socket says 172.21.15.81:46020) 2023-06-09T04:37:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa5077fe640 1 -- 172.21.15.81:0/2679185661 learned_addr learned my addr 172.21.15.81:0/2679185661 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa5067fc640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa508158510 0x7fa5080c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 -- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 msgr2=0x7fa5080c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 0x7fa5080c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 -- 172.21.15.81:0/2679185661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa508158510 msgr2=0x7fa5080c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa508158510 0x7fa5080c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 -- 172.21.15.81:0/2679185661 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8009420 con 0x7fa5080cb5d0 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa5077fe640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 0x7fa5080c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa506ffd640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5080cb5d0 0x7fa508154c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa50000cbc0 tx=0x7fa50000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000aca0 con 0x7fa5080cb5d0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000ae00 con 0x7fa5080cb5d0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5080c88b0 con 0x7fa5080cb5d0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500012600 con 0x7fa5080cb5d0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa508150e60 con 0x7fa5080cb5d0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa500012a60 con 0x7fa5080cb5d0 2023-06-09T04:37:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa500007070 con 0x7fa5080cb5d0 2023-06-09T04:37:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.870+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa508151080 con 0x7fa5080cb5d0 2023-06-09T04:37:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.886+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa500021060 con 0x7fa5080cb5d0 2023-06-09T04:37:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.950+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "356c0f63-ad8a-4ac6-b443-15726a83e608", "id": 0} v 0) v1 -- 0x7fa5080b4b80 con 0x7fa5080cb5d0 2023-06-09T04:37:47.962 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:47.961+0000 7f7309b38180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:37:47.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa4ef7fe640 1 -- 172.21.15.81:0/2679185661 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "356c0f63-ad8a-4ac6-b443-15726a83e608", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa500017070 con 0x7fa5080cb5d0 2023-06-09T04:37:47.963 INFO:teuthology.orchestra.run.smithi081.stdout:0 2023-06-09T04:37:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5080cb5d0 msgr2=0x7fa508154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5080cb5d0 0x7fa508154c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa50000cbc0 tx=0x7fa50000a060 comp rx=0 tx=0).stop 2023-06-09T04:37:47.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 shutdown_connections 2023-06-09T04:37:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50815cbd0 0x7fa5080c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa508158510 0x7fa5080c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 --2- 172.21.15.81:0/2679185661 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5080cb5d0 0x7fa508154c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 >> 172.21.15.81:0/2679185661 conn(0x7fa50806cdd0 msgr2=0x7fa5080c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 shutdown_connections 2023-06-09T04:37:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:47.962+0000 7fa50d494640 1 -- 172.21.15.81:0/2679185661 wait complete. 2023-06-09T04:37:47.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 8c385491-abcc-4edc-a6a9-7544ffb03391 1 2023-06-09T04:37:47.995 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:47.994+0000 7fe6d81cc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:37:48.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.086+0000 7eff3d1e1640 1 Processor -- start 2023-06-09T04:37:48.089 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.086+0000 7eff3d1e1640 1 -- start start 2023-06-09T04:37:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff3806c520 0x7eff380cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7eff3815b840 0x7eff3815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3815f100 con 0x7eff3806c8f0 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3815c1c0 con 0x7eff3815b840 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3815f3e0 con 0x7eff3806c520 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff3806c520 0x7eff380cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff3806c520 0x7eff380cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46032/0 (socket says 172.21.15.81:46032) 2023-06-09T04:37:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 -- 172.21.15.81:0/1963944147 learned_addr learned my addr 172.21.15.81:0/1963944147 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 -- 172.21.15.81:0/1963944147 >> v2:172.21.15.18:3300/0 conn(0x7eff3815b840 msgr2=0x7eff3815bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 --2- 172.21.15.81:0/1963944147 >> v2:172.21.15.18:3300/0 conn(0x7eff3815b840 0x7eff3815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 -- 172.21.15.81:0/1963944147 >> v1:172.21.15.18:6789/0 conn(0x7eff3806c8f0 legacy=0x7eff3815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 -- 172.21.15.81:0/1963944147 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3815ff80 con 0x7eff3806c520 2023-06-09T04:37:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff36d9d640 1 --2- 172.21.15.81:0/1963944147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806c520 0x7eff380cddc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7eff38070260 tx=0x7eff2001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4903b51200ef287 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff35d9b640 1 -- 172.21.15.81:0/1963944147 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff200a5700 con 0x7eff3806c520 2023-06-09T04:37:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff35d9b640 1 -- 172.21.15.81:0/1963944147 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff200a5860 con 0x7eff3806c520 2023-06-09T04:37:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff35d9b640 1 -- 172.21.15.81:0/1963944147 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff200a5bf0 con 0x7eff3806c520 2023-06-09T04:37:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- 172.21.15.81:0/1963944147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806c520 msgr2=0x7eff380cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/1963944147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806c520 0x7eff380cddc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7eff38070260 tx=0x7eff2001c840 comp rx=0 tx=0).stop 2023-06-09T04:37:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- 172.21.15.81:0/1963944147 shutdown_connections 2023-06-09T04:37:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/1963944147 >> v2:172.21.15.18:3300/0 conn(0x7eff3815b840 0x7eff3815bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/1963944147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3806c520 0x7eff380cddc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- 172.21.15.81:0/1963944147 >> 172.21.15.81:0/1963944147 conn(0x7eff380b0b10 msgr2=0x7eff380ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- 172.21.15.81:0/1963944147 shutdown_connections 2023-06-09T04:37:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.090+0000 7eff3d1e1640 1 -- 172.21.15.81:0/1963944147 wait complete. 2023-06-09T04:37:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 Processor -- start 2023-06-09T04:37:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- start start 2023-06-09T04:37:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff3806c520 0x7eff381579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff3806c8f0 0x7eff38149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 0x7eff3814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38159600 con 0x7eff3806c520 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38158c60 con 0x7eff3815b840 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff38158f40 con 0x7eff3806c8f0 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 0x7eff3814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3659c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff3806c8f0 0x7eff38149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 0x7eff3814a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46038/0 (socket says 172.21.15.81:46038) 2023-06-09T04:37:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3659c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff3806c8f0 0x7eff38149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:54862/0 (socket says 172.21.15.81:54862) 2023-06-09T04:37:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 -- 172.21.15.81:0/882468638 learned_addr learned my addr 172.21.15.81:0/882468638 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff36d9d640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff3806c520 0x7eff381579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 -- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff3806c8f0 msgr2=0x7eff38149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff3806c8f0 0x7eff38149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 -- 172.21.15.81:0/882468638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff3806c520 msgr2=0x7eff381579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff3806c520 0x7eff381579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 -- 172.21.15.81:0/882468638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20009b30 con 0x7eff3815b840 2023-06-09T04:37:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3759e640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 0x7eff3814a0e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff3000b3c0 tx=0x7eff3000b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30011830 con 0x7eff3815b840 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30011990 con 0x7eff3815b840 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff38159220 con 0x7eff3815b840 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30011d40 con 0x7eff3815b840 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff38153bb0 con 0x7eff3815b840 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff3001b760 con 0x7eff3815b840 2023-06-09T04:37:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7eff3001a800 con 0x7eff3815b840 2023-06-09T04:37:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.094+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff38158670 con 0x7eff3815b840 2023-06-09T04:37:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.098+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7eff3001bbf0 con 0x7eff3815b840 2023-06-09T04:37:48.154 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:48.153+0000 7f7309b38180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:37:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.166+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c385491-abcc-4edc-a6a9-7544ffb03391", "id": 1} v 0) v1 -- 0x7eff3815c930 con 0x7eff3815b840 2023-06-09T04:37:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff2f7fe640 1 -- 172.21.15.81:0/882468638 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c385491-abcc-4edc-a6a9-7544ffb03391", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7eff3002a0b0 con 0x7eff3815b840 2023-06-09T04:37:48.176 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 msgr2=0x7eff3814a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 0x7eff3814a0e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff3000b3c0 tx=0x7eff3000b880 comp rx=0 tx=0).stop 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 shutdown_connections 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3815b840 0x7eff3814a0e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff3806c8f0 0x7eff38149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 --2- 172.21.15.81:0/882468638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff3806c520 0x7eff381579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 >> 172.21.15.81:0/882468638 conn(0x7eff380b0b10 msgr2=0x7eff380af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 shutdown_connections 2023-06-09T04:37:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.174+0000 7eff3d1e1640 1 -- 172.21.15.81:0/882468638 wait complete. 2023-06-09T04:37:48.190 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:48.186+0000 7fe6d81cc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:37:48.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 0294f8c7-ffd3-4adc-b038-1d90f3a1277b 2 2023-06-09T04:37:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 Processor -- start 2023-06-09T04:37:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 -- start start 2023-06-09T04:37:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff02c153800 0x7ff02c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff02c0b0d90 0x7ff02c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c15a4b0 con 0x7ff02c153bd0 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c15a790 con 0x7ff02c0b0d90 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.346+0000 7ff0332c5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c15ad70 con 0x7ff02c153800 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff02c153800 0x7ff02c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff02c153800 0x7ff02c1599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46046/0 (socket says 172.21.15.81:46046) 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 -- 172.21.15.81:0/1423453565 learned_addr learned my addr 172.21.15.81:0/1423453565 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031862640 1 --2- 172.21.15.81:0/1423453565 >> v2:172.21.15.18:3300/0 conn(0x7ff02c0b0d90 0x7ff02c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 -- 172.21.15.81:0/1423453565 >> v2:172.21.15.18:3300/0 conn(0x7ff02c0b0d90 msgr2=0x7ff02c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 --2- 172.21.15.81:0/1423453565 >> v2:172.21.15.18:3300/0 conn(0x7ff02c0b0d90 0x7ff02c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 -- 172.21.15.81:0/1423453565 >> v1:172.21.15.18:6789/0 conn(0x7ff02c153bd0 legacy=0x7ff02c0b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.352 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 -- 172.21.15.81:0/1423453565 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c15b050 con 0x7ff02c153800 2023-06-09T04:37:48.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff031061640 1 --2- 172.21.15.81:0/1423453565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c1599a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0cc570 tx=0x7ff02801c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c592b2032d92c29 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff023fff640 1 -- 172.21.15.81:0/1423453565 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280ac630 con 0x7ff02c153800 2023-06-09T04:37:48.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff023fff640 1 -- 172.21.15.81:0/1423453565 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0280ac790 con 0x7ff02c153800 2023-06-09T04:37:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff023fff640 1 -- 172.21.15.81:0/1423453565 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280acb20 con 0x7ff02c153800 2023-06-09T04:37:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 -- 172.21.15.81:0/1423453565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 msgr2=0x7ff02c1599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.354 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 --2- 172.21.15.81:0/1423453565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c1599a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0cc570 tx=0x7ff02801c4c0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 -- 172.21.15.81:0/1423453565 shutdown_connections 2023-06-09T04:37:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 --2- 172.21.15.81:0/1423453565 >> v2:172.21.15.18:3300/0 conn(0x7ff02c0b0d90 0x7ff02c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 --2- 172.21.15.81:0/1423453565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c1599a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 -- 172.21.15.81:0/1423453565 >> 172.21.15.81:0/1423453565 conn(0x7ff02c06cdd0 msgr2=0x7ff02c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 -- 172.21.15.81:0/1423453565 shutdown_connections 2023-06-09T04:37:48.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.350+0000 7ff0332c5640 1 -- 172.21.15.81:0/1423453565 wait complete. 2023-06-09T04:37:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 Processor -- start 2023-06-09T04:37:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- start start 2023-06-09T04:37:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 0x7ff02c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff02c153bd0 0x7ff02c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c14d4f0 con 0x7ff02c153bd0 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0c8580 con 0x7ff02c153800 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0c7970 con 0x7ff02c0b0d90 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff030860640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 0x7ff02c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 0x7ff02c150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:54876/0 (socket says 172.21.15.81:54876) 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 -- 172.21.15.81:0/2314690462 learned_addr learned my addr 172.21.15.81:0/2314690462 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031862640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff02c153bd0 0x7ff02c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 -- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 msgr2=0x7ff02c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 -- 172.21.15.81:0/2314690462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff02c153bd0 msgr2=0x7ff02c0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff02c153bd0 0x7ff02c0c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 -- 172.21.15.81:0/2314690462 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280094d0 con 0x7ff02c0b0d90 2023-06-09T04:37:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff031061640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 0x7ff02c150be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff0280af040 tx=0x7ff028019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280b5640 con 0x7ff02c0b0d90 2023-06-09T04:37:48.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0280b57a0 con 0x7ff02c0b0d90 2023-06-09T04:37:48.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c0c7c50 con 0x7ff02c0b0d90 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280b5b10 con 0x7ff02c0b0d90 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c0c8210 con 0x7ff02c0b0d90 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c073380 con 0x7ff02c0b0d90 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0280b3070 con 0x7ff02c0b0d90 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.354+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff0280c0d70 con 0x7ff02c0b0d90 2023-06-09T04:37:48.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.358+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff0280b1070 con 0x7ff02c0b0d90 2023-06-09T04:37:48.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.422+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0294f8c7-ffd3-4adc-b038-1d90f3a1277b", "id": 2} v 0) v1 -- 0x7ff02c06b190 con 0x7ff02c0b0d90 2023-06-09T04:37:48.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff021ffb640 1 -- 172.21.15.81:0/2314690462 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0294f8c7-ffd3-4adc-b038-1d90f3a1277b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff0280a8050 con 0x7ff02c0b0d90 2023-06-09T04:37:48.431 INFO:teuthology.orchestra.run.smithi081.stdout:2 2023-06-09T04:37:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 msgr2=0x7ff02c150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 0x7ff02c150be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff0280af040 tx=0x7ff028019260 comp rx=0 tx=0).stop 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 shutdown_connections 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff02c153bd0 0x7ff02c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff02c153800 0x7ff02c0c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 --2- 172.21.15.81:0/2314690462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff02c0b0d90 0x7ff02c150be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 >> 172.21.15.81:0/2314690462 conn(0x7ff02c06cdd0 msgr2=0x7ff02c0b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 shutdown_connections 2023-06-09T04:37:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.430+0000 7ff0332c5640 1 -- 172.21.15.81:0/2314690462 wait complete. 2023-06-09T04:37:48.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664 3 2023-06-09T04:37:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 Processor -- start 2023-06-09T04:37:48.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 -- start start 2023-06-09T04:37:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 0x7f352c0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f352c158510 0x7f352c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c0b1100 con 0x7f352c158510 2023-06-09T04:37:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c15bea0 con 0x7f352c0cb5d0 2023-06-09T04:37:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3530ce8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0b1340 con 0x7f352c15cbd0 2023-06-09T04:37:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f352a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 0x7f352c0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c0b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:54878/0 (socket says 172.21.15.81:54878) 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f352a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 0x7f352c0cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46066/0 (socket says 172.21.15.81:46066) 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f3529d9b640 1 -- 172.21.15.81:0/563674195 learned_addr learned my addr 172.21.15.81:0/563674195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.554+0000 7f352ad9d640 1 --2- 172.21.15.81:0/563674195 >> v2:172.21.15.18:3300/0 conn(0x7f352c158510 0x7f352c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3529d9b640 1 -- 172.21.15.81:0/563674195 >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 msgr2=0x7f352c0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3529d9b640 1 --2- 172.21.15.81:0/563674195 >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 0x7f352c0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3529d9b640 1 -- 172.21.15.81:0/563674195 >> v2:172.21.15.18:3300/0 conn(0x7f352c158510 msgr2=0x7f352c0b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3529d9b640 1 --2- 172.21.15.81:0/563674195 >> v2:172.21.15.18:3300/0 conn(0x7f352c158510 0x7f352c0b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3529d9b640 1 -- 172.21.15.81:0/563674195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c15c0f0 con 0x7f352c15cbd0 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f352a59c640 1 --2- 172.21.15.81:0/563674195 >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 0x7f352c0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3529d9b640 1 --2- 172.21.15.81:0/563674195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c0b0680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f352c070b60 tx=0x7f352001e620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc68661a827bff8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f352959a640 1 -- 172.21.15.81:0/563674195 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35200ac640 con 0x7f352c15cbd0 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f352959a640 1 -- 172.21.15.81:0/563674195 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35200ac7a0 con 0x7f352c15cbd0 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f352959a640 1 -- 172.21.15.81:0/563674195 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35200acb30 con 0x7f352c15cbd0 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 -- 172.21.15.81:0/563674195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 msgr2=0x7f352c0b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 --2- 172.21.15.81:0/563674195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c0b0680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f352c070b60 tx=0x7f352001e620 comp rx=0 tx=0).stop 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 -- 172.21.15.81:0/563674195 shutdown_connections 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 --2- 172.21.15.81:0/563674195 >> v2:172.21.15.18:3300/0 conn(0x7f352c158510 0x7f352c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 --2- 172.21.15.81:0/563674195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c0b0680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 --2- 172.21.15.81:0/563674195 >> v2:172.21.15.81:3300/0 conn(0x7f352c0cb5d0 0x7f352c0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 -- 172.21.15.81:0/563674195 >> 172.21.15.81:0/563674195 conn(0x7f352c06cdd0 msgr2=0x7f352c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 -- 172.21.15.81:0/563674195 shutdown_connections 2023-06-09T04:37:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.558+0000 7f3530ce8640 1 -- 172.21.15.81:0/563674195 wait complete. 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 Processor -- start 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- start start 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352c0cb5d0 0x7f352c0c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352c158510 0x7f352c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0c60e0 con 0x7f352c0cb5d0 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0b22d0 con 0x7f352c158510 2023-06-09T04:37:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c14d030 con 0x7f352c15cbd0 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3529d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352c158510 0x7f352c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c14dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:54886/0 (socket says 172.21.15.81:54886) 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 -- 172.21.15.81:0/364960056 learned_addr learned my addr 172.21.15.81:0/364960056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352a59c640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352c0cb5d0 0x7f352c0c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 -- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352c158510 msgr2=0x7f352c14c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352c158510 0x7f352c14c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 -- 172.21.15.81:0/364960056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352c0cb5d0 msgr2=0x7f352c0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352c0cb5d0 0x7f352c0c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 -- 172.21.15.81:0/364960056 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c009420 con 0x7f352c15cbd0 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352a59c640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352c0cb5d0 0x7f352c0c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3529d9b640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352c158510 0x7f352c14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f352ad9d640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c14dd50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3524007e40 tx=0x7f352400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524014620 con 0x7f352c15cbd0 2023-06-09T04:37:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400ee90 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3520009480 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240149e0 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c0c5d70 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f352401e460 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f352401d850 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.562+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c0c6250 con 0x7f352c15cbd0 2023-06-09T04:37:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.566+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f352401d3c0 con 0x7f352c15cbd0 2023-06-09T04:37:48.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.626+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664", "id": 3} v 0) v1 -- 0x7f352c073380 con 0x7f352c15cbd0 2023-06-09T04:37:48.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.634+0000 7f351affd640 1 -- 172.21.15.81:0/364960056 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f352401d640 con 0x7f352c15cbd0 2023-06-09T04:37:48.638 INFO:teuthology.orchestra.run.smithi081.stdout:3 2023-06-09T04:37:48.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 msgr2=0x7f352c14dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c14dd50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3524007e40 tx=0x7f352400e4b0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 shutdown_connections 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352c15cbd0 0x7f352c14dd50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352c158510 0x7f352c14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 --2- 172.21.15.81:0/364960056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352c0cb5d0 0x7f352c0c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 >> 172.21.15.81:0/364960056 conn(0x7f352c06cdd0 msgr2=0x7f352c157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 shutdown_connections 2023-06-09T04:37:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.638+0000 7f3530ce8640 1 -- 172.21.15.81:0/364960056 wait complete. 2023-06-09T04:37:48.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new ada1aedb-b705-438f-89cd-a123f1d2bc42 4 2023-06-09T04:37:48.738 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:48.737+0000 7f7309b38180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:48.756 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:48.754+0000 7fe6d81cc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 Processor -- start 2023-06-09T04:37:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 -- start start 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f50280cb5d0 0x7f50280cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f502815cbd0 0x7f50280b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502815bea0 con 0x7f5028158510 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280caf20 con 0x7f50280cb5d0 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f502dc67640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280b1340 con 0x7f502815cbd0 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5026ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f502815cbd0 0x7f50280b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5027fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5028158510 0x7f50280cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60376/0 (socket says 172.21.15.81:60376) 2023-06-09T04:37:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5027fff640 1 -- 172.21.15.81:0/1430779419 learned_addr learned my addr 172.21.15.81:0/1430779419 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-06-09T04:37:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f50277fe640 1 --2- 172.21.15.81:0/1430779419 >> v2:172.21.15.18:3300/0 conn(0x7f50280cb5d0 0x7f50280cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f50267fc640 1 -- 172.21.15.81:0/1430779419 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302660491 0 0) 0x7f502815bea0 con 0x7f5028158510 2023-06-09T04:37:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5026ffd640 1 -- 172.21.15.81:0/1430779419 >> v2:172.21.15.18:3300/0 conn(0x7f50280cb5d0 msgr2=0x7f50280cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5026ffd640 1 --2- 172.21.15.81:0/1430779419 >> v2:172.21.15.18:3300/0 conn(0x7f50280cb5d0 0x7f50280cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5026ffd640 1 -- 172.21.15.81:0/1430779419 >> v1:172.21.15.81:6789/0 conn(0x7f5028158510 legacy=0x7f50280cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.758+0000 7f5026ffd640 1 -- 172.21.15.81:0/1430779419 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502815c0f0 con 0x7f502815cbd0 2023-06-09T04:37:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f5026ffd640 1 --2- 172.21.15.81:0/1430779419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f50280b0680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50180097a0 tx=0x7f501801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e3dbef57698b46 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f50267fc640 1 -- 172.21.15.81:0/1430779419 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ad680 con 0x7f502815cbd0 2023-06-09T04:37:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f50267fc640 1 -- 172.21.15.81:0/1430779419 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180ad7e0 con 0x7f502815cbd0 2023-06-09T04:37:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f50267fc640 1 -- 172.21.15.81:0/1430779419 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180adb70 con 0x7f502815cbd0 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- 172.21.15.81:0/1430779419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 msgr2=0x7f50280b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 --2- 172.21.15.81:0/1430779419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f50280b0680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50180097a0 tx=0x7f501801c380 comp rx=0 tx=0).stop 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- 172.21.15.81:0/1430779419 shutdown_connections 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 --2- 172.21.15.81:0/1430779419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f50280b0680 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 --2- 172.21.15.81:0/1430779419 >> v2:172.21.15.18:3300/0 conn(0x7f50280cb5d0 0x7f50280cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- 172.21.15.81:0/1430779419 >> 172.21.15.81:0/1430779419 conn(0x7f502806cdd0 msgr2=0x7f502806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- 172.21.15.81:0/1430779419 shutdown_connections 2023-06-09T04:37:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- 172.21.15.81:0/1430779419 wait complete. 2023-06-09T04:37:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 Processor -- start 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- start start 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50280cb5d0 0x7f502814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5028158510 0x7f502814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f5028159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280b42c0 con 0x7f50280cb5d0 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280b3f90 con 0x7f502815cbd0 2023-06-09T04:37:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f502dc67640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502814e5d0 con 0x7f5028158510 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f5027fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f5028159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f5027fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f5028159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46090/0 (socket says 172.21.15.81:46090) 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f5027fff640 1 -- 172.21.15.81:0/3327391950 learned_addr learned my addr 172.21.15.81:0/3327391950 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.762+0000 7f5026ffd640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5028158510 0x7f502814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f50277fe640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50280cb5d0 0x7f502814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f5027fff640 1 -- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5028158510 msgr2=0x7f502814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f5027fff640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5028158510 0x7f502814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f5027fff640 1 -- 172.21.15.81:0/3327391950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50280cb5d0 msgr2=0x7f502814cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f5027fff640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50280cb5d0 0x7f502814cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f5027fff640 1 -- 172.21.15.81:0/3327391950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180093b0 con 0x7f502815cbd0 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f5027fff640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f5028159a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f502000c7c0 tx=0x7f502000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000a5e0 con 0x7f502815cbd0 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000a760 con 0x7f502815cbd0 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502814e010 con 0x7f502815cbd0 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000ab10 con 0x7f502815cbd0 2023-06-09T04:37:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502814cc80 con 0x7f502815cbd0 2023-06-09T04:37:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f50200070d0 con 0x7f502815cbd0 2023-06-09T04:37:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5020012910 con 0x7f502815cbd0 2023-06-09T04:37:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280b3df0 con 0x7f502815cbd0 2023-06-09T04:37:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.766+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f50280b3df0 con 0x7f502815cbd0 2023-06-09T04:37:48.793 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:48.789+0000 7f7309b38180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:37:48.811 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:48.810+0000 7fe6d81cc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:37:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.834+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ada1aedb-b705-438f-89cd-a123f1d2bc42", "id": 4} v 0) v1 -- 0x7f50280b4430 con 0x7f502815cbd0 2023-06-09T04:37:48.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.842+0000 7f500ffff640 1 -- 172.21.15.81:0/3327391950 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ada1aedb-b705-438f-89cd-a123f1d2bc42", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5020018070 con 0x7f502815cbd0 2023-06-09T04:37:48.846 INFO:teuthology.orchestra.run.smithi081.stdout:4 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.842+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 msgr2=0x7f5028159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.842+0000 7f502dc67640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f5028159a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f502000c7c0 tx=0x7f502000cc80 comp rx=0 tx=0).stop 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 shutdown_connections 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502815cbd0 0x7f5028159a00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5028158510 0x7f502814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 --2- 172.21.15.81:0/3327391950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50280cb5d0 0x7f502814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 >> 172.21.15.81:0/3327391950 conn(0x7f502806cdd0 msgr2=0x7f502806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 shutdown_connections 2023-06-09T04:37:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.846+0000 7f502dc67640 1 -- 172.21.15.81:0/3327391950 wait complete. 2023-06-09T04:37:48.848 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:48.845+0000 7f7309b38180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:37:48.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f 5 2023-06-09T04:37:48.866 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:48.866+0000 7fe6d81cc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:37:48.928 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:48.925+0000 7f7309b38180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:37:48.945 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:48.942+0000 7fe6d81cc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:37:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.974+0000 7fd291cf7640 1 Processor -- start 2023-06-09T04:37:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.974+0000 7fd291cf7640 1 -- start start 2023-06-09T04:37:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd291cf7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd28c15b7e0 0x7fd28c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd291cf7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd28c0cce90 0x7fd28c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd291cf7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c15bbb0 con 0x7fd28c15f800 2023-06-09T04:37:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd291cf7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c0ca3c0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd291cf7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c15fd80 con 0x7fd28c0cce90 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd28c0cce90 0x7fd28c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd28c0cce90 0x7fd28c0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46100/0 (socket says 172.21.15.81:46100) 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 -- 172.21.15.81:0/1544514528 learned_addr learned my addr 172.21.15.81:0/1544514528 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28b7fe640 1 --2- 172.21.15.81:0/1544514528 >> v2:172.21.15.18:3300/0 conn(0x7fd28c15b7e0 0x7fd28c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 -- 172.21.15.81:0/1544514528 >> v2:172.21.15.18:3300/0 conn(0x7fd28c15b7e0 msgr2=0x7fd28c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 --2- 172.21.15.81:0/1544514528 >> v2:172.21.15.18:3300/0 conn(0x7fd28c15b7e0 0x7fd28c15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 -- 172.21.15.81:0/1544514528 >> v1:172.21.15.18:6789/0 conn(0x7fd28c15f800 legacy=0x7fd28c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.978+0000 7fd28bfff640 1 -- 172.21.15.81:0/1544514528 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c160060 con 0x7fd28c0cce90 2023-06-09T04:37:48.981 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:48.981+0000 7f7309b38180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:37:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28bfff640 1 --2- 172.21.15.81:0/1544514528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c0cce90 0x7fd28c0cadd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0cd260 tx=0x7fd28401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b88fab0ede12e9d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28a7fc640 1 -- 172.21.15.81:0/1544514528 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840a5860 con 0x7fd28c0cce90 2023-06-09T04:37:48.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28a7fc640 1 -- 172.21.15.81:0/1544514528 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2840a59c0 con 0x7fd28c0cce90 2023-06-09T04:37:48.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28a7fc640 1 -- 172.21.15.81:0/1544514528 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840a5d50 con 0x7fd28c0cce90 2023-06-09T04:37:48.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/1544514528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c0cce90 msgr2=0x7fd28c0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 --2- 172.21.15.81:0/1544514528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c0cce90 0x7fd28c0cadd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0cd260 tx=0x7fd28401c9a0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/1544514528 shutdown_connections 2023-06-09T04:37:48.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 --2- 172.21.15.81:0/1544514528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c0cce90 0x7fd28c0cadd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 --2- 172.21.15.81:0/1544514528 >> v2:172.21.15.18:3300/0 conn(0x7fd28c15b7e0 0x7fd28c15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/1544514528 >> 172.21.15.81:0/1544514528 conn(0x7fd28c06ce60 msgr2=0x7fd28c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/1544514528 shutdown_connections 2023-06-09T04:37:48.985 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/1544514528 wait complete. 2023-06-09T04:37:48.986 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 Processor -- start 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- start start 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c0cce90 0x7fd28c140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 0x7fd28c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 0x7fd28c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c14f480 con 0x7fd28c0cce90 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c15d820 con 0x7fd28c15f800 2023-06-09T04:37:48.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c14e800 con 0x7fd28c15b7e0 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 0x7fd28c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 0x7fd28c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 0x7fd28c15e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:54914/0 (socket says 172.21.15.81:54914) 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 0x7fd28c0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46108/0 (socket says 172.21.15.81:46108) 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 -- 172.21.15.81:0/2738283060 learned_addr learned my addr 172.21.15.81:0/2738283060 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28b7fe640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c0cce90 0x7fd28c140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 -- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 msgr2=0x7fd28c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 0x7fd28c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 -- 172.21.15.81:0/2738283060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c0cce90 msgr2=0x7fd28c140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c0cce90 0x7fd28c140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 -- 172.21.15.81:0/2738283060 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009b30 con 0x7fd28c15b7e0 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28bfff640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 0x7fd28c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28b7fe640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c0cce90 0x7fd28c140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd28affd640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 0x7fd28c15e390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c3c0 tx=0x7fd28000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800052d0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280005430 con 0x7fd28c15b7e0 2023-06-09T04:37:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c14eae0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280003840 con 0x7fd28c15b7e0 2023-06-09T04:37:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.982+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c14f0a0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.986+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd280003ca0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.986+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd2800129a0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.986+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c14f5c0 con 0x7fd28c15b7e0 2023-06-09T04:37:48.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:48.986+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd28c14f5c0 con 0x7fd28c15b7e0 2023-06-09T04:37:49.001 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:48.998+0000 7fe6d81cc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:37:49.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.054+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f", "id": 5} v 0) v1 -- 0x7fd28c073380 con 0x7fd28c15b7e0 2023-06-09T04:37:49.061 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:49.057+0000 7f7309b38180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:37:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd273fff640 1 -- 172.21.15.81:0/2738283060 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd280017070 con 0x7fd28c15b7e0 2023-06-09T04:37:49.064 INFO:teuthology.orchestra.run.smithi081.stdout:5 2023-06-09T04:37:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 msgr2=0x7fd28c15e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 0x7fd28c15e390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c3c0 tx=0x7fd28000c880 comp rx=0 tx=0).stop 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 shutdown_connections 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c15f800 0x7fd28c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15b7e0 0x7fd28c15e390 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 --2- 172.21.15.81:0/2738283060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c0cce90 0x7fd28c140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 >> 172.21.15.81:0/2738283060 conn(0x7fd28c06ce60 msgr2=0x7fd28c0b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 shutdown_connections 2023-06-09T04:37:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.062+0000 7fd291cf7640 1 -- 172.21.15.81:0/2738283060 wait complete. 2023-06-09T04:37:49.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 56bd42d6-a4fd-42c8-b24d-53c67224faab 6 2023-06-09T04:37:49.086 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:49.082+0000 7fe6d81cc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:37:49.115 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:49.113+0000 7f7309b38180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:37:49.139 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:49.138+0000 7fe6d81cc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:37:49.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 Processor -- start 2023-06-09T04:37:49.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 -- start start 2023-06-09T04:37:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1be81595b0 0x7f1be80b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1be80cf890 0x7f1be80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be8159980 con 0x7f1be80cc9a0 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80cbfc0 con 0x7f1be80cf890 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1beffce640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80ce710 con 0x7f1be81595b0 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bedd6a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1be81595b0 0x7f1be80b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bedd6a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1be81595b0 0x7f1be80b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46114/0 (socket says 172.21.15.81:46114) 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bedd6a640 1 -- 172.21.15.81:0/1371999337 learned_addr learned my addr 172.21.15.81:0/1371999337 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bed569640 1 --2- 172.21.15.81:0/1371999337 >> v2:172.21.15.18:3300/0 conn(0x7f1be80cf890 0x7f1be80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bedd6a640 1 -- 172.21.15.81:0/1371999337 >> v2:172.21.15.18:3300/0 conn(0x7f1be80cf890 msgr2=0x7f1be80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bedd6a640 1 --2- 172.21.15.81:0/1371999337 >> v2:172.21.15.18:3300/0 conn(0x7f1be80cf890 0x7f1be80cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.194+0000 7f1bedd6a640 1 -- 172.21.15.81:0/1371999337 >> v1:172.21.15.18:6789/0 conn(0x7f1be80cc9a0 legacy=0x7f1be80b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1bedd6a640 1 -- 172.21.15.81:0/1371999337 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80cabb0 con 0x7f1be81595b0 2023-06-09T04:37:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1bedd6a640 1 --2- 172.21.15.81:0/1371999337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be81595b0 0x7f1be80b2bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1be806db50 tx=0x7f1be401c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a32a67b3df8f17 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1becd68640 1 -- 172.21.15.81:0/1371999337 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be40ac630 con 0x7f1be81595b0 2023-06-09T04:37:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1becd68640 1 -- 172.21.15.81:0/1371999337 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be40ac790 con 0x7f1be81595b0 2023-06-09T04:37:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1becd68640 1 -- 172.21.15.81:0/1371999337 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be40acb20 con 0x7f1be81595b0 2023-06-09T04:37:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 -- 172.21.15.81:0/1371999337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be81595b0 msgr2=0x7f1be80b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 --2- 172.21.15.81:0/1371999337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be81595b0 0x7f1be80b2bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1be806db50 tx=0x7f1be401c4c0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 -- 172.21.15.81:0/1371999337 shutdown_connections 2023-06-09T04:37:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 --2- 172.21.15.81:0/1371999337 >> v2:172.21.15.18:3300/0 conn(0x7f1be80cf890 0x7f1be80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 --2- 172.21.15.81:0/1371999337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be81595b0 0x7f1be80b2bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 -- 172.21.15.81:0/1371999337 >> 172.21.15.81:0/1371999337 conn(0x7f1be806ce60 msgr2=0x7f1be806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 -- 172.21.15.81:0/1371999337 shutdown_connections 2023-06-09T04:37:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.198+0000 7f1beffce640 1 -- 172.21.15.81:0/1371999337 wait complete. 2023-06-09T04:37:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 Processor -- start 2023-06-09T04:37:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- start start 2023-06-09T04:37:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1be80cc9a0 0x7f1be814ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 0x7f1be815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1be81595b0 0x7f1be815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80c6e40 con 0x7f1be80cc9a0 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80c7090 con 0x7f1be80cf890 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80c7370 con 0x7f1be81595b0 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 0x7f1be815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 0x7f1be815a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46116/0 (socket says 172.21.15.81:46116) 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 -- 172.21.15.81:0/2710957137 learned_addr learned my addr 172.21.15.81:0/2710957137 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bee56b640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1be81595b0 0x7f1be815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bedd6a640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1be80cc9a0 0x7f1be814ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 -- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1be81595b0 msgr2=0x7f1be815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1be81595b0 0x7f1be815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 -- 172.21.15.81:0/2710957137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1be80cc9a0 msgr2=0x7f1be814ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1be80cc9a0 0x7f1be814ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 -- 172.21.15.81:0/2710957137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be40094d0 con 0x7f1be80cf890 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bee56b640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1be81595b0 0x7f1be815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bed569640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 0x7f1be815a970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00d800 tx=0x7f1bdc00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00b6c0 con 0x7f1be80cf890 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00b820 con 0x7f1be80cf890 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be80ce9f0 con 0x7f1be80cf890 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00bb90 con 0x7f1be80cf890 2023-06-09T04:37:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be80c7930 con 0x7f1be80cf890 2023-06-09T04:37:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1bdc01e460 con 0x7f1be80cf890 2023-06-09T04:37:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1bdc014b60 con 0x7f1be80cf890 2023-06-09T04:37:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.202+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be80c7af0 con 0x7f1be80cf890 2023-06-09T04:37:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.206+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1bdc014e20 con 0x7f1be80cf890 2023-06-09T04:37:49.258 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:49.257+0000 7f7309b38180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:37:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.274+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56bd42d6-a4fd-42c8-b24d-53c67224faab", "id": 6} v 0) v1 -- 0x7f1be8073380 con 0x7f1be80cf890 2023-06-09T04:37:49.283 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:49.282+0000 7fe6d81cc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:37:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1bda7fc640 1 -- 172.21.15.81:0/2710957137 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56bd42d6-a4fd-42c8-b24d-53c67224faab", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bdc0146a0 con 0x7f1be80cf890 2023-06-09T04:37:49.285 INFO:teuthology.orchestra.run.smithi081.stdout:6 2023-06-09T04:37:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 msgr2=0x7f1be815a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 0x7f1be815a970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00d800 tx=0x7f1bdc00dcc0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 shutdown_connections 2023-06-09T04:37:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1be81595b0 0x7f1be815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be80cf890 0x7f1be815a970 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 --2- 172.21.15.81:0/2710957137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1be80cc9a0 0x7f1be814ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 >> 172.21.15.81:0/2710957137 conn(0x7f1be806ce60 msgr2=0x7f1be80b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 shutdown_connections 2023-06-09T04:37:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.282+0000 7f1beffce640 1 -- 172.21.15.81:0/2710957137 wait complete. 2023-06-09T04:37:49.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 7f18ccf2-58b3-4f48-9858-5216768ac1b6 7 2023-06-09T04:37:49.321 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:49.317+0000 7f7309b38180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:37:49.345 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:49.342+0000 7fe6d81cc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:37:49.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.406+0000 7f77e1972640 1 Processor -- start 2023-06-09T04:37:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77e1972640 1 -- start start 2023-06-09T04:37:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77e1972640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77dc0cf890 0x7f77dc0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77e1972640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc159980 con 0x7f77dc1595b0 2023-06-09T04:37:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77e1972640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc0cabb0 con 0x7f77dc0ccb70 2023-06-09T04:37:49.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77e1972640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc0cbfc0 con 0x7f77dc0cf890 2023-06-09T04:37:49.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f77dc0ccb70 0x7f77dc15d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60390/0 (socket says 172.21.15.81:60390) 2023-06-09T04:37:49.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 -- 172.21.15.81:0/2961947361 learned_addr learned my addr 172.21.15.81:0/2961947361 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-06-09T04:37:49.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77da7fc640 1 --2- 172.21.15.81:0/2961947361 >> v2:172.21.15.18:3300/0 conn(0x7f77dc0cf890 0x7f77dc0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972677322 0 0) 0x7f77dc0cabb0 con 0x7f77dc0ccb70 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c4003530 con 0x7f77dc0ccb70 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 314494128 0 0) 0x7f77c4003530 con 0x7f77dc0ccb70 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 >> v2:172.21.15.18:3300/0 conn(0x7f77dc0cf890 msgr2=0x7f77dc0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 --2- 172.21.15.81:0/2961947361 >> v2:172.21.15.18:3300/0 conn(0x7f77dc0cf890 0x7f77dc0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 >> v1:172.21.15.18:6789/0 conn(0x7f77dc1595b0 legacy=0x7f77dc0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0ce9f0 con 0x7f77dc0ccb70 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f77d4001a00 con 0x7f77dc0ccb70 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 >> v1:172.21.15.81:6789/0 conn(0x7f77dc0ccb70 legacy=0x7f77dc15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77c4003980 0x7f77c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40047d0 0x7f77c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0cbfc0 con 0x7f77c40047d0 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c400c000 con 0x7f77c4005180 2023-06-09T04:37:49.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c400c1c0 con 0x7f77c4003980 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77daffd640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77c4003980 0x7f77c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77da7fc640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40047d0 0x7f77c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 -- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77c4003980 msgr2=0x7f77c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77c4003980 0x7f77c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 -- 172.21.15.81:0/2961947361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40047d0 msgr2=0x7f77c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40047d0 0x7f77c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77db7fe640 1 -- 172.21.15.81:0/2961947361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4003530 con 0x7f77c4005180 2023-06-09T04:37:49.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.410+0000 7f77da7fc640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40047d0 0x7f77c4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:49.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 -- 172.21.15.81:0/2961947361 reap_dead start 2023-06-09T04:37:49.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77c400b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f77d40013e0 tx=0x7f77d401fa60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d98871d033b20765 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40aa690 con 0x7f77c4005180 2023-06-09T04:37:49.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40aa7f0 con 0x7f77c4005180 2023-06-09T04:37:49.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77d9ffb640 1 -- 172.21.15.81:0/2961947361 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40aaba0 con 0x7f77c4005180 2023-06-09T04:37:49.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 msgr2=0x7f77c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77c400b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f77d40013e0 tx=0x7f77d401fa60 comp rx=0 tx=0).stop 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- 172.21.15.81:0/2961947361 shutdown_connections 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 --2- 172.21.15.81:0/2961947361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77c400b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- 172.21.15.81:0/2961947361 >> 172.21.15.81:0/2961947361 conn(0x7f77dc06ce60 msgr2=0x7f77dc06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- 172.21.15.81:0/2961947361 shutdown_connections 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- 172.21.15.81:0/2961947361 wait complete. 2023-06-09T04:37:49.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 Processor -- start 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- start start 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77dc157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77dc0b35b0 0x7f77dc0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 0x7f77dc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc1e6060 con 0x7f77dc0b35b0 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc1e38c0 con 0x7f77c4005180 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77e1972640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0b3a40 con 0x7f77dc0b1c00 2023-06-09T04:37:49.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77dc157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 0x7f77dc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77dc157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46124/0 (socket says 172.21.15.81:46124) 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 0x7f77dc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:54942/0 (socket says 172.21.15.81:54942) 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77daffd640 1 -- 172.21.15.81:0/3123856171 learned_addr learned my addr 172.21.15.81:0/3123856171 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77da7fc640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77dc0b35b0 0x7f77dc0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 -- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 msgr2=0x7f77dc157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77dc157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 -- 172.21.15.81:0/3123856171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77dc0b35b0 msgr2=0x7f77dc0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77dc0b35b0 0x7f77dc0b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 -- 172.21.15.81:0/3123856171 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0b3d20 con 0x7f77dc0b1c00 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.414+0000 7f77db7fe640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 0x7f77dc0b4ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0cf2a0 tx=0x7f77c4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40aa690 con 0x7f77dc0b1c00 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4001bc0 con 0x7f77dc0b1c00 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc0b4000 con 0x7f77dc0b1c00 2023-06-09T04:37:49.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40aaba0 con 0x7f77dc0b1c00 2023-06-09T04:37:49.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc0b5410 con 0x7f77dc0b1c00 2023-06-09T04:37:49.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc1e3a00 con 0x7f77dc0b1c00 2023-06-09T04:37:49.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77d40070f0 con 0x7f77dc0b1c00 2023-06-09T04:37:49.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f77d40abad0 con 0x7f77dc0b1c00 2023-06-09T04:37:49.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.418+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f77d40bb070 con 0x7f77dc0b1c00 2023-06-09T04:37:49.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.486+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7f18ccf2-58b3-4f48-9858-5216768ac1b6", "id": 7} v 0) v1 -- 0x7f77dc06ecb0 con 0x7f77dc0b1c00 2023-06-09T04:37:49.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.494+0000 7f77c3fff640 1 -- 172.21.15.81:0/3123856171 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f18ccf2-58b3-4f48-9858-5216768ac1b6", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77d400a460 con 0x7f77dc0b1c00 2023-06-09T04:37:49.498 INFO:teuthology.orchestra.run.smithi081.stdout:7 2023-06-09T04:37:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 msgr2=0x7f77dc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 0x7f77dc0b4ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0cf2a0 tx=0x7f77c4005800 comp rx=0 tx=0).stop 2023-06-09T04:37:49.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 shutdown_connections 2023-06-09T04:37:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f77dc0b1c00 0x7f77dc0b4ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77dc0b35b0 0x7f77dc0b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 --2- 172.21.15.81:0/3123856171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c4005180 0x7f77dc157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 >> 172.21.15.81:0/3123856171 conn(0x7f77dc06ce60 msgr2=0x7f77dc1586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 shutdown_connections 2023-06-09T04:37:49.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-06-09T04:37:49.498+0000 7f77e1972640 1 -- 172.21.15.81:0/3123856171 wait complete. 2023-06-09T04:37:49.513 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-09T04:37:49.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-09T04:37:49.516 INFO:tasks.ceph.osd.0:Started 2023-06-09T04:37:49.516 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-09T04:37:49.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-09T04:37:49.519 INFO:tasks.ceph.osd.1:Started 2023-06-09T04:37:49.519 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-09T04:37:49.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-09T04:37:49.521 INFO:tasks.ceph.osd.2:Started 2023-06-09T04:37:49.522 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-09T04:37:49.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-09T04:37:49.525 INFO:tasks.ceph.osd.3:Started 2023-06-09T04:37:49.525 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-09T04:37:49.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-09T04:37:49.556 INFO:tasks.ceph.osd.4:Started 2023-06-09T04:37:49.556 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-09T04:37:49.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-09T04:37:49.558 INFO:tasks.ceph.osd.5:Started 2023-06-09T04:37:49.559 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-09T04:37:49.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-09T04:37:49.561 INFO:tasks.ceph.osd.6:Started 2023-06-09T04:37:49.561 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-09T04:37:49.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-09T04:37:49.563 INFO:tasks.ceph.osd.7:Started 2023-06-09T04:37:49.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e83fd0640 1 Processor -- start 2023-06-09T04:37:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e83fd0640 1 -- start start 2023-06-09T04:37:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e83fd0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e7c15ba50 0x7f9e7c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e83fd0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c0cb460 con 0x7f9e7c0b4050 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e83fd0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c0cd0c0 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e83fd0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c0cf800 con 0x7f9e7c15ba50 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e81d6c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e7c15ba50 0x7f9e7c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e8156b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9e7c0b4050 0x7f9e7c0b05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39196/0 (socket says 172.21.15.18:39196) 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e81d6c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e7c15ba50 0x7f9e7c0b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53142/0 (socket says 172.21.15.18:53142) 2023-06-09T04:37:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e8156b640 1 -- 172.21.15.18:0/2589532763 learned_addr learned my addr 172.21.15.18:0/2589532763 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:37:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e81d6c640 1 -- 172.21.15.18:0/2589532763 >> v1:172.21.15.81:6789/0 conn(0x7f9e7c0b44c0 legacy=0x7f9e7c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.709+0000 7f9e81d6c640 1 -- 172.21.15.18:0/2589532763 >> v1:172.21.15.18:6789/0 conn(0x7f9e7c0b4050 legacy=0x7f9e7c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e81d6c640 1 -- 172.21.15.18:0/2589532763 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0b1410 con 0x7f9e7c15ba50 2023-06-09T04:37:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e80d6a640 1 -- 172.21.15.18:0/2589532763 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839472461 0 0) 0x7f9e7c0cb460 con 0x7f9e7c0b4050 2023-06-09T04:37:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e81d6c640 1 --2- 172.21.15.18:0/2589532763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c15ba50 0x7f9e7c0b3b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e780097c0 tx=0x7f9e7801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8c2bc818ed05f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e80d6a640 1 -- 172.21.15.18:0/2589532763 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780ad680 con 0x7f9e7c15ba50 2023-06-09T04:37:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e80d6a640 1 -- 172.21.15.18:0/2589532763 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780ad7e0 con 0x7f9e7c15ba50 2023-06-09T04:37:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e80d6a640 1 -- 172.21.15.18:0/2589532763 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780adb70 con 0x7f9e7c15ba50 2023-06-09T04:37:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 -- 172.21.15.18:0/2589532763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c15ba50 msgr2=0x7f9e7c0b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 --2- 172.21.15.18:0/2589532763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c15ba50 0x7f9e7c0b3b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e780097c0 tx=0x7f9e7801c380 comp rx=0 tx=0).stop 2023-06-09T04:37:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 -- 172.21.15.18:0/2589532763 shutdown_connections 2023-06-09T04:37:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 --2- 172.21.15.18:0/2589532763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c15ba50 0x7f9e7c0b3b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 -- 172.21.15.18:0/2589532763 >> 172.21.15.18:0/2589532763 conn(0x7f9e7c0b2720 msgr2=0x7f9e7c0ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 -- 172.21.15.18:0/2589532763 shutdown_connections 2023-06-09T04:37:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 -- 172.21.15.18:0/2589532763 wait complete. 2023-06-09T04:37:49.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.713+0000 7f9e83fd0640 1 Processor -- start 2023-06-09T04:37:49.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- start start 2023-06-09T04:37:49.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c0b4050 0x7f9e7c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 0x7f9e7c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7c148980 0x7f9e7c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c156250 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c149360 con 0x7f9e7c0b4050 2023-06-09T04:37:49.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c14e490 con 0x7f9e7c148980 2023-06-09T04:37:49.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 0x7f9e7c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e81d6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c0b4050 0x7f9e7c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 0x7f9e7c0ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53148/0 (socket says 172.21.15.18:53148) 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 -- 172.21.15.18:0/3026987891 learned_addr learned my addr 172.21.15.18:0/3026987891 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8256d640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7c148980 0x7f9e7c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 -- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7c148980 msgr2=0x7f9e7c148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7c148980 0x7f9e7c148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 -- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c0b4050 msgr2=0x7f9e7c150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c0b4050 0x7f9e7c150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 -- 172.21.15.18:0/3026987891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78009420 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e81d6c640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c0b4050 0x7f9e7c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e8156b640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 0x7f9e7c0ae6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00c480 tx=0x7f9e6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0074e0 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c007660 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c14e770 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c004a30 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c14ed30 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9e6c012400 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9e6c01ba30 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.717+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c0b0260 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.725+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9e6c018070 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.781+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e7c073380 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e727fc640 1 -- 172.21.15.18:0/3026987891 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9e6c01bcd0 con 0x7f9e7c0b44c0 2023-06-09T04:37:49.786 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:37:49.787 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:37:49.491271+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:49.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 msgr2=0x7f9e7c0ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 0x7f9e7c0ae6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00c480 tx=0x7f9e6c00c940 comp rx=0 tx=0).stop 2023-06-09T04:37:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 shutdown_connections 2023-06-09T04:37:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e7c148980 0x7f9e7c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7c0b44c0 0x7f9e7c0ae6f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 --2- 172.21.15.18:0/3026987891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7c0b4050 0x7f9e7c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 >> 172.21.15.18:0/3026987891 conn(0x7f9e7c0b2720 msgr2=0x7f9e7c0af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 shutdown_connections 2023-06-09T04:37:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:37:49.785+0000 7f9e83fd0640 1 -- 172.21.15.18:0/3026987891 wait complete. 2023-06-09T04:37:49.804 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-09T04:37:49.805 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-09T04:37:49.913 INFO:tasks.ceph.mgr.y.smithi018.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-09T04:37:49.913 INFO:tasks.ceph.mgr.y.smithi018.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-09T04:37:49.913 INFO:tasks.ceph.mgr.y.smithi018.stderr: from numpy import show_config as show_numpy_config 2023-06-09T04:37:49.930 INFO:tasks.ceph.mgr.x.smithi081.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-09T04:37:49.930 INFO:tasks.ceph.mgr.x.smithi081.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-09T04:37:49.930 INFO:tasks.ceph.mgr.x.smithi081.stderr: from numpy import show_config as show_numpy_config 2023-06-09T04:37:49.952 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T04:37:49.950+0000 7f176e287640 -1 Falling back to public interface 2023-06-09T04:37:49.952 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T04:37:49.950+0000 7fa29942d640 -1 Falling back to public interface 2023-06-09T04:37:49.963 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:49.961+0000 7f7309b38180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:37:49.971 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T04:37:49.970+0000 7f0e9b766640 -1 Falling back to public interface 2023-06-09T04:37:49.972 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T04:37:49.970+0000 7f80d4e6a640 -1 Falling back to public interface 2023-06-09T04:37:50.002 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:49.998+0000 7fe6d81cc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:37:50.092 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:50.089+0000 7f7309b38180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:50.123 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:50.122+0000 7fe6d81cc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:50.139 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T04:37:50.137+0000 7fafd73b7640 -1 Falling back to public interface 2023-06-09T04:37:50.147 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T04:37:50.145+0000 7fc30e74b640 -1 Falling back to public interface 2023-06-09T04:37:50.162 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T04:37:50.161+0000 7f79c9539640 -1 Falling back to public interface 2023-06-09T04:37:50.163 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T04:37:50.161+0000 7f67f7d76640 -1 Falling back to public interface 2023-06-09T04:37:50.255 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:50.253+0000 7f7309b38180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:50.275 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:50.274+0000 7fe6d81cc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:37:50.324 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:50.321+0000 7f7309b38180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:37:50.338 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:50.334+0000 7fe6d81cc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:37:50.452 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:50.449+0000 7f7309b38180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:50.458 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:50.454+0000 7fe6d81cc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:37:50.609 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:50.721 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.717+0000 7feaf9634640 1 Processor -- start 2023-06-09T04:37:50.722 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.717+0000 7feaf9634640 1 -- start start 2023-06-09T04:37:50.722 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf9634640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feaf40b1110 0x7feaf40cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.723 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf9634640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40cb690 con 0x7feaf40cb1f0 2023-06-09T04:37:50.723 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf9634640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40cb970 con 0x7feaf40cdf30 2023-06-09T04:37:50.723 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf9634640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf4159cd0 con 0x7feaf40b1110 2023-06-09T04:37:50.723 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feaf40cb1f0 0x7feaf40cd820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39206/0 (socket says 172.21.15.18:39206) 2023-06-09T04:37:50.723 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 -- 172.21.15.18:0/4207585639 learned_addr learned my addr 172.21.15.18:0/4207585639 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:37:50.725 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf2ffd640 1 --2- 172.21.15.18:0/4207585639 >> v2:172.21.15.81:3300/0 conn(0x7feaf40b1110 0x7feaf40cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.725 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999278406 0 0) 0x7feaf40cb690 con 0x7feaf40cb1f0 2023-06-09T04:37:50.725 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feadc003530 con 0x7feaf40cb1f0 2023-06-09T04:37:50.725 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3210426520 0 0) 0x7feadc003530 con 0x7feaf40cb1f0 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 >> v2:172.21.15.81:3300/0 conn(0x7feaf40b1110 msgr2=0x7feaf40cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 --2- 172.21.15.18:0/4207585639 >> v2:172.21.15.81:3300/0 conn(0x7feaf40b1110 0x7feaf40cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 >> v1:172.21.15.81:6789/0 conn(0x7feaf40cdf30 legacy=0x7feaf40af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40cbc50 con 0x7feaf40cb1f0 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7feae8001680 con 0x7feaf40cb1f0 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 >> v1:172.21.15.18:6789/0 conn(0x7feaf40cb1f0 legacy=0x7feaf40cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.726 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc003980 0x7feadc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feadc0047d0 0x7feadc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feadc005180 0x7feadc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf4159cd0 con 0x7feadc0047d0 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc00c000 con 0x7feadc003980 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc00c1c0 con 0x7feadc005180 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feadc0047d0 0x7feadc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.727 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf37fe640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feadc005180 0x7feadc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf2ffd640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc003980 0x7feadc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 -- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feadc005180 msgr2=0x7feadc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feadc005180 0x7feadc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 -- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc003980 msgr2=0x7feadc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc003980 0x7feadc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf27fc640 1 -- 172.21.15.18:0/4207585639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc003530 con 0x7feadc0047d0 2023-06-09T04:37:50.728 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf37fe640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feadc005180 0x7feadc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:50.729 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.721+0000 7feaf37fe640 1 -- 172.21.15.18:0/4207585639 reap_dead start 2023-06-09T04:37:50.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feadc0047d0 0x7feadc004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feae8007cb0 tx=0x7feae80237a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0ac2fe66e5ff1a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8005ae0 con 0x7feadc0047d0 2023-06-09T04:37:50.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80af070 con 0x7feadc0047d0 2023-06-09T04:37:50.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf1ffb640 1 -- 172.21.15.18:0/4207585639 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8007070 con 0x7feadc0047d0 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- 172.21.15.18:0/4207585639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feadc0047d0 msgr2=0x7feadc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feadc0047d0 0x7feadc004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feae8007cb0 tx=0x7feae80237a0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- 172.21.15.18:0/4207585639 shutdown_connections 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 --2- 172.21.15.18:0/4207585639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feadc0047d0 0x7feadc004c40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- 172.21.15.18:0/4207585639 >> 172.21.15.18:0/4207585639 conn(0x7feaf4069b70 msgr2=0x7feaf4098f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- 172.21.15.18:0/4207585639 shutdown_connections 2023-06-09T04:37:50.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- 172.21.15.18:0/4207585639 wait complete. 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 Processor -- start 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- start start 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc0047d0 0x7feaf4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 0x7feaf4159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feaf40cfa60 0x7feaf40cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40d0420 con 0x7feaf415c9f0 2023-06-09T04:37:50.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf4155d50 con 0x7feadc0047d0 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf9634640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf415a6f0 con 0x7feaf40cfa60 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 0x7feaf4159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 0x7feaf4159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53168/0 (socket says 172.21.15.18:53168) 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 -- 172.21.15.18:0/439605217 learned_addr learned my addr 172.21.15.18:0/439605217 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf37fe640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feaf40cfa60 0x7feaf40cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf2ffd640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc0047d0 0x7feaf4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 -- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feaf40cfa60 msgr2=0x7feaf40cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feaf40cfa60 0x7feaf40cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 -- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc0047d0 msgr2=0x7feaf4155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc0047d0 0x7feaf4155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf27fc640 1 -- 172.21.15.18:0/439605217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf415a9d0 con 0x7feaf415c9f0 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf37fe640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feaf40cfa60 0x7feaf40cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.725+0000 7feaf2ffd640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc0047d0 0x7feaf4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:50.735 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feaf27fc640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 0x7feaf4159e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feae809fdf0 tx=0x7feadc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8001440 con 0x7feaf415c9f0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80015a0 con 0x7feaf415c9f0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf415acb0 con 0x7feaf415c9f0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8007270 con 0x7feaf415c9f0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf40c8040 con 0x7feaf415c9f0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feae80bd030 con 0x7feaf415c9f0 2023-06-09T04:37:50.736 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feae80bb070 con 0x7feaf415c9f0 2023-06-09T04:37:50.737 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.729+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf40c9ff0 con 0x7feaf415c9f0 2023-06-09T04:37:50.737 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.733+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7feae80c5060 con 0x7feaf415c9f0 2023-06-09T04:37:50.790 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaf4073380 con 0x7feaf415c9f0 2023-06-09T04:37:50.791 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feadb7fe640 1 -- 172.21.15.18:0/439605217 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7feae8007cf0 con 0x7feaf415c9f0 2023-06-09T04:37:50.791 INFO:teuthology.misc.health.smithi018.stdout: 2023-06-09T04:37:50.791 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:37:49.491271+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:50.792 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 msgr2=0x7feaf4159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 0x7feaf4159e10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feae809fdf0 tx=0x7feadc005800 comp rx=0 tx=0).stop 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 shutdown_connections 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feaf40cfa60 0x7feaf40cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaf415c9f0 0x7feaf4159e10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 --2- 172.21.15.18:0/439605217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feadc0047d0 0x7feaf4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 >> 172.21.15.18:0/439605217 conn(0x7feaf4069b70 msgr2=0x7feaf41560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.793 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 shutdown_connections 2023-06-09T04:37:50.794 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:50.789+0000 7feaf9634640 1 -- 172.21.15.18:0/439605217 wait complete. 2023-06-09T04:37:50.806 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:37:51.039 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:51.038+0000 7fe6d81cc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:37:51.083 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:51.081+0000 7f7309b38180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:37:51.113 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:51.110+0000 7fe6d81cc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:37:51.161 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:51.157+0000 7f7309b38180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:37:51.283 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:51.282+0000 7fe6d81cc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:37:51.337 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:51.333+0000 7f7309b38180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:37:51.355 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:51.354+0000 7fe6d81cc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:37:51.413 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:51.409+0000 7f7309b38180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:37:51.597 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:51.594+0000 7fe6d81cc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:37:51.656 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:51.654+0000 7fe6d81cc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:37:51.666 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:51.665+0000 7f7309b38180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:37:51.729 INFO:tasks.ceph.mgr.y.smithi018.stderr:2023-06-09T04:37:51.725+0000 7f7309b38180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:37:52.700 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:52.698+0000 7fe67fc8a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-09T04:37:52.701 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-06-09T04:37:52.698+0000 7fe67fc8a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-09T04:37:53.383 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T04:37:53.382+0000 7fa29942d640 -1 osd.5 0 log_to_monitors true 2023-06-09T04:37:53.639 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T04:37:53.638+0000 7f0e9b766640 -1 osd.7 0 log_to_monitors true 2023-06-09T04:37:53.830 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T04:37:53.830+0000 7f176e287640 -1 osd.4 0 log_to_monitors true 2023-06-09T04:37:53.948 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T04:37:53.946+0000 7f80d4e6a640 -1 osd.6 0 log_to_monitors true 2023-06-09T04:37:53.956 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T04:37:53.953+0000 7fc30e74b640 -1 osd.1 0 log_to_monitors true 2023-06-09T04:37:54.088 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T04:37:54.085+0000 7f67f7d76640 -1 osd.2 0 log_to_monitors true 2023-06-09T04:37:54.092 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T04:37:54.089+0000 7fafd73b7640 -1 osd.0 0 log_to_monitors true 2023-06-09T04:37:54.112 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T04:37:54.109+0000 7f79c9539640 -1 osd.3 0 log_to_monitors true 2023-06-09T04:37:56.283 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T04:37:56.282+0000 7fa2953d2640 -1 osd.5 0 waiting for initial osdmap 2023-06-09T04:37:56.318 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T04:37:56.318+0000 7fa28d205640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:56.502 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T04:37:56.498+0000 7f0e9770b640 -1 osd.7 0 waiting for initial osdmap 2023-06-09T04:37:56.539 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T04:37:56.538+0000 7f0e8f53e640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.144 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T04:37:57.142+0000 7f80d1626640 -1 osd.6 0 waiting for initial osdmap 2023-06-09T04:37:57.147 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T04:37:57.146+0000 7f176a22c640 -1 osd.4 0 waiting for initial osdmap 2023-06-09T04:37:57.179 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T04:37:57.178+0000 7f80c8c42640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.186 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T04:37:57.186+0000 7f176205f640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.226 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T04:37:57.225+0000 7f67f3d1b640 -1 osd.2 0 waiting for initial osdmap 2023-06-09T04:37:57.270 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T04:37:57.269+0000 7f67ebb4e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.432 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T04:37:57.429+0000 7fafd335c640 -1 osd.0 0 waiting for initial osdmap 2023-06-09T04:37:57.455 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T04:37:57.453+0000 7f79c54de640 -1 osd.3 0 waiting for initial osdmap 2023-06-09T04:37:57.462 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T04:37:57.461+0000 7fafcb18f640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.486 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T04:37:57.485+0000 7f79bd311640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.495 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T04:37:57.493+0000 7fc30a6f0640 -1 osd.1 0 waiting for initial osdmap 2023-06-09T04:37:57.534 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T04:37:57.533+0000 7fc302523640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:37:57.612 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:57.729 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 Processor -- start 2023-06-09T04:37:57.730 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 -- start start 2023-06-09T04:37:57.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbdd4143110 0x7fbdd40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbdd40c9190 0x7fbdd40cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.731 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40c98c0 con 0x7fbdd4069250 2023-06-09T04:37:57.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40c9ba0 con 0x7fbdd4143110 2023-06-09T04:37:57.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd96ab640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40cb2a0 con 0x7fbdd40c9190 2023-06-09T04:37:57.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbdd4143110 0x7fbdd40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbdd4143110 0x7fbdd40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38574/0 (socket says 172.21.15.18:38574) 2023-06-09T04:37:57.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 -- 172.21.15.18:0/1538058366 learned_addr learned my addr 172.21.15.18:0/1538058366 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:37:57.732 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd27fc640 1 --2- 172.21.15.18:0/1538058366 >> v2:172.21.15.81:3300/0 conn(0x7fbdd40c9190 0x7fbdd40cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 -- 172.21.15.18:0/1538058366 >> v2:172.21.15.81:3300/0 conn(0x7fbdd40c9190 msgr2=0x7fbdd40cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:57.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 --2- 172.21.15.18:0/1538058366 >> v2:172.21.15.81:3300/0 conn(0x7fbdd40c9190 0x7fbdd40cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 -- 172.21.15.18:0/1538058366 >> v1:172.21.15.81:6789/0 conn(0x7fbdd4069250 legacy=0x7fbdd40c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.733 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 -- 172.21.15.18:0/1538058366 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40cb580 con 0x7fbdd4143110 2023-06-09T04:37:57.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd27fc640 1 --2- 172.21.15.18:0/1538058366 >> v2:172.21.15.81:3300/0 conn(0x7fbdd40c9190 0x7fbdd40cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:57.734 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.729+0000 7fbdd2ffd640 1 --2- 172.21.15.18:0/1538058366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd4143110 0x7fbdd40b10f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40cc660 tx=0x7fbdc401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437435c6f71dac50 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.762 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd1ffb640 1 -- 172.21.15.18:0/1538058366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40ab600 con 0x7fbdd4143110 2023-06-09T04:37:57.763 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd1ffb640 1 -- 172.21.15.18:0/1538058366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40a7050 con 0x7fbdd4143110 2023-06-09T04:37:57.763 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd1ffb640 1 -- 172.21.15.18:0/1538058366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40ab980 con 0x7fbdd4143110 2023-06-09T04:37:57.764 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 -- 172.21.15.18:0/1538058366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd4143110 msgr2=0x7fbdd40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.764 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/1538058366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd4143110 0x7fbdd40b10f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40cc660 tx=0x7fbdc401c470 comp rx=0 tx=0).stop 2023-06-09T04:37:57.764 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 -- 172.21.15.18:0/1538058366 shutdown_connections 2023-06-09T04:37:57.764 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/1538058366 >> v2:172.21.15.81:3300/0 conn(0x7fbdd40c9190 0x7fbdd40cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.764 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/1538058366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd4143110 0x7fbdd40b10f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.765 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 -- 172.21.15.18:0/1538058366 >> 172.21.15.18:0/1538058366 conn(0x7fbdd406cc50 msgr2=0x7fbdd406d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.765 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 -- 172.21.15.18:0/1538058366 shutdown_connections 2023-06-09T04:37:57.765 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 -- 172.21.15.18:0/1538058366 wait complete. 2023-06-09T04:37:57.765 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 Processor -- start 2023-06-09T04:37:57.765 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.761+0000 7fbdd96ab640 1 -- start start 2023-06-09T04:37:57.766 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdd4069250 0x7fbdd40c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 0x7fbdd4158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbdd4143110 0x7fbdd40c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41427c0 con 0x7fbdd40c9190 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40c20e0 con 0x7fbdd4069250 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40bf2d0 con 0x7fbdd4143110 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 0x7fbdd4158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.767 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 0x7fbdd4158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38582/0 (socket says 172.21.15.18:38582) 2023-06-09T04:37:57.768 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 -- 172.21.15.18:0/966067867 learned_addr learned my addr 172.21.15.18:0/966067867 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:37:57.768 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd37fe640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbdd4143110 0x7fbdd40c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.768 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd2ffd640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdd4069250 0x7fbdd40c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.769 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 -- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbdd4143110 msgr2=0x7fbdd40c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.769 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbdd4143110 0x7fbdd40c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 -- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdd4069250 msgr2=0x7fbdd40c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdd4069250 0x7fbdd40c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 -- 172.21.15.18:0/966067867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40094d0 con 0x7fbdd40c9190 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd37fe640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbdd4143110 0x7fbdd40c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd27fc640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 0x7fbdd4158050 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800e810 tx=0x7fbdc800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800c870 con 0x7fbdd40c9190 2023-06-09T04:37:57.770 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800c9d0 con 0x7fbdd40c9190 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd40cc440 con 0x7fbdd40c9190 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800cd60 con 0x7fbdd40c9190 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd4158ea0 con 0x7fbdd40c9190 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd40bf440 con 0x7fbdd40c9190 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fbdc8013410 con 0x7fbdd40c9190 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdbb7fe640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbdc0066220 0x7fbdc00686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.771 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.765+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3631+0+0 (secure 0 0 0) 0x7fbdc8083010 con 0x7fbdd40c9190 2023-06-09T04:37:57.772 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.769+0000 7fbdd2ffd640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbdc0066220 0x7fbdc00686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.772 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.769+0000 7fbdd2ffd640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbdc0066220 0x7fbdc00686d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40ad000 tx=0x7fbdc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.774 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.773+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbdc8050ef0 con 0x7fbdd40c9190 2023-06-09T04:37:57.925 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.921+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd4073380 con 0x7fbdd40c9190 2023-06-09T04:37:57.926 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdbb7fe640 1 -- 172.21.15.18:0/966067867 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9438 (secure 0 0 0) 0x7fbdc8009480 con 0x7fbdd40c9190 2023-06-09T04:37:57.927 INFO:teuthology.misc.health.smithi018.stdout: 2023-06-09T04:37:57.927 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":14,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:37:57.309466+0000","last_up_change":"2023-06-09T04:37:57.309466+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:57.928 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbdc0066220 msgr2=0x7fbdc00686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.929 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbdc0066220 0x7fbdc00686d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40ad000 tx=0x7fbdc4009040 comp rx=0 tx=0).stop 2023-06-09T04:37:57.929 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 msgr2=0x7fbdd4158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.929 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 0x7fbdd4158050 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800e810 tx=0x7fbdc800ecd0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.929 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 shutdown_connections 2023-06-09T04:37:57.929 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbdc0066220 0x7fbdc00686d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.929 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbdd4143110 0x7fbdd40c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.930 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdd40c9190 0x7fbdd4158050 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.930 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 --2- 172.21.15.18:0/966067867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbdd4069250 0x7fbdd40c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.930 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 >> 172.21.15.18:0/966067867 conn(0x7fbdd406cc50 msgr2=0x7fbdd40ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.930 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 shutdown_connections 2023-06-09T04:37:57.930 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:37:57.925+0000 7fbdd96ab640 1 -- 172.21.15.18:0/966067867 wait complete. 2023-06-09T04:37:57.942 DEBUG:teuthology.misc:5 of 8 OSDs are up 2023-06-09T04:38:04.747 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:04.874 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 Processor -- start 2023-06-09T04:38:04.875 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 -- start start 2023-06-09T04:38:04.876 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffbe00cc710 0x7ffbe00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.876 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffbe006e6a0 0x7ffbe006eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.876 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe00cd020 con 0x7ffbe0069250 2023-06-09T04:38:04.876 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe015bb80 con 0x7ffbe006e6a0 2023-06-09T04:38:04.877 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe86d9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe00b1390 con 0x7ffbe00cc710 2023-06-09T04:38:04.877 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe5c74640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffbe0069250 0x7ffbe00696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39600/0 (socket says 172.21.15.18:39600) 2023-06-09T04:38:04.877 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe5c74640 1 -- 172.21.15.18:0/3788152170 learned_addr learned my addr 172.21.15.18:0/3788152170 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:04.877 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe6c76640 1 --2- 172.21.15.18:0/3788152170 >> v2:172.21.15.18:3300/0 conn(0x7ffbe006e6a0 0x7ffbe006eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.877 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe6475640 1 --2- 172.21.15.18:0/3788152170 >> v2:172.21.15.81:3300/0 conn(0x7ffbe00cc710 0x7ffbe00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.878 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe5473640 1 -- 172.21.15.18:0/3788152170 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514136362 0 0) 0x7ffbe00cd020 con 0x7ffbe0069250 2023-06-09T04:38:04.878 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe5473640 1 -- 172.21.15.18:0/3788152170 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbcc003530 con 0x7ffbe0069250 2023-06-09T04:38:04.878 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe5473640 1 -- 172.21.15.18:0/3788152170 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 841660636 0 0) 0x7ffbcc003530 con 0x7ffbe0069250 2023-06-09T04:38:04.878 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe6c76640 1 -- 172.21.15.18:0/3788152170 >> v2:172.21.15.81:3300/0 conn(0x7ffbe00cc710 msgr2=0x7ffbe00ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:04.878 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe6c76640 1 --2- 172.21.15.18:0/3788152170 >> v2:172.21.15.81:3300/0 conn(0x7ffbe00cc710 0x7ffbe00ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.879 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe6c76640 1 -- 172.21.15.18:0/3788152170 >> v1:172.21.15.18:6789/0 conn(0x7ffbe0069250 legacy=0x7ffbe00696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.879 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.872+0000 7ffbe6c76640 1 -- 172.21.15.18:0/3788152170 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe015f1d0 con 0x7ffbe006e6a0 2023-06-09T04:38:04.879 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe6c76640 1 --2- 172.21.15.18:0/3788152170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe006e6a0 0x7ffbe006eae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0070940 tx=0x7ffbd801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902823adb5de7810 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.879 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe5473640 1 -- 172.21.15.18:0/3788152170 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0001680 con 0x7ffbe006e6a0 2023-06-09T04:38:04.880 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe5473640 1 -- 172.21.15.18:0/3788152170 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd80a5640 con 0x7ffbe006e6a0 2023-06-09T04:38:04.880 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe5473640 1 -- 172.21.15.18:0/3788152170 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80a59d0 con 0x7ffbe006e6a0 2023-06-09T04:38:04.880 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 -- 172.21.15.18:0/3788152170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe006e6a0 msgr2=0x7ffbe006eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/3788152170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe006e6a0 0x7ffbe006eae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0070940 tx=0x7ffbd801c800 comp rx=0 tx=0).stop 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 -- 172.21.15.18:0/3788152170 shutdown_connections 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/3788152170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe006e6a0 0x7ffbe006eae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/3788152170 >> v2:172.21.15.81:3300/0 conn(0x7ffbe00cc710 0x7ffbe00ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 -- 172.21.15.18:0/3788152170 >> 172.21.15.18:0/3788152170 conn(0x7ffbe006cc50 msgr2=0x7ffbe006d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 -- 172.21.15.18:0/3788152170 shutdown_connections 2023-06-09T04:38:04.881 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 -- 172.21.15.18:0/3788152170 wait complete. 2023-06-09T04:38:04.883 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 Processor -- start 2023-06-09T04:38:04.883 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 -- start start 2023-06-09T04:38:04.883 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 0x7ffbe0154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.883 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbe006e6a0 0x7ffbe00aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.876+0000 7ffbe86d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe00cc710 0x7ffbe01551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe86d9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00c7230 con 0x7ffbe0069250 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe86d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00ab2a0 con 0x7ffbe00cc710 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe86d9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00ab580 con 0x7ffbe006e6a0 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 0x7ffbe0154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 0x7ffbe0154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38624/0 (socket says 172.21.15.18:38624) 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 -- 172.21.15.18:0/1915172539 learned_addr learned my addr 172.21.15.18:0/1915172539 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:04.884 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6c76640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe00cc710 0x7ffbe01551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 -- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbe006e6a0 msgr2=0x7ffbe00aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe5c74640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbe006e6a0 0x7ffbe00aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbe006e6a0 0x7ffbe00aa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 -- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe00cc710 msgr2=0x7ffbe01551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe00cc710 0x7ffbe01551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 -- 172.21.15.18:0/1915172539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd8009a70 con 0x7ffbe0069250 2023-06-09T04:38:04.885 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6c76640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe00cc710 0x7ffbe01551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:04.886 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe6475640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 0x7ffbe0154be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00e870 tx=0x7ffbdc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.886 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc009510 con 0x7ffbe0069250 2023-06-09T04:38:04.886 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00eec0 con 0x7ffbe0069250 2023-06-09T04:38:04.886 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe00c6ec0 con 0x7ffbe0069250 2023-06-09T04:38:04.886 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00cb40 con 0x7ffbe0069250 2023-06-09T04:38:04.886 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe00aafd0 con 0x7ffbe0069250 2023-06-09T04:38:04.887 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe00ab740 con 0x7ffbe0069250 2023-06-09T04:38:04.887 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbdc00cca0 con 0x7ffbe0069250 2023-06-09T04:38:04.887 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbd6ffd640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffbc4066280 0x7ffbc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.887 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffbdc083990 con 0x7ffbe0069250 2023-06-09T04:38:04.888 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe5c74640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffbc4066280 0x7ffbc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.888 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.880+0000 7ffbe5c74640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffbc4066280 0x7ffbc4068730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0001ec0 tx=0x7ffbd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.889 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:04.884+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbdc0512c0 con 0x7ffbe0069250 2023-06-09T04:38:05.044 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.040+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbe0073380 con 0x7ffbe0069250 2023-06-09T04:38:05.045 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.040+0000 7ffbd6ffd640 1 -- 172.21.15.18:0/1915172539 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12802 (secure 0 0 0) 0x7ffbdc017090 con 0x7ffbe0069250 2023-06-09T04:38:05.046 INFO:teuthology.misc.health.smithi018.stdout: 2023-06-09T04:38:05.046 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":17,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:00.468065+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:05.048 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffbc4066280 msgr2=0x7ffbc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.048 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffbc4066280 0x7ffbc4068730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0001ec0 tx=0x7ffbd0009040 comp rx=0 tx=0).stop 2023-06-09T04:38:05.048 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 msgr2=0x7ffbe0154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.048 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 0x7ffbe0154be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00e870 tx=0x7ffbdc00ec70 comp rx=0 tx=0).stop 2023-06-09T04:38:05.048 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 shutdown_connections 2023-06-09T04:38:05.048 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbe00cc710 0x7ffbe01551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.049 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffbc4066280 0x7ffbc4068730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.049 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffbe006e6a0 0x7ffbe00aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.049 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 --2- 172.21.15.18:0/1915172539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbe0069250 0x7ffbe0154be0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.049 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 >> 172.21.15.18:0/1915172539 conn(0x7ffbe006cc50 msgr2=0x7ffbe0157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.049 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 shutdown_connections 2023-06-09T04:38:05.049 INFO:teuthology.misc.health.smithi018.stderr:2023-06-09T04:38:05.044+0000 7ffbe86d9640 1 -- 172.21.15.18:0/1915172539 wait complete. 2023-06-09T04:38:05.062 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-09T04:38:05.063 INFO:tasks.ceph:Creating RBD pool 2023-06-09T04:38:05.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-09T04:38:05.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 Processor -- start 2023-06-09T04:38:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 -- start start 2023-06-09T04:38:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea4415b730 0x7fea440c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 0x7fea440cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea440cbef0 con 0x7fea440cba70 2023-06-09T04:38:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4415f2f0 con 0x7fea4415b730 2023-06-09T04:38:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea4a399640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4415f5d0 con 0x7fea440cc8b0 2023-06-09T04:38:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 0x7fea440cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 0x7fea440cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:60806/0 (socket says 172.21.15.18:60806) 2023-06-09T04:38:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea43fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea4415b730 0x7fea440c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 -- 172.21.15.18:0/1929790739 learned_addr learned my addr 172.21.15.18:0/1929790739 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 -- 172.21.15.18:0/1929790739 >> v2:172.21.15.81:3300/0 conn(0x7fea4415b730 msgr2=0x7fea440c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 --2- 172.21.15.18:0/1929790739 >> v2:172.21.15.81:3300/0 conn(0x7fea4415b730 0x7fea440c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 -- 172.21.15.18:0/1929790739 >> v1:172.21.15.81:6789/0 conn(0x7fea440cba70 legacy=0x7fea440b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.172+0000 7fea437fe640 1 -- 172.21.15.18:0/1929790739 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4415f8b0 con 0x7fea440cc8b0 2023-06-09T04:38:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea437fe640 1 --2- 172.21.15.18:0/1929790739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 0x7fea440cb530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fea38006fd0 tx=0x7fea3801c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b710a8ec73bd46 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea42ffd640 1 -- 172.21.15.18:0/1929790739 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea380aa650 con 0x7fea440cc8b0 2023-06-09T04:38:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea42ffd640 1 -- 172.21.15.18:0/1929790739 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380aa7b0 con 0x7fea440cc8b0 2023-06-09T04:38:05.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea42ffd640 1 -- 172.21.15.18:0/1929790739 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea380aab40 con 0x7fea440cc8b0 2023-06-09T04:38:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 -- 172.21.15.18:0/1929790739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 msgr2=0x7fea440cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 --2- 172.21.15.18:0/1929790739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 0x7fea440cb530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fea38006fd0 tx=0x7fea3801c4f0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 -- 172.21.15.18:0/1929790739 shutdown_connections 2023-06-09T04:38:05.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 --2- 172.21.15.18:0/1929790739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cc8b0 0x7fea440cb530 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 --2- 172.21.15.18:0/1929790739 >> v2:172.21.15.81:3300/0 conn(0x7fea4415b730 0x7fea440c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 -- 172.21.15.18:0/1929790739 >> 172.21.15.18:0/1929790739 conn(0x7fea4406cdd0 msgr2=0x7fea4406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 -- 172.21.15.18:0/1929790739 shutdown_connections 2023-06-09T04:38:05.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 -- 172.21.15.18:0/1929790739 wait complete. 2023-06-09T04:38:05.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 Processor -- start 2023-06-09T04:38:05.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.176+0000 7fea4a399640 1 -- start start 2023-06-09T04:38:05.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cba70 0x7fea44154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 0x7fea4414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4415b730 0x7fea440ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea441553a0 con 0x7fea440cc8b0 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440afb50 con 0x7fea4415b730 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44155d10 con 0x7fea440cba70 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 0x7fea4414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 0x7fea4414b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38638/0 (socket says 172.21.15.18:38638) 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 -- 172.21.15.18:0/2862723830 learned_addr learned my addr 172.21.15.18:0/2862723830 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea43fff640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cba70 0x7fea44154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea48936640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4415b730 0x7fea440ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 -- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cba70 msgr2=0x7fea44154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cba70 0x7fea44154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 -- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4415b730 msgr2=0x7fea440ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4415b730 0x7fea440ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 -- 172.21.15.18:0/2862723830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38009480 con 0x7fea440cc8b0 2023-06-09T04:38:05.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea437fe640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 0x7fea4414b270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea3801a120 tx=0x7fea38019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea380aab20 con 0x7fea440cc8b0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380aac80 con 0x7fea440cc8b0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea440afdf0 con 0x7fea440cc8b0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38003620 con 0x7fea440cc8b0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea440b03b0 con 0x7fea440cc8b0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea440b05a0 con 0x7fea440cc8b0 2023-06-09T04:38:05.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea38003990 con 0x7fea440cc8b0 2023-06-09T04:38:05.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea40ff9640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fea300662b0 0x7fea30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea3811e620 con 0x7fea440cc8b0 2023-06-09T04:38:05.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.180+0000 7fea43fff640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fea300662b0 0x7fea30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.184+0000 7fea43fff640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fea300662b0 0x7fea30068760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea34009a50 tx=0x7fea34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.184+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea380ec170 con 0x7fea440cc8b0 2023-06-09T04:38:05.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.336+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fea44073380 con 0x7fea440cc8b0 2023-06-09T04:38:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.988+0000 7fea40ff9640 1 -- 172.21.15.18:0/2862723830 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fea380c30a0 con 0x7fea440cc8b0 2023-06-09T04:38:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'rbd' created 2023-06-09T04:38:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fea300662b0 msgr2=0x7fea30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fea300662b0 0x7fea30068760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea34009a50 tx=0x7fea34008040 comp rx=0 tx=0).stop 2023-06-09T04:38:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 msgr2=0x7fea4414b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 0x7fea4414b270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea3801a120 tx=0x7fea38019290 comp rx=0 tx=0).stop 2023-06-09T04:38:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 shutdown_connections 2023-06-09T04:38:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4415b730 0x7fea440ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea440cc8b0 0x7fea4414b270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fea300662b0 0x7fea30068760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 --2- 172.21.15.18:0/2862723830 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fea440cba70 0x7fea44154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 >> 172.21.15.18:0/2862723830 conn(0x7fea4406cdd0 msgr2=0x7fea4415d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 shutdown_connections 2023-06-09T04:38:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:05.996+0000 7fea4a399640 1 -- 172.21.15.18:0/2862723830 wait complete. 2023-06-09T04:38:06.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-09T04:38:06.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 Processor -- start 2023-06-09T04:38:06.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 -- start start 2023-06-09T04:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27580cbd60 0x7f275806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f275806fac0 0x7f275806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275806d800 con 0x7f2758142fe0 2023-06-09T04:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580cc1c0 con 0x7f27580cbd60 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.140+0000 7f275f8d6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2758159cc0 con 0x7f275806fac0 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275ce71640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27580cbd60 0x7f275806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275d672640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2758142fe0 0x7f275806b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39612/0 (socket says 172.21.15.18:39612) 2023-06-09T04:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275d672640 1 -- 172.21.15.18:0/152692679 learned_addr learned my addr 172.21.15.18:0/152692679 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275de73640 1 --2- 172.21.15.18:0/152692679 >> v2:172.21.15.81:3300/0 conn(0x7f275806fac0 0x7f275806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275ce71640 1 -- 172.21.15.18:0/152692679 >> v2:172.21.15.81:3300/0 conn(0x7f275806fac0 msgr2=0x7f275806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275ce71640 1 --2- 172.21.15.18:0/152692679 >> v2:172.21.15.81:3300/0 conn(0x7f275806fac0 0x7f275806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275ce71640 1 -- 172.21.15.18:0/152692679 >> v1:172.21.15.18:6789/0 conn(0x7f2758142fe0 legacy=0x7f275806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275ce71640 1 -- 172.21.15.18:0/152692679 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580703f0 con 0x7f27580cbd60 2023-06-09T04:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f274ffff640 1 -- 172.21.15.18:0/152692679 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457017925 0 0) 0x7f2754001120 con 0x7f2758142fe0 2023-06-09T04:38:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275ce71640 1 --2- 172.21.15.18:0/152692679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580cbd60 0x7f275806d2c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27580c14e0 tx=0x7f274801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9504a3c97329d925 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f274ffff640 1 -- 172.21.15.18:0/152692679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480a8950 con 0x7f27580cbd60 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f274ffff640 1 -- 172.21.15.18:0/152692679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480a8ab0 con 0x7f27580cbd60 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f274ffff640 1 -- 172.21.15.18:0/152692679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480a8e40 con 0x7f27580cbd60 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 -- 172.21.15.18:0/152692679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580cbd60 msgr2=0x7f275806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 --2- 172.21.15.18:0/152692679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580cbd60 0x7f275806d2c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27580c14e0 tx=0x7f274801ec50 comp rx=0 tx=0).stop 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 -- 172.21.15.18:0/152692679 shutdown_connections 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 --2- 172.21.15.18:0/152692679 >> v2:172.21.15.81:3300/0 conn(0x7f275806fac0 0x7f275806feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 --2- 172.21.15.18:0/152692679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580cbd60 0x7f275806d2c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 -- 172.21.15.18:0/152692679 >> 172.21.15.18:0/152692679 conn(0x7f27580cda10 msgr2=0x7f27580cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 -- 172.21.15.18:0/152692679 shutdown_connections 2023-06-09T04:38:06.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.144+0000 7f275f8d6640 1 -- 172.21.15.18:0/152692679 wait complete. 2023-06-09T04:38:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 Processor -- start 2023-06-09T04:38:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- start start 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 0x7f27580a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27580cbd60 0x7f27580a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2758142fe0 0x7f27580c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580a8490 con 0x7f275806fac0 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580a7400 con 0x7f27580cbd60 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580a7630 con 0x7f2758142fe0 2023-06-09T04:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 0x7f27580a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 0x7f27580a7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38646/0 (socket says 172.21.15.18:38646) 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 -- 172.21.15.18:0/337181695 learned_addr learned my addr 172.21.15.18:0/337181695 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275de73640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2758142fe0 0x7f27580c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275ce71640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27580cbd60 0x7f27580a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 -- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2758142fe0 msgr2=0x7f27580c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2758142fe0 0x7f27580c2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 -- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27580cbd60 msgr2=0x7f27580a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27580cbd60 0x7f27580a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 -- 172.21.15.18:0/337181695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009420 con 0x7f275806fac0 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275ce71640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27580cbd60 0x7f27580a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275d672640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 0x7f27580a7f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f275400c480 tx=0x7f275400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540074e0 con 0x7f275806fac0 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754007660 con 0x7f275806fac0 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27581f0410 con 0x7f275806fac0 2023-06-09T04:38:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754004a30 con 0x7f275806fac0 2023-06-09T04:38:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27581f09d0 con 0x7f275806fac0 2023-06-09T04:38:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275806a4c0 con 0x7f275806fac0 2023-06-09T04:38:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.148+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2754004b90 con 0x7f275806fac0 2023-06-09T04:38:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.152+0000 7f274dffb640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f273c066280 0x7f273c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.152+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2754082d70 con 0x7f275806fac0 2023-06-09T04:38:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.152+0000 7f275ce71640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f273c066280 0x7f273c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.152+0000 7f275ce71640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f273c066280 0x7f273c068730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27480b2000 tx=0x7f27480aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.156+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2754053fd0 con 0x7f275806fac0 2023-06-09T04:38:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.304+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f275806d800 con 0x7f275806fac0 2023-06-09T04:38:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.992+0000 7f274dffb640 1 -- 172.21.15.18:0/337181695 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f275806d800 con 0x7f275806fac0 2023-06-09T04:38:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f273c066280 msgr2=0x7f273c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f273c066280 0x7f273c068730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27480b2000 tx=0x7f27480aa070 comp rx=0 tx=0).stop 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 msgr2=0x7f27580a7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 0x7f27580a7f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f275400c480 tx=0x7f275400c940 comp rx=0 tx=0).stop 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 shutdown_connections 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f273c066280 0x7f273c068730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2758142fe0 0x7f27580c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27580cbd60 0x7f27580a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 --2- 172.21.15.18:0/337181695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275806fac0 0x7f27580a7f50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 >> 172.21.15.18:0/337181695 conn(0x7f27580cda10 msgr2=0x7f275815a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 shutdown_connections 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:06.996+0000 7f275f8d6640 1 -- 172.21.15.18:0/337181695 wait complete. 2023-06-09T04:38:07.021 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-09T04:38:07.022 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:38:07.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:38:07.024 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:38:07.024 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:38:07.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:38:07.026 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:38:07.027 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:38:07.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:38:07.029 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:38:07.029 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:38:07.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:38:07.032 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:38:07.032 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-09T04:38:07.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:07.095 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2023-06-09T04:38:07.097 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2023-06-09T04:38:07.110 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-06-09T04:38:07.110 INFO:tasks.ceph.mds.d.smithi081.stdout:starting mds.d at 2023-06-09T04:38:07.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 Processor -- start 2023-06-09T04:38:07.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 -- start start 2023-06-09T04:38:07.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d00b7480 0x7f01d00b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01d00cc9b0 0x7f01d00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01d006a3e0 0x7f01d00692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d015c950 con 0x7f01d006a3e0 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d00ce320 con 0x7f01d00cc9b0 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01d56e7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d00cc4b0 con 0x7f01d00b7480 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01d006a3e0 0x7f01d00692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01d006a3e0 0x7f01d00692b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37200/0 (socket says 172.21.15.18:37200) 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 -- 172.21.15.18:0/2869959539 learned_addr learned my addr 172.21.15.18:0/2869959539 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:07.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01ceffd640 1 --2- 172.21.15.18:0/2869959539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d00b7480 0x7f01d00b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01ce7fc640 1 --2- 172.21.15.18:0/2869959539 >> v2:172.21.15.81:3300/0 conn(0x7f01d00cc9b0 0x7f01d00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 -- 172.21.15.18:0/2869959539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d00b7480 msgr2=0x7f01d00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 --2- 172.21.15.18:0/2869959539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d00b7480 0x7f01d00b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 -- 172.21.15.18:0/2869959539 >> v2:172.21.15.81:3300/0 conn(0x7f01d00cc9b0 msgr2=0x7f01d00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 --2- 172.21.15.18:0/2869959539 >> v2:172.21.15.81:3300/0 conn(0x7f01d00cc9b0 0x7f01d00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.156+0000 7f01cf7fe640 1 -- 172.21.15.18:0/2869959539 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d00ce010 con 0x7f01d006a3e0 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cf7fe640 1 --2- 172.21.15.18:0/2869959539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d006a3e0 0x7f01d00692b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01d008acc0 tx=0x7f01c801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6290fca9af3572d8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cdffb640 1 -- 172.21.15.18:0/2869959539 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80a5870 con 0x7f01d006a3e0 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cdffb640 1 -- 172.21.15.18:0/2869959539 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c80a59d0 con 0x7f01d006a3e0 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cdffb640 1 -- 172.21.15.18:0/2869959539 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80a5d60 con 0x7f01d006a3e0 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- 172.21.15.18:0/2869959539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d006a3e0 msgr2=0x7f01d00692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- 172.21.15.18:0/2869959539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d006a3e0 0x7f01d00692b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01d008acc0 tx=0x7f01c801c9d0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- 172.21.15.18:0/2869959539 shutdown_connections 2023-06-09T04:38:07.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- 172.21.15.18:0/2869959539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d006a3e0 0x7f01d00692b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- 172.21.15.18:0/2869959539 >> v2:172.21.15.81:3300/0 conn(0x7f01d00cc9b0 0x7f01d00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- 172.21.15.18:0/2869959539 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d00b7480 0x7f01d00b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- 172.21.15.18:0/2869959539 >> 172.21.15.18:0/2869959539 conn(0x7f01d00d2ae0 msgr2=0x7f01d00ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- 172.21.15.18:0/2869959539 shutdown_connections 2023-06-09T04:38:07.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- 172.21.15.18:0/2869959539 wait complete. 2023-06-09T04:38:07.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 Processor -- start 2023-06-09T04:38:07.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- start start 2023-06-09T04:38:07.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d006a3e0 0x7f01d0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01d00b7480 0x7f01d00c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 0x7f01d0161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d00ca160 con 0x7f01d00cb9e0 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d00ca440 con 0x7f01d00b7480 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01d56e7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d00ca720 con 0x7f01d006a3e0 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 0x7f01d0161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 0x7f01d0161820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37208/0 (socket says 172.21.15.18:37208) 2023-06-09T04:38:07.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01cf7fe640 1 -- 172.21.15.18:0/1329661956 learned_addr learned my addr 172.21.15.18:0/1329661956 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01ceffd640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d006a3e0 0x7f01d0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.160+0000 7f01ce7fc640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01d00b7480 0x7f01d00c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01cf7fe640 1 -- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d006a3e0 msgr2=0x7f01d0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01cf7fe640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d006a3e0 0x7f01d0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01cf7fe640 1 -- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01d00b7480 msgr2=0x7f01d00c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01cf7fe640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01d00b7480 0x7f01d00c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01cf7fe640 1 -- 172.21.15.18:0/1329661956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8009b30 con 0x7f01d00cb9e0 2023-06-09T04:38:07.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01cf7fe640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 0x7f01d0161820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01c80af040 tx=0x7f01c8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80b8670 con 0x7f01d00cb9e0 2023-06-09T04:38:07.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c80b87d0 con 0x7f01d00cb9e0 2023-06-09T04:38:07.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d00caa00 con 0x7f01d00cb9e0 2023-06-09T04:38:07.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80b8b80 con 0x7f01d00cb9e0 2023-06-09T04:38:07.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0159b40 con 0x7f01d00cb9e0 2023-06-09T04:38:07.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d0163b50 con 0x7f01d00cb9e0 2023-06-09T04:38:07.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01c80b8ce0 con 0x7f01d00cb9e0 2023-06-09T04:38:07.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01b77fe640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01bc066280 0x7f01bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f01c811ef00 con 0x7f01d00cb9e0 2023-06-09T04:38:07.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01ceffd640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01bc066280 0x7f01bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.164+0000 7f01ceffd640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01bc066280 0x7f01bc068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ae0 tx=0x7f01c0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.168+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01d0163b50 con 0x7f01d00cb9e0 2023-06-09T04:38:07.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.324+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01d0163b50 con 0x7f01d00cb9e0 2023-06-09T04:38:07.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01b77fe640 1 -- 172.21.15.18:0/1329661956 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f01d0163b50 con 0x7f01d00cb9e0 2023-06-09T04:38:07.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:07.332 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":19,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:06.988671+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:07.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01bc066280 msgr2=0x7f01bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01bc066280 0x7f01bc068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ae0 tx=0x7f01c0009190 comp rx=0 tx=0).stop 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 msgr2=0x7f01d0161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 0x7f01d0161820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01c80af040 tx=0x7f01c8019770 comp rx=0 tx=0).stop 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 shutdown_connections 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01d00cb9e0 0x7f01d0161820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01d00b7480 0x7f01d00c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01bc066280 0x7f01bc068730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 --2- 172.21.15.18:0/1329661956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01d006a3e0 0x7f01d0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 >> 172.21.15.18:0/1329661956 conn(0x7f01d00d2ae0 msgr2=0x7f01d015dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 shutdown_connections 2023-06-09T04:38:07.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.328+0000 7f01d56e7640 1 -- 172.21.15.18:0/1329661956 wait complete. 2023-06-09T04:38:07.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:07.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.480+0000 7f1a82a3a640 1 Processor -- start 2023-06-09T04:38:07.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.480+0000 7f1a82a3a640 1 -- start start 2023-06-09T04:38:07.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a82a3a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a7c1591c0 0x7f1a7c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a82a3a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 0x7f1a7c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a82a3a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c15de50 con 0x7f1a7c0acdf0 2023-06-09T04:38:07.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a82a3a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c15d2d0 con 0x7f1a7c1591c0 2023-06-09T04:38:07.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a82a3a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15d5b0 con 0x7f1a7c159590 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a80fd7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1a7c0acdf0 0x7f1a7c06bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34584/0 (socket says 172.21.15.18:34584) 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a80fd7640 1 -- 172.21.15.18:0/2856968602 learned_addr learned my addr 172.21.15.18:0/2856968602 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/2856968602 >> v2:172.21.15.81:3300/0 conn(0x7f1a7c1591c0 0x7f1a7c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7b7fe640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 0x7f1a7c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866698079 0 0) 0x7f1a7c15de50 con 0x7f1a7c0acdf0 2023-06-09T04:38:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a64003530 con 0x7f1a7c0acdf0 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970885367 0 0) 0x7f1a64003530 con 0x7f1a7c0acdf0 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 msgr2=0x7f1a7c0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 0x7f1a7c0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 >> v2:172.21.15.81:3300/0 conn(0x7f1a7c1591c0 msgr2=0x7f1a7c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 --2- 172.21.15.18:0/2856968602 >> v2:172.21.15.81:3300/0 conn(0x7f1a7c1591c0 0x7f1a7c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c15d890 con 0x7f1a7c0acdf0 2023-06-09T04:38:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f1a74001a00 con 0x7f1a7c0acdf0 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 >> v1:172.21.15.18:6789/0 conn(0x7f1a7c0acdf0 legacy=0x7f1a7c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a64003980 0x7f1a64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640043b0 0x7f1a64004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 0x7f1a64004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15d2d0 con 0x7f1a64003980 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15d5b0 con 0x7f1a640043b0 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6400b990 con 0x7f1a7c159590 2023-06-09T04:38:07.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a64003980 0x7f1a64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a80fd7640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 0x7f1a64004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7b7fe640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640043b0 0x7f1a64004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 -- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 msgr2=0x7f1a64004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c159590 0x7f1a64004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 -- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640043b0 msgr2=0x7f1a64004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a640043b0 0x7f1a64004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.484+0000 7f1a7bfff640 1 -- 172.21.15.18:0/2856968602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64003530 con 0x7f1a64003980 2023-06-09T04:38:07.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a64003980 0x7f1a64003d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009ac0 tx=0x7f1a7001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53efb187eb5dbde server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700059a0 con 0x7f1a64003980 2023-06-09T04:38:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70005b00 con 0x7f1a64003980 2023-06-09T04:38:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7affd640 1 -- 172.21.15.18:0/2856968602 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70006030 con 0x7f1a64003980 2023-06-09T04:38:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- 172.21.15.18:0/2856968602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a64003980 msgr2=0x7f1a64003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/2856968602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a64003980 0x7f1a64003d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009ac0 tx=0x7f1a7001ca40 comp rx=0 tx=0).stop 2023-06-09T04:38:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a80fd7640 1 -- 172.21.15.18:0/2856968602 reap_dead start 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- 172.21.15.18:0/2856968602 shutdown_connections 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- 172.21.15.18:0/2856968602 >> 172.21.15.18:0/2856968602 conn(0x7f1a7c0afa90 msgr2=0x7f1a7c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- 172.21.15.18:0/2856968602 shutdown_connections 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- 172.21.15.18:0/2856968602 wait complete. 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 Processor -- start 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- start start 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c1519b0 0x7f1a7c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 0x7f1a7c155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7c151d80 0x7f1a7c155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15b340 con 0x7f1a7c1522f0 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15a3b0 con 0x7f1a7c151d80 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a82a3a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15c480 con 0x7f1a7c1519b0 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 0x7f1a7c155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 0x7f1a7c155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37228/0 (socket says 172.21.15.18:37228) 2023-06-09T04:38:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 -- 172.21.15.18:0/1082531502 learned_addr learned my addr 172.21.15.18:0/1082531502 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c1519b0 0x7f1a7c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a80fd7640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7c151d80 0x7f1a7c155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 -- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c1519b0 msgr2=0x7f1a7c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c1519b0 0x7f1a7c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 -- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7c151d80 msgr2=0x7f1a7c155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7c151d80 0x7f1a7c155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7b7fe640 1 -- 172.21.15.18:0/1082531502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c15c760 con 0x7f1a7c1522f0 2023-06-09T04:38:07.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a80fd7640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7c151d80 0x7f1a7c155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.488+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c1519b0 0x7f1a7c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a7b7fe640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 0x7f1a7c155310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0115e0 tx=0x7f1a6c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00f8f0 con 0x7f1a7c1522f0 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00fa50 con 0x7f1a7c1522f0 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c15a600 con 0x7f1a7c1522f0 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00fdc0 con 0x7f1a7c1522f0 2023-06-09T04:38:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c0c5b00 con 0x7f1a7c1522f0 2023-06-09T04:38:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c06d120 con 0x7f1a7c1522f0 2023-06-09T04:38:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a6c015460 con 0x7f1a7c1522f0 2023-06-09T04:38:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a78ff9640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1a68066280 0x7f1a68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1a6c0842d0 con 0x7f1a7c1522f0 2023-06-09T04:38:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1a68066280 0x7f1a68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.492+0000 7f1a7bfff640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1a68066280 0x7f1a68068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a700ae000 tx=0x7f1a700046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.496+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a6c051a90 con 0x7f1a7c1522f0 2023-06-09T04:38:07.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a7c0aef00 con 0x7f1a7c1522f0 2023-06-09T04:38:07.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a78ff9640 1 -- 172.21.15.18:0/1082531502 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a6c0550b0 con 0x7f1a7c1522f0 2023-06-09T04:38:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:07.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1a68066280 msgr2=0x7f1a68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1a68066280 0x7f1a68068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a700ae000 tx=0x7f1a700046d0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 msgr2=0x7f1a7c155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 0x7f1a7c155310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0115e0 tx=0x7f1a6c011aa0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 shutdown_connections 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a7c151d80 0x7f1a7c155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a7c1522f0 0x7f1a7c155310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1a68066280 0x7f1a68068730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 --2- 172.21.15.18:0/1082531502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1a7c1519b0 0x7f1a7c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 >> 172.21.15.18:0/1082531502 conn(0x7f1a7c0afa90 msgr2=0x7f1a7c06bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 shutdown_connections 2023-06-09T04:38:07.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.656+0000 7f1a82a3a640 1 -- 172.21.15.18:0/1082531502 wait complete. 2023-06-09T04:38:07.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:07.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce9832b640 1 Processor -- start 2023-06-09T04:38:07.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce9832b640 1 -- start start 2023-06-09T04:38:07.803 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce9832b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce900cb5d0 0x7fce900cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce9832b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9015bea0 con 0x7fce90158510 2023-06-09T04:38:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce9832b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce900b1340 con 0x7fce9015cbd0 2023-06-09T04:38:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce9832b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9015c0f0 con 0x7fce900cb5d0 2023-06-09T04:38:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce960c7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce900cb5d0 0x7fce900cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce968c8640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fce90158510 0x7fce900c9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34594/0 (socket says 172.21.15.18:34594) 2023-06-09T04:38:07.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce968c8640 1 -- 172.21.15.18:0/3281522920 learned_addr learned my addr 172.21.15.18:0/3281522920 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce960c7640 1 -- 172.21.15.18:0/3281522920 >> v1:172.21.15.81:6789/0 conn(0x7fce9015cbd0 legacy=0x7fce900b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce960c7640 1 -- 172.21.15.18:0/3281522920 >> v1:172.21.15.18:6789/0 conn(0x7fce90158510 legacy=0x7fce900c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce960c7640 1 -- 172.21.15.18:0/3281522920 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9015c3d0 con 0x7fce900cb5d0 2023-06-09T04:38:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.800+0000 7fce950c5640 1 -- 172.21.15.18:0/3281522920 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724455914 0 0) 0x7fce9015bea0 con 0x7fce90158510 2023-06-09T04:38:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce960c7640 1 --2- 172.21.15.18:0/3281522920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce900cb5d0 0x7fce900cb9a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce84009d90 tx=0x7fce8401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78eeeb4537a7937 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce950c5640 1 -- 172.21.15.18:0/3281522920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5930 con 0x7fce900cb5d0 2023-06-09T04:38:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce950c5640 1 -- 172.21.15.18:0/3281522920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840a5a90 con 0x7fce900cb5d0 2023-06-09T04:38:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce950c5640 1 -- 172.21.15.18:0/3281522920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5e20 con 0x7fce900cb5d0 2023-06-09T04:38:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/3281522920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce900cb5d0 msgr2=0x7fce900cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 --2- 172.21.15.18:0/3281522920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce900cb5d0 0x7fce900cb9a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce84009d90 tx=0x7fce8401c850 comp rx=0 tx=0).stop 2023-06-09T04:38:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/3281522920 shutdown_connections 2023-06-09T04:38:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 --2- 172.21.15.18:0/3281522920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce900cb5d0 0x7fce900cb9a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/3281522920 >> 172.21.15.18:0/3281522920 conn(0x7fce9006cdd0 msgr2=0x7fce9006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/3281522920 shutdown_connections 2023-06-09T04:38:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/3281522920 wait complete. 2023-06-09T04:38:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 Processor -- start 2023-06-09T04:38:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- start start 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900cb5d0 0x7fce9015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce90158510 0x7fce90155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 0x7fce90152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90159990 con 0x7fce9015cbd0 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90159c70 con 0x7fce900cb5d0 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90161df0 con 0x7fce90158510 2023-06-09T04:38:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 0x7fce90152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 0x7fce90152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37248/0 (socket says 172.21.15.18:37248) 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 -- 172.21.15.18:0/2603058707 learned_addr learned my addr 172.21.15.18:0/2603058707 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce960c7640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900cb5d0 0x7fce9015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce958c6640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce90158510 0x7fce90155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 -- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce90158510 msgr2=0x7fce90155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce90158510 0x7fce90155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 -- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900cb5d0 msgr2=0x7fce9015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900cb5d0 0x7fce9015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 -- 172.21.15.18:0/2603058707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009a70 con 0x7fce9015cbd0 2023-06-09T04:38:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce960c7640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900cb5d0 0x7fce9015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce968c8640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 0x7fce90152d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c480 tx=0x7fce8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880074e0 con 0x7fce9015cbd0 2023-06-09T04:38:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce88007640 con 0x7fce9015cbd0 2023-06-09T04:38:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce901620d0 con 0x7fce9015cbd0 2023-06-09T04:38:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88004a10 con 0x7fce9015cbd0 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.804+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce90151f60 con 0x7fce9015cbd0 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.808+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9015bc10 con 0x7fce9015cbd0 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.808+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce88004b70 con 0x7fce9015cbd0 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.808+0000 7fce82ffd640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce74066280 0x7fce74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.808+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fce88082e60 con 0x7fce9015cbd0 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.808+0000 7fce960c7640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce74066280 0x7fce74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.808+0000 7fce960c7640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce74066280 0x7fce74068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fce840af000 tx=0x7fce840a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.812+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce880506c0 con 0x7fce9015cbd0 2023-06-09T04:38:07.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.964+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce900cf070 con 0x7fce9015cbd0 2023-06-09T04:38:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.964+0000 7fce82ffd640 1 -- 172.21.15.18:0/2603058707 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce880180a0 con 0x7fce9015cbd0 2023-06-09T04:38:07.969 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce74066280 msgr2=0x7fce74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce74066280 0x7fce74068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fce840af000 tx=0x7fce840a7070 comp rx=0 tx=0).stop 2023-06-09T04:38:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 msgr2=0x7fce90152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 0x7fce90152d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c480 tx=0x7fce8800c940 comp rx=0 tx=0).stop 2023-06-09T04:38:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 shutdown_connections 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce9015cbd0 0x7fce90152d00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce74066280 0x7fce74068730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce90158510 0x7fce90155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 --2- 172.21.15.18:0/2603058707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce900cb5d0 0x7fce9015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 >> 172.21.15.18:0/2603058707 conn(0x7fce9006cdd0 msgr2=0x7fce900b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 shutdown_connections 2023-06-09T04:38:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:07.968+0000 7fce9832b640 1 -- 172.21.15.18:0/2603058707 wait complete. 2023-06-09T04:38:07.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.100+0000 7fbc66633640 1 Processor -- start 2023-06-09T04:38:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc66633640 1 -- start start 2023-06-09T04:38:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc66633640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc60157dc0 0x7fbc600c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc66633640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc600acd10 0x7fbc600cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc66633640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600c9010 con 0x7fbc6006fb60 2023-06-09T04:38:08.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc66633640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600cbdc0 con 0x7fbc60157dc0 2023-06-09T04:38:08.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc66633640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600c8460 con 0x7fbc600acd10 2023-06-09T04:38:08.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc60157dc0 0x7fbc600c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc60157dc0 0x7fbc600c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37264/0 (socket says 172.21.15.18:37264) 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 -- 172.21.15.18:0/1257026258 learned_addr learned my addr 172.21.15.18:0/1257026258 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5f7fe640 1 --2- 172.21.15.18:0/1257026258 >> v2:172.21.15.81:3300/0 conn(0x7fbc600acd10 0x7fbc600cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 -- 172.21.15.18:0/1257026258 >> v2:172.21.15.81:3300/0 conn(0x7fbc600acd10 msgr2=0x7fbc600cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 --2- 172.21.15.18:0/1257026258 >> v2:172.21.15.81:3300/0 conn(0x7fbc600acd10 0x7fbc600cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 -- 172.21.15.18:0/1257026258 >> v1:172.21.15.81:6789/0 conn(0x7fbc6006fb60 legacy=0x7fbc600694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 -- 172.21.15.18:0/1257026258 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600ad160 con 0x7fbc60157dc0 2023-06-09T04:38:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.104+0000 7fbc5ffff640 1 --2- 172.21.15.18:0/1257026258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc60157dc0 0x7fbc600c94a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc6006b500 tx=0x7fbc50020ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e2937b72f73795 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5effd640 1 -- 172.21.15.18:0/1257026258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500aabc0 con 0x7fbc60157dc0 2023-06-09T04:38:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5effd640 1 -- 172.21.15.18:0/1257026258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc500aad20 con 0x7fbc60157dc0 2023-06-09T04:38:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5effd640 1 -- 172.21.15.18:0/1257026258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500b2660 con 0x7fbc60157dc0 2023-06-09T04:38:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/1257026258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc60157dc0 msgr2=0x7fbc600c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 --2- 172.21.15.18:0/1257026258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc60157dc0 0x7fbc600c94a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbc6006b500 tx=0x7fbc50020ec0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/1257026258 shutdown_connections 2023-06-09T04:38:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 --2- 172.21.15.18:0/1257026258 >> v2:172.21.15.81:3300/0 conn(0x7fbc600acd10 0x7fbc600cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 --2- 172.21.15.18:0/1257026258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc60157dc0 0x7fbc600c94a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/1257026258 >> 172.21.15.18:0/1257026258 conn(0x7fbc600b0240 msgr2=0x7fbc600cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/1257026258 shutdown_connections 2023-06-09T04:38:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/1257026258 wait complete. 2023-06-09T04:38:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 Processor -- start 2023-06-09T04:38:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- start start 2023-06-09T04:38:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc6006fb60 0x7fbc60149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 0x7fbc60069e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc60157dc0 0x7fbc600abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60149b70 con 0x7fbc600acd10 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60149da0 con 0x7fbc60157dc0 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014a080 con 0x7fbc6006fb60 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 0x7fbc60069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 0x7fbc60069e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37274/0 (socket says 172.21.15.18:37274) 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 -- 172.21.15.18:0/3996118695 learned_addr learned my addr 172.21.15.18:0/3996118695 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5ffff640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc6006fb60 0x7fbc60149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc64bd0640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc60157dc0 0x7fbc600abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 -- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc6006fb60 msgr2=0x7fbc60149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc6006fb60 0x7fbc60149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 -- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc60157dc0 msgr2=0x7fbc600abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc60157dc0 0x7fbc600abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 -- 172.21.15.18:0/3996118695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500094d0 con 0x7fbc600acd10 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5ffff640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc6006fb60 0x7fbc60149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:08.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5f7fe640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 0x7fbc60069e40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007ef0 tx=0x7fbc5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54014620 con 0x7fbc600acd10 2023-06-09T04:38:08.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54014780 con 0x7fbc600acd10 2023-06-09T04:38:08.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6014a360 con 0x7fbc600acd10 2023-06-09T04:38:08.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54014b30 con 0x7fbc600acd10 2023-06-09T04:38:08.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.108+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6014a920 con 0x7fbc600acd10 2023-06-09T04:38:08.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.112+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60073380 con 0x7fbc600acd10 2023-06-09T04:38:08.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.112+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc54014c90 con 0x7fbc600acd10 2023-06-09T04:38:08.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.112+0000 7fbc5cff9640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbc4c066280 0x7fbc4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.112+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbc540844a0 con 0x7fbc600acd10 2023-06-09T04:38:08.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.112+0000 7fbc5ffff640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbc4c066280 0x7fbc4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.112+0000 7fbc5ffff640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbc4c066280 0x7fbc4c068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc500b4000 tx=0x7fbc50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.116+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc54051bd0 con 0x7fbc600acd10 2023-06-09T04:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.304+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc600c9750 con 0x7fbc600acd10 2023-06-09T04:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc5cff9640 1 -- 172.21.15.18:0/3996118695 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7fbc540551f0 con 0x7fbc600acd10 2023-06-09T04:38:08.310 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:08.311 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-09T04:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2023-06-09T04:38:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbc4c066280 msgr2=0x7fbc4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbc4c066280 0x7fbc4c068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc500b4000 tx=0x7fbc50008040 comp rx=0 tx=0).stop 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 msgr2=0x7fbc60069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 0x7fbc60069e40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007ef0 tx=0x7fbc5400e4b0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 shutdown_connections 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc60157dc0 0x7fbc600abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc600acd10 0x7fbc60069e40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbc4c066280 0x7fbc4c068730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 --2- 172.21.15.18:0/3996118695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbc6006fb60 0x7fbc60149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 >> 172.21.15.18:0/3996118695 conn(0x7fbc600b0240 msgr2=0x7fbc600cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 shutdown_connections 2023-06-09T04:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.308+0000 7fbc66633640 1 -- 172.21.15.18:0/3996118695 wait complete. 2023-06-09T04:38:08.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634f001640 1 Processor -- start 2023-06-09T04:38:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634f001640 1 -- start start 2023-06-09T04:38:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634f001640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 0x7f634806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634f001640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634815cf10 con 0x7f63480700a0 2023-06-09T04:38:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634f001640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6348070520 con 0x7f6348159320 2023-06-09T04:38:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634f001640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634815dd90 con 0x7f634815a3e0 2023-06-09T04:38:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f63480700a0 0x7f634806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34610/0 (socket says 172.21.15.18:34610) 2023-06-09T04:38:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 -- 172.21.15.18:0/2136112717 learned_addr learned my addr 172.21.15.18:0/2136112717 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f6347fff640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 0x7f634806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264642491 0 0) 0x7f634815cf10 con 0x7f63480700a0 2023-06-09T04:38:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6338003530 con 0x7f63480700a0 2023-06-09T04:38:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686309665 0 0) 0x7f6338003530 con 0x7f63480700a0 2023-06-09T04:38:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 msgr2=0x7f634806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 0x7f634806fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 >> v1:172.21.15.81:6789/0 conn(0x7f6348159320 legacy=0x7f634815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480c81b0 con 0x7f63480700a0 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f6340001a00 con 0x7f63480700a0 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 >> v1:172.21.15.18:6789/0 conn(0x7f63480700a0 legacy=0x7f634806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63380039b0 0x7f6338003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 0x7f63380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6338004d10 0x7f6338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634815dd90 con 0x7f6338004d10 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633800baa0 con 0x7f63380039b0 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633800bc60 con 0x7f634815a3e0 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6338004d10 0x7f6338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634cd9d640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63380039b0 0x7f6338003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f6347fff640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 0x7f63380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 -- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 msgr2=0x7f63380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f634815a3e0 0x7f63380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 -- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63380039b0 msgr2=0x7f6338003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63380039b0 0x7f6338003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.452+0000 7f634d59e640 1 -- 172.21.15.18:0/2136112717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338003530 con 0x7f6338004d10 2023-06-09T04:38:08.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634d59e640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6338004d10 0x7f6338005180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f634000a830 tx=0x7f634001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d175a501bf91554 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400aa6d0 con 0x7f6338004d10 2023-06-09T04:38:08.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63400aa850 con 0x7f6338004d10 2023-06-09T04:38:08.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f63477fe640 1 -- 172.21.15.18:0/2136112717 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400aac00 con 0x7f6338004d10 2023-06-09T04:38:08.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- 172.21.15.18:0/2136112717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6338004d10 msgr2=0x7f6338005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 --2- 172.21.15.18:0/2136112717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6338004d10 0x7f6338005180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f634000a830 tx=0x7f634001faa0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634d59e640 1 -- 172.21.15.18:0/2136112717 reap_dead start 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- 172.21.15.18:0/2136112717 shutdown_connections 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- 172.21.15.18:0/2136112717 >> 172.21.15.18:0/2136112717 conn(0x7f63480b0240 msgr2=0x7f63480cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- 172.21.15.18:0/2136112717 shutdown_connections 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- 172.21.15.18:0/2136112717 wait complete. 2023-06-09T04:38:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 Processor -- start 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- start start 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6338004d10 0x7f63481550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 0x7f63481f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6348156e90 0x7f6348157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481f3f80 con 0x7f63481f35f0 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6348157b30 con 0x7f6338004d10 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.456+0000 7f634f001640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6348157e10 con 0x7f6348156e90 2023-06-09T04:38:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 0x7f63481f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 0x7f63481f3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37294/0 (socket says 172.21.15.18:37294) 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 -- 172.21.15.18:0/515526854 learned_addr learned my addr 172.21.15.18:0/515526854 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634cd9d640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6338004d10 0x7f63481550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634d59e640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6348156e90 0x7f6348157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 -- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6348156e90 msgr2=0x7f6348157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6348156e90 0x7f6348157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 -- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6338004d10 msgr2=0x7f63481550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6338004d10 0x7f63481550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 -- 172.21.15.18:0/515526854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480cb630 con 0x7f63481f35f0 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f6347fff640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 0x7f63481f3a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63340115e0 tx=0x7f6334011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400f8f0 con 0x7f63481f35f0 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400fa50 con 0x7f63481f35f0 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63480cb910 con 0x7f63481f35f0 2023-06-09T04:38:08.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400fdc0 con 0x7f63481f35f0 2023-06-09T04:38:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6348157840 con 0x7f63481f35f0 2023-06-09T04:38:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634806c900 con 0x7f63481f35f0 2023-06-09T04:38:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6334015460 con 0x7f63481f35f0 2023-06-09T04:38:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f63457fa640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f632c066280 0x7f632c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6334084290 con 0x7f63481f35f0 2023-06-09T04:38:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634cd9d640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f632c066280 0x7f632c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.460+0000 7f634cd9d640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f632c066280 0x7f632c068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f633c005510 tx=0x7f633c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.464+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6334051af0 con 0x7f63481f35f0 2023-06-09T04:38:08.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.620+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63480ce690 con 0x7f63481f35f0 2023-06-09T04:38:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.620+0000 7f63457fa640 1 -- 172.21.15.18:0/515526854 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14614 (secure 0 0 0) 0x7f6334055110 con 0x7f63481f35f0 2023-06-09T04:38:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:08.625 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:07.991617+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f632c066280 msgr2=0x7f632c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f632c066280 0x7f632c068730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f633c005510 tx=0x7f633c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 msgr2=0x7f63481f3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 0x7f63481f3a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63340115e0 tx=0x7f6334011aa0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 shutdown_connections 2023-06-09T04:38:08.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f632c066280 0x7f632c068730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6348156e90 0x7f6348157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63481f35f0 0x7f63481f3a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 --2- 172.21.15.18:0/515526854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6338004d10 0x7f63481550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 >> 172.21.15.18:0/515526854 conn(0x7f63480b0240 msgr2=0x7f6348158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 shutdown_connections 2023-06-09T04:38:08.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.624+0000 7f634f001640 1 -- 172.21.15.18:0/515526854 wait complete. 2023-06-09T04:38:08.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:08.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb334ba640 1 Processor -- start 2023-06-09T04:38:08.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb334ba640 1 -- start start 2023-06-09T04:38:08.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb334ba640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 0x7fdb2c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb334ba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c0ca590 con 0x7fdb2c15b730 2023-06-09T04:38:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb334ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c0cbef0 con 0x7fdb2c0cba70 2023-06-09T04:38:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb334ba640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c15f2f0 con 0x7fdb2c0cc8b0 2023-06-09T04:38:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb31256640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdb2c15b730 0x7fdb2c0c9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34626/0 (socket says 172.21.15.18:34626) 2023-06-09T04:38:08.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb31256640 1 -- 172.21.15.18:0/3914041161 learned_addr learned my addr 172.21.15.18:0/3914041161 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb30a55640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 0x7fdb2c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388990740 0 0) 0x7fdb2c0ca590 con 0x7fdb2c15b730 2023-06-09T04:38:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.768+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb18003530 con 0x7fdb2c15b730 2023-06-09T04:38:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992913306 0 0) 0x7fdb18003530 con 0x7fdb2c15b730 2023-06-09T04:38:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 msgr2=0x7fdb2c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 0x7fdb2c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 >> v1:172.21.15.81:6789/0 conn(0x7fdb2c0cba70 legacy=0x7fdb2c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c15f5d0 con 0x7fdb2c15b730 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fdb28001a00 con 0x7fdb2c15b730 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 >> v1:172.21.15.18:6789/0 conn(0x7fdb2c15b730 legacy=0x7fdb2c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb180039b0 0x7fdb18003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 0x7fdb180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c15f2f0 con 0x7fdb18004d10 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1800ba40 con 0x7fdb180039b0 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1800bc00 con 0x7fdb2c0cc8b0 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31256640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb180039b0 0x7fdb18003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb30a55640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 0x7fdb180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 -- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 msgr2=0x7fdb180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0cc8b0 0x7fdb180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 -- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb180039b0 msgr2=0x7fdb18003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb180039b0 0x7fdb18003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 -- 172.21.15.18:0/3914041161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18003530 con 0x7fdb18004d10 2023-06-09T04:38:08.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb18005180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb24001780 tx=0x7fdb2401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f92636e297005e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb240052d0 con 0x7fdb18004d10 2023-06-09T04:38:08.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb240a7050 con 0x7fdb18004d10 2023-06-09T04:38:08.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb23fff640 1 -- 172.21.15.18:0/3914041161 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb24003600 con 0x7fdb18004d10 2023-06-09T04:38:08.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb334ba640 1 -- 172.21.15.18:0/3914041161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 msgr2=0x7fdb18005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb334ba640 1 --2- 172.21.15.18:0/3914041161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb18005180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb24001780 tx=0x7fdb2401c400 comp rx=0 tx=0).stop 2023-06-09T04:38:08.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb31a57640 1 -- 172.21.15.18:0/3914041161 reap_dead start 2023-06-09T04:38:08.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb334ba640 1 -- 172.21.15.18:0/3914041161 shutdown_connections 2023-06-09T04:38:08.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb334ba640 1 -- 172.21.15.18:0/3914041161 >> 172.21.15.18:0/3914041161 conn(0x7fdb2c06cdd0 msgr2=0x7fdb2c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb334ba640 1 -- 172.21.15.18:0/3914041161 shutdown_connections 2023-06-09T04:38:08.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.772+0000 7fdb334ba640 1 -- 172.21.15.18:0/3914041161 wait complete. 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 Processor -- start 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- start start 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb2c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0ad290 0x7fdb2c0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c0c3f20 0x7fdb2c0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0acc80 con 0x7fdb18004d10 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0c2c50 con 0x7fdb2c0c3f20 2023-06-09T04:38:08.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0ad6e0 con 0x7fdb2c0ad290 2023-06-09T04:38:08.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb2c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb2c152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37316/0 (socket says 172.21.15.18:37316) 2023-06-09T04:38:08.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 -- 172.21.15.18:0/66177464 learned_addr learned my addr 172.21.15.18:0/66177464 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:08.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb30a55640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0ad290 0x7fdb2c0c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31a57640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c0c3f20 0x7fdb2c0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 -- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0ad290 msgr2=0x7fdb2c0c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0ad290 0x7fdb2c0c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 -- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c0c3f20 msgr2=0x7fdb2c0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c0c3f20 0x7fdb2c0ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 -- 172.21.15.18:0/66177464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0c2e80 con 0x7fdb18004d10 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31a57640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c0c3f20 0x7fdb2c0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb31256640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb2c152a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb28007a50 tx=0x7fdb2800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800ee50 con 0x7fdb18004d10 2023-06-09T04:38:08.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb28013420 con 0x7fdb18004d10 2023-06-09T04:38:08.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb280137d0 con 0x7fdb18004d10 2023-06-09T04:38:08.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c0c3160 con 0x7fdb18004d10 2023-06-09T04:38:08.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c0c3720 con 0x7fdb18004d10 2023-06-09T04:38:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.776+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c0c5a40 con 0x7fdb18004d10 2023-06-09T04:38:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.780+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb28013930 con 0x7fdb18004d10 2023-06-09T04:38:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.780+0000 7fdb21ffb640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb10066280 0x7fdb10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.780+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdb28084240 con 0x7fdb18004d10 2023-06-09T04:38:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.780+0000 7fdb30a55640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb10066280 0x7fdb10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.780+0000 7fdb30a55640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb10066280 0x7fdb10068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0ac1c0 tx=0x7fdb1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.784+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb28051a10 con 0x7fdb18004d10 2023-06-09T04:38:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb2c0b4b80 con 0x7fdb18004d10 2023-06-09T04:38:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb21ffb640 1 -- 172.21.15.18:0/66177464 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb28055030 con 0x7fdb18004d10 2023-06-09T04:38:08.940 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb10066280 msgr2=0x7fdb10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb10066280 0x7fdb10068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0ac1c0 tx=0x7fdb1c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 msgr2=0x7fdb2c152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb2c152a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb28007a50 tx=0x7fdb2800e530 comp rx=0 tx=0).stop 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 shutdown_connections 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c0c3f20 0x7fdb2c0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb10066280 0x7fdb10068730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb2c0ad290 0x7fdb2c0c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 --2- 172.21.15.18:0/66177464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb18004d10 0x7fdb2c152a50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 >> 172.21.15.18:0/66177464 conn(0x7fdb2c06cdd0 msgr2=0x7fdb2c069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 shutdown_connections 2023-06-09T04:38:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:08.936+0000 7fdb334ba640 1 -- 172.21.15.18:0/66177464 wait complete. 2023-06-09T04:38:08.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:09.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 Processor -- start 2023-06-09T04:38:09.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 -- start start 2023-06-09T04:38:09.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07501595b0 0x7f07500b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07500ccb70 0x7f075015d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0750159980 con 0x7f07500cf890 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500cbfc0 con 0x7f07501595b0 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0758194640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500ce710 con 0x7f07500ccb70 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07501595b0 0x7f07500b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07501595b0 0x7f07500b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37330/0 (socket says 172.21.15.18:37330) 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 -- 172.21.15.18:0/3875796346 learned_addr learned my addr 172.21.15.18:0/3875796346 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:09.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0756731640 1 --2- 172.21.15.18:0/3875796346 >> v2:172.21.15.81:3300/0 conn(0x7f07500ccb70 0x7f075015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 -- 172.21.15.18:0/3875796346 >> v2:172.21.15.81:3300/0 conn(0x7f07500ccb70 msgr2=0x7f075015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 --2- 172.21.15.18:0/3875796346 >> v2:172.21.15.81:3300/0 conn(0x7f07500ccb70 0x7f075015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 -- 172.21.15.18:0/3875796346 >> v1:172.21.15.81:6789/0 conn(0x7f07500cf890 legacy=0x7f07500cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.076+0000 7f0755f30640 1 -- 172.21.15.18:0/3875796346 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500cabb0 con 0x7f07501595b0 2023-06-09T04:38:09.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0755f30640 1 --2- 172.21.15.18:0/3875796346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07501595b0 0x7f07500b2bc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f075006db20 tx=0x7f074c01c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f4f1f57ea25ac3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0754f2e640 1 -- 172.21.15.18:0/3875796346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0ab600 con 0x7f07501595b0 2023-06-09T04:38:09.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0754f2e640 1 -- 172.21.15.18:0/3875796346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c0a7050 con 0x7f07501595b0 2023-06-09T04:38:09.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0754f2e640 1 -- 172.21.15.18:0/3875796346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0ab980 con 0x7f07501595b0 2023-06-09T04:38:09.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 -- 172.21.15.18:0/3875796346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07501595b0 msgr2=0x7f07500b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 --2- 172.21.15.18:0/3875796346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07501595b0 0x7f07500b2bc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f075006db20 tx=0x7f074c01c200 comp rx=0 tx=0).stop 2023-06-09T04:38:09.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 -- 172.21.15.18:0/3875796346 shutdown_connections 2023-06-09T04:38:09.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 --2- 172.21.15.18:0/3875796346 >> v2:172.21.15.81:3300/0 conn(0x7f07500ccb70 0x7f075015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 --2- 172.21.15.18:0/3875796346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07501595b0 0x7f07500b2bc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 -- 172.21.15.18:0/3875796346 >> 172.21.15.18:0/3875796346 conn(0x7f075006ce60 msgr2=0x7f075006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 -- 172.21.15.18:0/3875796346 shutdown_connections 2023-06-09T04:38:09.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 -- 172.21.15.18:0/3875796346 wait complete. 2023-06-09T04:38:09.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 Processor -- start 2023-06-09T04:38:09.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.080+0000 7f0758194640 1 -- start start 2023-06-09T04:38:09.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07500ccb70 0x7f07500c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 0x7f07500b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07501595b0 0x7f075014baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500c6780 con 0x7f07500cf890 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500c47e0 con 0x7f07500ccb70 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500c61c0 con 0x7f07501595b0 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 0x7f07500b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 0x7f07500b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37344/0 (socket says 172.21.15.18:37344) 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 -- 172.21.15.18:0/1105624481 learned_addr learned my addr 172.21.15.18:0/1105624481 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0755f30640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07500ccb70 0x7f07500c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 -- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07501595b0 msgr2=0x7f075014baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07501595b0 0x7f075014baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 -- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07500ccb70 msgr2=0x7f07500c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07500ccb70 0x7f07500c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 -- 172.21.15.18:0/1105624481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0094d0 con 0x7f07500cf890 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f075572f640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 0x7f07500b4b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f074000c490 tx=0x7f0740001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740003600 con 0x7f07500cf890 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0740003780 con 0x7f07500cf890 2023-06-09T04:38:09.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0740003b70 con 0x7f07500cf890 2023-06-09T04:38:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07500ce9f0 con 0x7f07500cf890 2023-06-09T04:38:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07500c5e70 con 0x7f07500cf890 2023-06-09T04:38:09.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0750073380 con 0x7f07500cf890 2023-06-09T04:38:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0740003cd0 con 0x7f07500cf890 2023-06-09T04:38:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f07467fc640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0734066280 0x7f0734068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0740082c20 con 0x7f07500cf890 2023-06-09T04:38:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.084+0000 7f0755f30640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0734066280 0x7f0734068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.088+0000 7f0755f30640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0734066280 0x7f0734068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f074c0ad000 tx=0x7f074c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.088+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0740050480 con 0x7f07500cf890 2023-06-09T04:38:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.236+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f075006ecb0 con 0x7f07500cf890 2023-06-09T04:38:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.236+0000 7f07467fc640 1 -- 172.21.15.18:0/1105624481 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0740017020 con 0x7f07500cf890 2023-06-09T04:38:09.241 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0734066280 msgr2=0x7f0734068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0734066280 0x7f0734068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f074c0ad000 tx=0x7f074c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 msgr2=0x7f07500b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 0x7f07500b4b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f074000c490 tx=0x7f0740001e80 comp rx=0 tx=0).stop 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 shutdown_connections 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0734066280 0x7f0734068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07501595b0 0x7f075014baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500cf890 0x7f07500b4b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 --2- 172.21.15.18:0/1105624481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07500ccb70 0x7f07500c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.245 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 >> 172.21.15.18:0/1105624481 conn(0x7f075006ce60 msgr2=0x7f075015b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.245 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 shutdown_connections 2023-06-09T04:38:09.245 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.240+0000 7f0758194640 1 -- 172.21.15.18:0/1105624481 wait complete. 2023-06-09T04:38:09.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:38:09.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.364+0000 7f5a48eeb640 1 Processor -- start 2023-06-09T04:38:09.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.364+0000 7f5a48eeb640 1 -- start start 2023-06-09T04:38:09.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a48eeb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a441586e0 0x7f5a440ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a48eeb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a4406c3c0 0x7f5a4415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a48eeb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4406a900 con 0x7f5a44158310 2023-06-09T04:38:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a48eeb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440cd0f0 con 0x7f5a441586e0 2023-06-09T04:38:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a48eeb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415ceb0 con 0x7f5a4406c3c0 2023-06-09T04:38:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a441586e0 0x7f5a440ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a441586e0 0x7f5a440ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37346/0 (socket says 172.21.15.18:37346) 2023-06-09T04:38:09.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 -- 172.21.15.18:0/3254628980 learned_addr learned my addr 172.21.15.18:0/3254628980 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:09.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a42d9d640 1 --2- 172.21.15.18:0/3254628980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a4406c3c0 0x7f5a4415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 -- 172.21.15.18:0/3254628980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a4406c3c0 msgr2=0x7f5a4415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 --2- 172.21.15.18:0/3254628980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a4406c3c0 0x7f5a4415bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 -- 172.21.15.18:0/3254628980 >> v1:172.21.15.81:6789/0 conn(0x7f5a44158310 legacy=0x7f5a4406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 -- 172.21.15.18:0/3254628980 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4415cbd0 con 0x7f5a441586e0 2023-06-09T04:38:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.368+0000 7f5a41d9b640 1 --2- 172.21.15.18:0/3254628980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a441586e0 0x7f5a440ccbb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00bb10 tx=0x7f5a2c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64de108ccaaa5dd2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a4159a640 1 -- 172.21.15.18:0/3254628980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0a7b40 con 0x7f5a441586e0 2023-06-09T04:38:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a4159a640 1 -- 172.21.15.18:0/3254628980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0a7ca0 con 0x7f5a441586e0 2023-06-09T04:38:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a4159a640 1 -- 172.21.15.18:0/3254628980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0af660 con 0x7f5a441586e0 2023-06-09T04:38:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/3254628980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a441586e0 msgr2=0x7f5a440ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/3254628980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a441586e0 0x7f5a440ccbb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00bb10 tx=0x7f5a2c01eba0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/3254628980 shutdown_connections 2023-06-09T04:38:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/3254628980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a4406c3c0 0x7f5a4415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/3254628980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a441586e0 0x7f5a440ccbb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/3254628980 >> 172.21.15.18:0/3254628980 conn(0x7f5a440b0240 msgr2=0x7f5a440cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/3254628980 shutdown_connections 2023-06-09T04:38:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/3254628980 wait complete. 2023-06-09T04:38:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 Processor -- start 2023-06-09T04:38:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- start start 2023-06-09T04:38:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4406c3c0 0x7f5a440c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 0x7f5a44158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a441586e0 0x7f5a4415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415a2b0 con 0x7f5a44158310 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4415b9d0 con 0x7f5a4406c3c0 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a441596a0 con 0x7f5a441586e0 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 0x7f5a44158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 0x7f5a44158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37356/0 (socket says 172.21.15.18:37356) 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 -- 172.21.15.18:0/1651318505 learned_addr learned my addr 172.21.15.18:0/1651318505 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a42d9d640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a441586e0 0x7f5a4415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a4259c640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4406c3c0 0x7f5a440c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 -- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a441586e0 msgr2=0x7f5a4415a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a441586e0 0x7f5a4415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 -- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4406c3c0 msgr2=0x7f5a440c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4406c3c0 0x7f5a440c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 -- 172.21.15.18:0/1651318505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c00b770 con 0x7f5a44158310 2023-06-09T04:38:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a4259c640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4406c3c0 0x7f5a440c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a41d9b640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 0x7f5a44158d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00b2c0 tx=0x7f5a2c01b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0bf070 con 0x7f5a44158310 2023-06-09T04:38:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0ba440 con 0x7f5a44158310 2023-06-09T04:38:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a44159980 con 0x7f5a44158310 2023-06-09T04:38:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0ba810 con 0x7f5a44158310 2023-06-09T04:38:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.372+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a44159f40 con 0x7f5a44158310 2023-06-09T04:38:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.376+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a44073380 con 0x7f5a44158310 2023-06-09T04:38:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.376+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a2c0b6040 con 0x7f5a44158310 2023-06-09T04:38:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.376+0000 7f5a3affd640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5a24066280 0x7f5a24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.376+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5a2c1206c0 con 0x7f5a44158310 2023-06-09T04:38:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.376+0000 7f5a4259c640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5a24066280 0x7f5a24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.376+0000 7f5a4259c640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5a24066280 0x7f5a24068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a4414d130 tx=0x7f5a34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.380+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a2c0ede90 con 0x7f5a44158310 2023-06-09T04:38:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.528+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5a4406a390 con 0x7f5a44158310 2023-06-09T04:38:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.528+0000 7f5a3affd640 1 -- 172.21.15.18:0/1651318505 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5a2c0f14b0 con 0x7f5a44158310 2023-06-09T04:38:09.534 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:38:09.535 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 2, 2023-06-09T04:38:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": "rbd" 2023-06-09T04:38:09.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:38:09.536 INFO:teuthology.orchestra.run.smithi018.stdout:] 2023-06-09T04:38:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5a24066280 msgr2=0x7f5a24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5a24066280 0x7f5a24068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a4414d130 tx=0x7f5a34009040 comp rx=0 tx=0).stop 2023-06-09T04:38:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 msgr2=0x7f5a44158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 0x7f5a44158d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00b2c0 tx=0x7f5a2c01b940 comp rx=0 tx=0).stop 2023-06-09T04:38:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 shutdown_connections 2023-06-09T04:38:09.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5a24066280 0x7f5a24068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5a441586e0 0x7f5a4415a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a44158310 0x7f5a44158d50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 --2- 172.21.15.18:0/1651318505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4406c3c0 0x7f5a440c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 >> 172.21.15.18:0/1651318505 conn(0x7f5a440b0240 msgr2=0x7f5a44150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 shutdown_connections 2023-06-09T04:38:09.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.532+0000 7f5a48eeb640 1 -- 172.21.15.18:0/1651318505 wait complete. 2023-06-09T04:38:09.551 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:38:09.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:38:09.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 Processor -- start 2023-06-09T04:38:09.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 -- start start 2023-06-09T04:38:09.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f038806a3e0 0x7f03880b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 0x7f03880b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880d0590 con 0x7f038815b650 2023-06-09T04:38:09.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038815ba20 con 0x7f038806a3e0 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f038dfda640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03880ccbc0 con 0x7f03880b51a0 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03877fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f038815b650 0x7f03880ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34634/0 (socket says 172.21.15.18:34634) 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03877fe640 1 -- 172.21.15.18:0/1387462289 learned_addr learned my addr 172.21.15.18:0/1387462289 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 0x7f03880b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0386ffd640 1 --2- 172.21.15.18:0/1387462289 >> v2:172.21.15.81:3300/0 conn(0x7f038806a3e0 0x7f03880b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154594689 0 0) 0x7f03880d0590 con 0x7f038815b650 2023-06-09T04:38:09.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0374003530 con 0x7f038815b650 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741912401 0 0) 0x7f0374003530 con 0x7f038815b650 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 msgr2=0x7f03880b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 0x7f03880b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 >> v2:172.21.15.81:3300/0 conn(0x7f038806a3e0 msgr2=0x7f03880b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 --2- 172.21.15.18:0/1387462289 >> v2:172.21.15.81:3300/0 conn(0x7f038806a3e0 0x7f03880b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880cc600 con 0x7f038815b650 2023-06-09T04:38:09.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f0380001680 con 0x7f038815b650 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 >> v1:172.21.15.18:6789/0 conn(0x7f038815b650 legacy=0x7f03880ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 0x7f0374003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374003f50 0x7f03740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0374004d10 0x7f0374005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038815ba20 con 0x7f0374004d10 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03880ccbc0 con 0x7f0374003f50 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037400b990 con 0x7f03880b51a0 2023-06-09T04:38:09.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0374004d10 0x7f0374005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 -- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 msgr2=0x7f0374003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03880b51a0 0x7f0374003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0386ffd640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374003f50 0x7f03740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 -- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374003f50 msgr2=0x7f03740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0374003f50 0x7f03740047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.664+0000 7f0387fff640 1 -- 172.21.15.18:0/1387462289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374003530 con 0x7f0374004d10 2023-06-09T04:38:09.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f0387fff640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0374004d10 0x7f0374005180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0378009fc0 tx=0x7f037801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab5449e9a86b434 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780a5cb0 con 0x7f0374004d10 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037800f040 con 0x7f0374004d10 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f03867fc640 1 -- 172.21.15.18:0/1387462289 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780ad680 con 0x7f0374004d10 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 -- 172.21.15.18:0/1387462289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0374004d10 msgr2=0x7f0374005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 --2- 172.21.15.18:0/1387462289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0374004d10 0x7f0374005180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0378009fc0 tx=0x7f037801cca0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f0387fff640 1 -- 172.21.15.18:0/1387462289 reap_dead start 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 -- 172.21.15.18:0/1387462289 shutdown_connections 2023-06-09T04:38:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 -- 172.21.15.18:0/1387462289 >> 172.21.15.18:0/1387462289 conn(0x7f038806bf30 msgr2=0x7f03880ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 -- 172.21.15.18:0/1387462289 shutdown_connections 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 -- 172.21.15.18:0/1387462289 wait complete. 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 Processor -- start 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.668+0000 7f038dfda640 1 -- start start 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 0x7f038815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038815bb60 0x7f03881efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0388158960 0x7f03881f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03881f07f0 con 0x7f0388158590 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388155c00 con 0x7f0388158960 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0388153340 con 0x7f038815bb60 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 0x7f038815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 0x7f038815c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37382/0 (socket says 172.21.15.18:37382) 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 -- 172.21.15.18:0/2437988143 learned_addr learned my addr 172.21.15.18:0/2437988143 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f0386ffd640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038815bb60 0x7f03881efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f0387fff640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0388158960 0x7f03881f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 -- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038815bb60 msgr2=0x7f03881efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038815bb60 0x7f03881efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 -- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0388158960 msgr2=0x7f03881f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0388158960 0x7f03881f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 -- 172.21.15.18:0/2437988143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038815c040 con 0x7f0388158590 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f0386ffd640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038815bb60 0x7f03881efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f0387fff640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0388158960 0x7f03881f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f03877fe640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 0x7f038815c570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f038000c770 tx=0x7f038000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800074e0 con 0x7f0388158590 2023-06-09T04:38:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380007640 con 0x7f0388158590 2023-06-09T04:38:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0388153590 con 0x7f0388158590 2023-06-09T04:38:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380004a30 con 0x7f0388158590 2023-06-09T04:38:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0388153b50 con 0x7f0388158590 2023-06-09T04:38:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0388153d70 con 0x7f0388158590 2023-06-09T04:38:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0380004b90 con 0x7f0388158590 2023-06-09T04:38:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f037ffff640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03680662b0 0x7f0368068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0380082e00 con 0x7f0388158590 2023-06-09T04:38:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.672+0000 7f0386ffd640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03680662b0 0x7f0368068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.676+0000 7f0386ffd640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03680662b0 0x7f0368068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0388159730 tx=0x7f0370008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.676+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0380050660 con 0x7f0388158590 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:09.824+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f038804dea0 con 0x7f0388158590 2023-06-09T04:38:10.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.140+0000 7f037ffff640 1 -- 172.21.15.18:0/2437988143 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f03800180b0 con 0x7f0388158590 2023-06-09T04:38:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2023-06-09T04:38:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03680662b0 msgr2=0x7f0368068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03680662b0 0x7f0368068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0388159730 tx=0x7f0370008040 comp rx=0 tx=0).stop 2023-06-09T04:38:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 msgr2=0x7f038815c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 0x7f038815c570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f038000c770 tx=0x7f038000cc30 comp rx=0 tx=0).stop 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 shutdown_connections 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0388158960 0x7f03881f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03680662b0 0x7f0368068760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f038815bb60 0x7f03881efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 --2- 172.21.15.18:0/2437988143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0388158590 0x7f038815c570 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 >> 172.21.15.18:0/2437988143 conn(0x7f0374004d10 msgr2=0x7f0388159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 shutdown_connections 2023-06-09T04:38:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.144+0000 7f038dfda640 1 -- 172.21.15.18:0/2437988143 wait complete. 2023-06-09T04:38:10.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-09T04:38:10.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 Processor -- start 2023-06-09T04:38:10.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 -- start start 2023-06-09T04:38:10.308 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face81594e0 0x7face80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7face80c8840 0x7face8070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face8070560 con 0x7face806fbd0 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80ccff0 con 0x7face80c8840 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7faced074640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80cc620 con 0x7face81594e0 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face759e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7face80c8840 0x7face8070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7face806fbd0 0x7face80c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34646/0 (socket says 172.21.15.18:34646) 2023-06-09T04:38:10.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face659c640 1 -- 172.21.15.18:0/3106279460 learned_addr learned my addr 172.21.15.18:0/3106279460 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face6d9d640 1 --2- 172.21.15.18:0/3106279460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face81594e0 0x7face80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face759e640 1 -- 172.21.15.18:0/3106279460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face81594e0 msgr2=0x7face80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face759e640 1 --2- 172.21.15.18:0/3106279460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face81594e0 0x7face80ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face759e640 1 -- 172.21.15.18:0/3106279460 >> v1:172.21.15.18:6789/0 conn(0x7face806fbd0 legacy=0x7face80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face759e640 1 -- 172.21.15.18:0/3106279460 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80cba80 con 0x7face80c8840 2023-06-09T04:38:10.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.304+0000 7face5d9b640 1 -- 172.21.15.18:0/3106279460 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339746540 0 0) 0x7facdc001120 con 0x7face806fbd0 2023-06-09T04:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face759e640 1 --2- 172.21.15.18:0/3106279460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face8070020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7face0009d90 tx=0x7face001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afddf82f6c364ad server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face5d9b640 1 -- 172.21.15.18:0/3106279460 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00a5900 con 0x7face80c8840 2023-06-09T04:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face5d9b640 1 -- 172.21.15.18:0/3106279460 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face00a5a60 con 0x7face80c8840 2023-06-09T04:38:10.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face5d9b640 1 -- 172.21.15.18:0/3106279460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00a5df0 con 0x7face80c8840 2023-06-09T04:38:10.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- 172.21.15.18:0/3106279460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 msgr2=0x7face8070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 --2- 172.21.15.18:0/3106279460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face8070020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7face0009d90 tx=0x7face001c950 comp rx=0 tx=0).stop 2023-06-09T04:38:10.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- 172.21.15.18:0/3106279460 shutdown_connections 2023-06-09T04:38:10.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 --2- 172.21.15.18:0/3106279460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face8070020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 --2- 172.21.15.18:0/3106279460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face81594e0 0x7face80ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- 172.21.15.18:0/3106279460 >> 172.21.15.18:0/3106279460 conn(0x7face80b0320 msgr2=0x7face80cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- 172.21.15.18:0/3106279460 shutdown_connections 2023-06-09T04:38:10.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- 172.21.15.18:0/3106279460 wait complete. 2023-06-09T04:38:10.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 Processor -- start 2023-06-09T04:38:10.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- start start 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face806fbd0 0x7face80c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face814e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81594e0 0x7face814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80c60a0 con 0x7face80c8840 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80c6380 con 0x7face81594e0 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7faced074640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80c6660 con 0x7face806fbd0 2023-06-09T04:38:10.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face814e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face814e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37398/0 (socket says 172.21.15.18:37398) 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face659c640 1 -- 172.21.15.18:0/335589956 learned_addr learned my addr 172.21.15.18:0/335589956 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face6d9d640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face806fbd0 0x7face80c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.308+0000 7face759e640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81594e0 0x7face814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face659c640 1 -- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face806fbd0 msgr2=0x7face80c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face659c640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face806fbd0 0x7face80c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face659c640 1 -- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81594e0 msgr2=0x7face814ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face659c640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81594e0 0x7face814ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face659c640 1 -- 172.21.15.18:0/335589956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009a70 con 0x7face80c8840 2023-06-09T04:38:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face6d9d640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face806fbd0 0x7face80c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face659c640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face814e520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c780 tx=0x7facdc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0072d0 con 0x7face80c8840 2023-06-09T04:38:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc007450 con 0x7face80c8840 2023-06-09T04:38:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faced074640 1 -- 172.21.15.18:0/335589956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80c6940 con 0x7face80c8840 2023-06-09T04:38:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0047f0 con 0x7face80c8840 2023-06-09T04:38:10.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faced074640 1 -- 172.21.15.18:0/335589956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80c7140 con 0x7face80c8840 2023-06-09T04:38:10.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faced074640 1 -- 172.21.15.18:0/335589956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8073380 con 0x7face80c8840 2023-06-09T04:38:10.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facdc00a640 con 0x7face80c8840 2023-06-09T04:38:10.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faccf7fe640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7facd4066280 0x7facd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7facdc083120 con 0x7face80c8840 2023-06-09T04:38:10.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.312+0000 7face6d9d640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7facd4066280 0x7facd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.316+0000 7face6d9d640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7facd4066280 0x7facd4068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7face80b35f0 tx=0x7facd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.316+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facdc0508f0 con 0x7face80c8840 2023-06-09T04:38:10.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:10.472+0000 7faced074640 1 -- 172.21.15.18:0/335589956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7face8070520 con 0x7face80c8840 2023-06-09T04:38:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.156+0000 7faccf7fe640 1 -- 172.21.15.18:0/335589956 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7facdc053f10 con 0x7face80c8840 2023-06-09T04:38:11.162 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2023-06-09T04:38:11.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 -- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7facd4066280 msgr2=0x7facd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7facd4066280 0x7facd4068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7face80b35f0 tx=0x7facd8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:11.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 -- 172.21.15.18:0/335589956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 msgr2=0x7face814e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face814e520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c780 tx=0x7facdc00cc40 comp rx=0 tx=0).stop 2023-06-09T04:38:11.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 -- 172.21.15.18:0/335589956 shutdown_connections 2023-06-09T04:38:11.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7face81594e0 0x7face814ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7face80c8840 0x7face814e520 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7facd4066280 0x7facd4068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 --2- 172.21.15.18:0/335589956 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7face806fbd0 0x7face80c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.164+0000 7faced074640 1 -- 172.21.15.18:0/335589956 >> 172.21.15.18:0/335589956 conn(0x7face80b0320 msgr2=0x7face80ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.188+0000 7faced074640 1 -- 172.21.15.18:0/335589956 shutdown_connections 2023-06-09T04:38:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.188+0000 7faced074640 1 -- 172.21.15.18:0/335589956 wait complete. 2023-06-09T04:38:11.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:38:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 Processor -- start 2023-06-09T04:38:11.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 -- start start 2023-06-09T04:38:11.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45dc15b600 0x7f45dc0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45dc0b40e0 0x7f45dc15f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc15fd40 con 0x7f45dc15f280 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0cfce0 con 0x7f45dc15b600 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e290f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc160020 con 0x7f45dc0b40e0 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45dc15b600 0x7f45dc0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45dc15b600 0x7f45dc0b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37412/0 (socket says 172.21.15.18:37412) 2023-06-09T04:38:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 -- 172.21.15.18:0/1660936399 learned_addr learned my addr 172.21.15.18:0/1660936399 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45e0eac640 1 --2- 172.21.15.18:0/1660936399 >> v2:172.21.15.81:3300/0 conn(0x7f45dc0b40e0 0x7f45dc15f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 -- 172.21.15.18:0/1660936399 >> v2:172.21.15.81:3300/0 conn(0x7f45dc0b40e0 msgr2=0x7f45dc15f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 --2- 172.21.15.18:0/1660936399 >> v2:172.21.15.81:3300/0 conn(0x7f45dc0b40e0 0x7f45dc15f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 -- 172.21.15.18:0/1660936399 >> v1:172.21.15.81:6789/0 conn(0x7f45dc15f280 legacy=0x7f45dc0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.340+0000 7f45dbfff640 1 -- 172.21.15.18:0/1660936399 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0cfef0 con 0x7f45dc15b600 2023-06-09T04:38:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45dbfff640 1 --2- 172.21.15.18:0/1660936399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15b600 0x7f45dc0b4da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45dc15fc40 tx=0x7f45cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486e63cbecfb8ddd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45daffd640 1 -- 172.21.15.18:0/1660936399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0aa610 con 0x7f45dc15b600 2023-06-09T04:38:11.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45daffd640 1 -- 172.21.15.18:0/1660936399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc0a6040 con 0x7f45dc15b600 2023-06-09T04:38:11.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45daffd640 1 -- 172.21.15.18:0/1660936399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0aa990 con 0x7f45dc15b600 2023-06-09T04:38:11.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- 172.21.15.18:0/1660936399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15b600 msgr2=0x7f45dc0b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 --2- 172.21.15.18:0/1660936399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15b600 0x7f45dc0b4da0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45dc15fc40 tx=0x7f45cc01c490 comp rx=0 tx=0).stop 2023-06-09T04:38:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- 172.21.15.18:0/1660936399 shutdown_connections 2023-06-09T04:38:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 --2- 172.21.15.18:0/1660936399 >> v2:172.21.15.81:3300/0 conn(0x7f45dc0b40e0 0x7f45dc15f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 --2- 172.21.15.18:0/1660936399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15b600 0x7f45dc0b4da0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- 172.21.15.18:0/1660936399 >> 172.21.15.18:0/1660936399 conn(0x7f45dc0d2120 msgr2=0x7f45dc0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- 172.21.15.18:0/1660936399 shutdown_connections 2023-06-09T04:38:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- 172.21.15.18:0/1660936399 wait complete. 2023-06-09T04:38:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 Processor -- start 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- start start 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45dc0b40e0 0x7f45dc1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45dc15b600 0x7f45dc141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 0x7f45dc156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0c87e0 con 0x7f45dc15f280 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc156f80 con 0x7f45dc15b600 2023-06-09T04:38:11.351 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e290f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc152ea0 con 0x7f45dc0b40e0 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e0eac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 0x7f45dc156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e0eac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 0x7f45dc156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37418/0 (socket says 172.21.15.18:37418) 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45e0eac640 1 -- 172.21.15.18:0/1041259099 learned_addr learned my addr 172.21.15.18:0/1041259099 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45db7fe640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45dc15b600 0x7f45dc141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.344+0000 7f45dbfff640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45dc0b40e0 0x7f45dc1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e0eac640 1 -- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45dc0b40e0 msgr2=0x7f45dc1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e0eac640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45dc0b40e0 0x7f45dc1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.352 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e0eac640 1 -- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45dc15b600 msgr2=0x7f45dc141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e0eac640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45dc15b600 0x7f45dc141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e0eac640 1 -- 172.21.15.18:0/1041259099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0094d0 con 0x7f45dc15f280 2023-06-09T04:38:11.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e0eac640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 0x7f45dc156260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45d400cd20 tx=0x7f45d400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4003ba0 con 0x7f45dc15f280 2023-06-09T04:38:11.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d4003d00 con 0x7f45dc15f280 2023-06-09T04:38:11.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc153180 con 0x7f45dc15f280 2023-06-09T04:38:11.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4004240 con 0x7f45dc15f280 2023-06-09T04:38:11.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc153740 con 0x7f45dc15f280 2023-06-09T04:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc073380 con 0x7f45dc15f280 2023-06-09T04:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45d40043a0 con 0x7f45dc15f280 2023-06-09T04:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45d8ff9640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f45c8066280 0x7f45c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f45d4012070 con 0x7f45dc15f280 2023-06-09T04:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.348+0000 7f45dbfff640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f45c8066280 0x7f45c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.352+0000 7f45dbfff640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f45c8066280 0x7f45c8068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ae000 tx=0x7f45cc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.352+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45d4052030 con 0x7f45dc15f280 2023-06-09T04:38:11.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.540+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45dc06a7d0 con 0x7f45dc15f280 2023-06-09T04:38:11.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.564+0000 7f45d8ff9640 1 -- 172.21.15.18:0/1041259099 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f45d4055650 con 0x7f45dc15f280 2023-06-09T04:38:11.572 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 3 and data pool 4 2023-06-09T04:38:11.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f45c8066280 msgr2=0x7f45c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f45c8066280 0x7f45c8068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ae000 tx=0x7f45cc0a7000 comp rx=0 tx=0).stop 2023-06-09T04:38:11.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 msgr2=0x7f45dc156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 0x7f45dc156260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45d400cd20 tx=0x7f45d400a660 comp rx=0 tx=0).stop 2023-06-09T04:38:11.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 shutdown_connections 2023-06-09T04:38:11.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45dc15f280 0x7f45dc156260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45dc15b600 0x7f45dc141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f45c8066280 0x7f45c8068730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 --2- 172.21.15.18:0/1041259099 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45dc0b40e0 0x7f45dc1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 >> 172.21.15.18:0/1041259099 conn(0x7f45dc0d2120 msgr2=0x7f45dc15c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 shutdown_connections 2023-06-09T04:38:11.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.580+0000 7f45e290f640 1 -- 172.21.15.18:0/1041259099 wait complete. 2023-06-09T04:38:11.611 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-09T04:38:11.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-09T04:38:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 Processor -- start 2023-06-09T04:38:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 -- start start 2023-06-09T04:38:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 0x7fd49806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd49806fac0 0x7fd49806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49806d800 con 0x7fd498142fe0 2023-06-09T04:38:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980cc190 con 0x7fd49806fac0 2023-06-09T04:38:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49cd77640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd498159cc0 con 0x7fd4980cbd60 2023-06-09T04:38:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd498142fe0 0x7fd49806b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34662/0 (socket says 172.21.15.18:34662) 2023-06-09T04:38:11.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49659c640 1 -- 172.21.15.18:0/1626985053 learned_addr learned my addr 172.21.15.18:0/1626985053 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd495d9b640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 0x7fd49806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd496d9d640 1 --2- 172.21.15.18:0/1626985053 >> v2:172.21.15.81:3300/0 conn(0x7fd49806fac0 0x7fd49806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.732+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024723883 0 0) 0x7fd488001120 con 0x7fd498142fe0 2023-06-09T04:38:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480003530 con 0x7fd498142fe0 2023-06-09T04:38:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697413776 0 0) 0x7fd480003530 con 0x7fd498142fe0 2023-06-09T04:38:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 msgr2=0x7fd49806d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 0x7fd49806d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 >> v2:172.21.15.81:3300/0 conn(0x7fd49806fac0 msgr2=0x7fd49806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 --2- 172.21.15.18:0/1626985053 >> v2:172.21.15.81:3300/0 conn(0x7fd49806fac0 0x7fd49806fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498070420 con 0x7fd498142fe0 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fd488001810 con 0x7fd498142fe0 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 >> v1:172.21.15.18:6789/0 conn(0x7fd498142fe0 legacy=0x7fd49806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd480003980 0x7fd480003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 0x7fd4800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd480004d10 0x7fd480005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980cc190 con 0x7fd480003980 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd498159cc0 con 0x7fd480004d10 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48000b990 con 0x7fd4980cbd60 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd480003980 0x7fd480003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd495d9b640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 0x7fd4800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd496d9d640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd480004d10 0x7fd480005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 -- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 msgr2=0x7fd4800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd4980cbd60 0x7fd4800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 -- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd480004d10 msgr2=0x7fd480005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd480004d10 0x7fd480005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 -- 172.21.15.18:0/1626985053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480003530 con 0x7fd480003980 2023-06-09T04:38:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd496d9d640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd480004d10 0x7fd480005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:11.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49659c640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd480003980 0x7fd480003d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd48800c240 tx=0x7fd48801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f3248b99fea936 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488005ae0 con 0x7fd480003980 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4880ab070 con 0x7fd480003980 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.736+0000 7fd49559a640 1 -- 172.21.15.18:0/1626985053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488005ea0 con 0x7fd480003980 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/1626985053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd480003980 msgr2=0x7fd480003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 --2- 172.21.15.18:0/1626985053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd480003980 0x7fd480003d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd48800c240 tx=0x7fd48801f350 comp rx=0 tx=0).stop 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd496d9d640 1 -- 172.21.15.18:0/1626985053 reap_dead start 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/1626985053 shutdown_connections 2023-06-09T04:38:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/1626985053 >> 172.21.15.18:0/1626985053 conn(0x7fd4980cda10 msgr2=0x7fd4980cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/1626985053 shutdown_connections 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/1626985053 wait complete. 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 Processor -- start 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- start start 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd480003980 0x7fd4980c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 0x7fd4980c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4980c2440 0x7fd49815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980c6c60 con 0x7fd4980c3b50 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980c3ff0 con 0x7fd4980c2440 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980c65a0 con 0x7fd480003980 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 0x7fd4980c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 0x7fd4980c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37430/0 (socket says 172.21.15.18:37430) 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 -- 172.21.15.18:0/3580623124 learned_addr learned my addr 172.21.15.18:0/3580623124 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49659c640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd480003980 0x7fd4980c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd496d9d640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4980c2440 0x7fd49815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 -- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd480003980 msgr2=0x7fd4980c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd480003980 0x7fd4980c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 -- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4980c2440 msgr2=0x7fd49815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4980c2440 0x7fd49815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 -- 172.21.15.18:0/3580623124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980c6880 con 0x7fd4980c3b50 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd495d9b640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 0x7fd4980c7080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0119d0 tx=0x7fd48c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00fb50 con 0x7fd4980c3b50 2023-06-09T04:38:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00fcb0 con 0x7fd4980c3b50 2023-06-09T04:38:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4980c42d0 con 0x7fd4980c3b50 2023-06-09T04:38:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c014440 con 0x7fd4980c3b50 2023-06-09T04:38:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.740+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4980c7790 con 0x7fd4980c3b50 2023-06-09T04:38:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.744+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4980c6da0 con 0x7fd4980c3b50 2023-06-09T04:38:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.744+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd48c0145a0 con 0x7fd4980c3b50 2023-06-09T04:38:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.744+0000 7fd486ffd640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4780662b0 0x7fd478068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.744+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd48c0846d0 con 0x7fd4980c3b50 2023-06-09T04:38:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.744+0000 7fd49659c640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4780662b0 0x7fd478068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.744+0000 7fd49659c640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4780662b0 0x7fd478068760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4880ae000 tx=0x7fd488001c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.748+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4980c6da0 con 0x7fd4980c3b50 2023-06-09T04:38:11.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:11.908+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd4980c6da0 con 0x7fd4980c3b50 2023-06-09T04:38:12.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:12.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:12.565 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.560+0000 7fd486ffd640 1 -- 172.21.15.18:0/3580623124 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd4980c6da0 con 0x7fd4980c3b50 2023-06-09T04:38:12.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4780662b0 msgr2=0x7fd478068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4780662b0 0x7fd478068760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4880ae000 tx=0x7fd488001c10 comp rx=0 tx=0).stop 2023-06-09T04:38:12.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 msgr2=0x7fd4980c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 0x7fd4980c7080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0119d0 tx=0x7fd48c011e90 comp rx=0 tx=0).stop 2023-06-09T04:38:12.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 shutdown_connections 2023-06-09T04:38:12.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4980c2440 0x7fd49815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4980c3b50 0x7fd4980c7080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4780662b0 0x7fd478068760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 --2- 172.21.15.18:0/3580623124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd480003980 0x7fd4980c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 >> 172.21.15.18:0/3580623124 conn(0x7fd4980cda10 msgr2=0x7fd4980b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 shutdown_connections 2023-06-09T04:38:12.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.564+0000 7fd49cd77640 1 -- 172.21.15.18:0/3580623124 wait complete. 2023-06-09T04:38:12.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:38:12.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe1266dc640 1 Processor -- start 2023-06-09T04:38:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe1266dc640 1 -- start start 2023-06-09T04:38:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe1266dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe120159720 0x7fe12015c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe1266dc640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12015c640 con 0x7fe120152be0 2023-06-09T04:38:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe1266dc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe120152fb0 con 0x7fe1200b0550 2023-06-09T04:38:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe1266dc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12015c8e0 con 0x7fe120159720 2023-06-09T04:38:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe120152be0 0x7fe1200cc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34678/0 (socket says 172.21.15.18:34678) 2023-06-09T04:38:12.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11ffff640 1 -- 172.21.15.18:0/919604169 learned_addr learned my addr 172.21.15.18:0/919604169 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913541158 0 0) 0x7fe12015c640 con 0x7fe120152be0 2023-06-09T04:38:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11f7fe640 1 --2- 172.21.15.18:0/919604169 >> v2:172.21.15.81:3300/0 conn(0x7fe120159720 0x7fe12015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe108003530 con 0x7fe120152be0 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139296422 0 0) 0x7fe108003530 con 0x7fe120152be0 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 >> v2:172.21.15.81:3300/0 conn(0x7fe120159720 msgr2=0x7fe12015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 --2- 172.21.15.18:0/919604169 >> v2:172.21.15.81:3300/0 conn(0x7fe120159720 0x7fe12015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 >> v1:172.21.15.81:6789/0 conn(0x7fe1200b0550 legacy=0x7fe1200ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12015cbc0 con 0x7fe120152be0 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fe110001800 con 0x7fe120152be0 2023-06-09T04:38:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 >> v1:172.21.15.18:6789/0 conn(0x7fe120152be0 legacy=0x7fe1200cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe108003ab0 0x7fe108003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1080047d0 0x7fe108004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe10800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015c8e0 con 0x7fe1080051f0 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800c130 con 0x7fe1080047d0 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800c2f0 con 0x7fe108003ab0 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe124c79640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe10800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11f7fe640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1080047d0 0x7fe108004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe11ffff640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe108003ab0 0x7fe108003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe124c79640 1 -- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe108003ab0 msgr2=0x7fe108003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe124c79640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe108003ab0 0x7fe108003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe124c79640 1 -- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1080047d0 msgr2=0x7fe108004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe124c79640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1080047d0 0x7fe108004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.728+0000 7fe124c79640 1 -- 172.21.15.18:0/919604169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108003530 con 0x7fe1080051f0 2023-06-09T04:38:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe124c79640 1 -- 172.21.15.18:0/919604169 reap_dead start 2023-06-09T04:38:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe124c79640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe10800b990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe118001e70 tx=0x7fe11801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40261f500d419c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118003b80 con 0x7fe1080051f0 2023-06-09T04:38:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118003d20 con 0x7fe1080051f0 2023-06-09T04:38:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe11effd640 1 -- 172.21.15.18:0/919604169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118005260 con 0x7fe1080051f0 2023-06-09T04:38:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 -- 172.21.15.18:0/919604169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 msgr2=0x7fe10800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe10800b990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe118001e70 tx=0x7fe11801c760 comp rx=0 tx=0).stop 2023-06-09T04:38:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 -- 172.21.15.18:0/919604169 shutdown_connections 2023-06-09T04:38:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 --2- 172.21.15.18:0/919604169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe10800b990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 -- 172.21.15.18:0/919604169 >> 172.21.15.18:0/919604169 conn(0x7fe12006d8b0 msgr2=0x7fe1200cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 -- 172.21.15.18:0/919604169 shutdown_connections 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 -- 172.21.15.18:0/919604169 wait complete. 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 Processor -- start 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.732+0000 7fe1266dc640 1 -- start start 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe120147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1201f1450 0x7fe120150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1201575b0 0x7fe120157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120157f90 con 0x7fe1080051f0 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12006ba60 con 0x7fe1201575b0 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe120069850 con 0x7fe1201f1450 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe120147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe120147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37446/0 (socket says 172.21.15.18:37446) 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 -- 172.21.15.18:0/4027624604 learned_addr learned my addr 172.21.15.18:0/4027624604 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe124c79640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1201575b0 0x7fe120157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11f7fe640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1201f1450 0x7fe120150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 -- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1201f1450 msgr2=0x7fe120150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1201f1450 0x7fe120150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 -- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1201575b0 msgr2=0x7fe120157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1201575b0 0x7fe120157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 -- 172.21.15.18:0/4027624604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1201f19c0 con 0x7fe1080051f0 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe124c79640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1201575b0 0x7fe120157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:12.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11ffff640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe120147870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe11000f770 tx=0x7fe11000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100072e0 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110007440 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100057b0 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1201f1ca0 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1201f2260 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe120069a10 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe110005910 con 0x7fe1080051f0 2023-06-09T04:38:12.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11cff9640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe10c0662b0 0x7fe10c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fe110083f60 con 0x7fe1080051f0 2023-06-09T04:38:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.736+0000 7fe11f7fe640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe10c0662b0 0x7fe10c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.740+0000 7fe11f7fe640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe10c0662b0 0x7fe10c068760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1200cd160 tx=0x7fe114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.740+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe110051310 con 0x7fe1080051f0 2023-06-09T04:38:12.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:12.896+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe12004dea0 con 0x7fe1080051f0 2023-06-09T04:38:13.134 INFO:tasks.ceph.mds.b.smithi081.stderr:2023-06-09T04:38:13.129+0000 7f989636e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:38:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.575+0000 7fe11cff9640 1 -- 172.21.15.18:0/4027624604 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7fe110054930 con 0x7fe1080051f0 2023-06-09T04:38:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2023-06-09T04:38:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe10c0662b0 msgr2=0x7fe10c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe10c0662b0 0x7fe10c068760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1200cd160 tx=0x7fe114008040 comp rx=0 tx=0).stop 2023-06-09T04:38:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 msgr2=0x7fe120147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe120147870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe11000f770 tx=0x7fe11000fc30 comp rx=0 tx=0).stop 2023-06-09T04:38:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 shutdown_connections 2023-06-09T04:38:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1201575b0 0x7fe120157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe10c0662b0 0x7fe10c068760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1201f1450 0x7fe120150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 --2- 172.21.15.18:0/4027624604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1080051f0 0x7fe120147870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 >> 172.21.15.18:0/4027624604 conn(0x7fe12006d8b0 msgr2=0x7fe1200cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 shutdown_connections 2023-06-09T04:38:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.587+0000 7fe1266dc640 1 -- 172.21.15.18:0/4027624604 wait complete. 2023-06-09T04:38:14.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-09T04:38:14.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5663aae640 1 Processor -- start 2023-06-09T04:38:14.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5663aae640 1 -- start start 2023-06-09T04:38:14.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5663aae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f565c0cbd60 0x7f565c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5663aae640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c06d800 con 0x7f565c142fe0 2023-06-09T04:38:14.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5663aae640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c159cc0 con 0x7f565c06fac0 2023-06-09T04:38:14.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5663aae640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0cc1c0 con 0x7f565c0cbd60 2023-06-09T04:38:14.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566184a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f565c142fe0 0x7f565c06b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34682/0 (socket says 172.21.15.18:34682) 2023-06-09T04:38:14.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566184a640 1 -- 172.21.15.18:0/4194958163 learned_addr learned my addr 172.21.15.18:0/4194958163 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5661049640 1 --2- 172.21.15.18:0/4194958163 >> v2:172.21.15.81:3300/0 conn(0x7f565c0cbd60 0x7f565c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835094346 0 0) 0x7f5658001120 con 0x7f565c142fe0 2023-06-09T04:38:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5648003530 con 0x7f565c142fe0 2023-06-09T04:38:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293307363 0 0) 0x7f5648003530 con 0x7f565c142fe0 2023-06-09T04:38:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 >> v2:172.21.15.81:3300/0 conn(0x7f565c0cbd60 msgr2=0x7f565c06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 --2- 172.21.15.18:0/4194958163 >> v2:172.21.15.81:3300/0 conn(0x7f565c0cbd60 0x7f565c06d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 >> v1:172.21.15.81:6789/0 conn(0x7f565c06fac0 legacy=0x7f565c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c06c220 con 0x7f565c142fe0 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f5658001810 con 0x7f565c142fe0 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 >> v1:172.21.15.18:6789/0 conn(0x7f565c142fe0 legacy=0x7f565c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648003980 0x7f5648003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56480047d0 0x7f5648004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5648005180 0x7f564800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0cc1c0 con 0x7f5648005180 2023-06-09T04:38:14.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564800bfe0 con 0x7f56480047d0 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564800c1a0 con 0x7f5648003980 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566204b640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5648005180 0x7f564800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f5661049640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56480047d0 0x7f5648004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566184a640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648003980 0x7f5648003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566204b640 1 -- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648003980 msgr2=0x7f5648003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566204b640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648003980 0x7f5648003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566204b640 1 -- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56480047d0 msgr2=0x7f5648004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566204b640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56480047d0 0x7f5648004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.743+0000 7f566204b640 1 -- 172.21.15.18:0/4194958163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648003530 con 0x7f5648005180 2023-06-09T04:38:14.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f566204b640 1 -- 172.21.15.18:0/4194958163 reap_dead start 2023-06-09T04:38:14.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f566204b640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5648005180 0x7f564800b990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5654001e40 tx=0x7f565401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef9714639134a4f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654003b80 con 0x7f5648005180 2023-06-09T04:38:14.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654003ce0 con 0x7f5648005180 2023-06-09T04:38:14.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5660848640 1 -- 172.21.15.18:0/4194958163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654005260 con 0x7f5648005180 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 -- 172.21.15.18:0/4194958163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5648005180 msgr2=0x7f564800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5648005180 0x7f564800b990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5654001e40 tx=0x7f565401c740 comp rx=0 tx=0).stop 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 -- 172.21.15.18:0/4194958163 shutdown_connections 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 --2- 172.21.15.18:0/4194958163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5648005180 0x7f564800b990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 -- 172.21.15.18:0/4194958163 >> 172.21.15.18:0/4194958163 conn(0x7f565c0cda10 msgr2=0x7f565c0cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 -- 172.21.15.18:0/4194958163 shutdown_connections 2023-06-09T04:38:14.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 -- 172.21.15.18:0/4194958163 wait complete. 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 Processor -- start 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.747+0000 7f5663aae640 1 -- start start 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648005180 0x7f565c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 0x7f565c0c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565c0c3930 0x7f565c1f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c153750 con 0x7f565c1f2cd0 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c153a30 con 0x7f565c0c3930 2023-06-09T04:38:14.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c153d10 con 0x7f5648005180 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 0x7f565c0c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 0x7f565c0c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37456/0 (socket says 172.21.15.18:37456) 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 -- 172.21.15.18:0/555370538 learned_addr learned my addr 172.21.15.18:0/555370538 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f566184a640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648005180 0x7f565c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f566204b640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565c0c3930 0x7f565c1f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 -- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648005180 msgr2=0x7f565c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648005180 0x7f565c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 -- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565c0c3930 msgr2=0x7f565c1f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565c0c3930 0x7f565c1f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 -- 172.21.15.18:0/555370538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0c4ae0 con 0x7f565c1f2cd0 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f566204b640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565c0c3930 0x7f565c1f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f566184a640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648005180 0x7f565c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5661049640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 0x7f565c0c5f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f564c011560 tx=0x7f564c011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c015930 con 0x7f565c1f2cd0 2023-06-09T04:38:14.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c015a90 con 0x7f565c1f2cd0 2023-06-09T04:38:14.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c015e60 con 0x7f565c1f2cd0 2023-06-09T04:38:14.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c0c4dc0 con 0x7f565c1f2cd0 2023-06-09T04:38:14.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c0c64d0 con 0x7f565c1f2cd0 2023-06-09T04:38:14.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c04dea0 con 0x7f565c1f2cd0 2023-06-09T04:38:14.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f564c00f460 con 0x7f565c1f2cd0 2023-06-09T04:38:14.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f56527fc640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5640066280 0x7f5640068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f564c0847b0 con 0x7f565c1f2cd0 2023-06-09T04:38:14.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.751+0000 7f566184a640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5640066280 0x7f5640068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.755+0000 7f566184a640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5640066280 0x7f5640068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5658001280 tx=0x7f5658009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.755+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f564c055480 con 0x7f565c1f2cd0 2023-06-09T04:38:14.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:14.911+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f565c153890 con 0x7f565c1f2cd0 2023-06-09T04:38:15.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.583+0000 7f56527fc640 1 -- 172.21.15.18:0/555370538 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f565c153890 con 0x7f565c1f2cd0 2023-06-09T04:38:15.590 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 5 allow_ec_overwrites to true 2023-06-09T04:38:15.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.591+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5640066280 msgr2=0x7f5640068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.591+0000 7f5663aae640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5640066280 0x7f5640068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5658001280 tx=0x7f5658009040 comp rx=0 tx=0).stop 2023-06-09T04:38:15.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.591+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 msgr2=0x7f565c0c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.591+0000 7f5663aae640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 0x7f565c0c5f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f564c011560 tx=0x7f564c011a20 comp rx=0 tx=0).stop 2023-06-09T04:38:15.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 shutdown_connections 2023-06-09T04:38:15.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565c0c3930 0x7f565c1f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f565c1f2cd0 0x7f565c0c5f90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5640066280 0x7f5640068730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 --2- 172.21.15.18:0/555370538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5648005180 0x7f565c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 >> 172.21.15.18:0/555370538 conn(0x7f565c0cda10 msgr2=0x7f565c0c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 shutdown_connections 2023-06-09T04:38:15.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.599+0000 7f5663aae640 1 -- 172.21.15.18:0/555370538 wait complete. 2023-06-09T04:38:15.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-09T04:38:15.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.763+0000 7f82ee703640 1 Processor -- start 2023-06-09T04:38:15.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.763+0000 7f82ee703640 1 -- start start 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e81591c0 0x7f82e80cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82e80acdf0 0x7f82e80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e815de50 con 0x7f82e8159590 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e815d2d0 con 0x7f82e80acdf0 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e815d5b0 con 0x7f82e81591c0 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ecca0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82e80acdf0 0x7f82e80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82dffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f82e8159590 0x7f82e806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34696/0 (socket says 172.21.15.18:34696) 2023-06-09T04:38:15.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82dffff640 1 -- 172.21.15.18:0/2582145304 learned_addr learned my addr 172.21.15.18:0/2582145304 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:15.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82e7fff640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e81591c0 0x7f82e80cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ecca0640 1 -- 172.21.15.18:0/2582145304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e81591c0 msgr2=0x7f82e80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:15.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ecca0640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e81591c0 0x7f82e80cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ecca0640 1 -- 172.21.15.18:0/2582145304 >> v1:172.21.15.18:6789/0 conn(0x7f82e8159590 legacy=0x7f82e806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ecca0640 1 -- 172.21.15.18:0/2582145304 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e815d890 con 0x7f82e80acdf0 2023-06-09T04:38:15.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82e77fe640 1 -- 172.21.15.18:0/2582145304 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169609535 0 0) 0x7f82e815de50 con 0x7f82e8159590 2023-06-09T04:38:15.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82e7fff640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e81591c0 0x7f82e80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ecca0640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e80acdf0 0x7f82e80cbb70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009d90 tx=0x7f82e001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4640d03d7b3891 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82e77fe640 1 -- 172.21.15.18:0/2582145304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00a58f0 con 0x7f82e80acdf0 2023-06-09T04:38:15.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82e77fe640 1 -- 172.21.15.18:0/2582145304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00a5a50 con 0x7f82e80acdf0 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82e77fe640 1 -- 172.21.15.18:0/2582145304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00a5de0 con 0x7f82e80acdf0 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- 172.21.15.18:0/2582145304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e80acdf0 msgr2=0x7f82e80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e80acdf0 0x7f82e80cbb70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009d90 tx=0x7f82e001c920 comp rx=0 tx=0).stop 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- 172.21.15.18:0/2582145304 shutdown_connections 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e80acdf0 0x7f82e80cbb70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 --2- 172.21.15.18:0/2582145304 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e81591c0 0x7f82e80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- 172.21.15.18:0/2582145304 >> 172.21.15.18:0/2582145304 conn(0x7f82e80afa90 msgr2=0x7f82e80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- 172.21.15.18:0/2582145304 shutdown_connections 2023-06-09T04:38:15.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.767+0000 7f82ee703640 1 -- 172.21.15.18:0/2582145304 wait complete. 2023-06-09T04:38:15.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 Processor -- start 2023-06-09T04:38:15.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- start start 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e80acdf0 0x7f82e80b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 0x7f82e80b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e8159590 0x7f82e814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80b2b00 con 0x7f82e81591c0 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80b2da0 con 0x7f82e80acdf0 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e81532e0 con 0x7f82e8159590 2023-06-09T04:38:15.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 0x7f82e80b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 0x7f82e80b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37476/0 (socket says 172.21.15.18:37476) 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 -- 172.21.15.18:0/775006950 learned_addr learned my addr 172.21.15.18:0/775006950 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ecca0640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e8159590 0x7f82e814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82e7fff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e80acdf0 0x7f82e80b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 -- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e8159590 msgr2=0x7f82e814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e8159590 0x7f82e814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 -- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e80acdf0 msgr2=0x7f82e80b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e80acdf0 0x7f82e80b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 -- 172.21.15.18:0/775006950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009a70 con 0x7f82e81591c0 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ecca0640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e8159590 0x7f82e814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82e7fff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e80acdf0 0x7f82e80b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82dffff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 0x7f82e80b0bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c480 tx=0x7f82d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00074e0 con 0x7f82e81591c0 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0007660 con 0x7f82e81591c0 2023-06-09T04:38:15.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e81535c0 con 0x7f82e81591c0 2023-06-09T04:38:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0004a30 con 0x7f82e81591c0 2023-06-09T04:38:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e8153b80 con 0x7f82e81591c0 2023-06-09T04:38:15.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.771+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e8073380 con 0x7f82e81591c0 2023-06-09T04:38:15.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.775+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82d0004b90 con 0x7f82e81591c0 2023-06-09T04:38:15.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.775+0000 7f82e57fa640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82c8066280 0x7f82c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.775+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f82d0083160 con 0x7f82e81591c0 2023-06-09T04:38:15.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.775+0000 7f82e7fff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82c8066280 0x7f82c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.775+0000 7f82e7fff640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82c8066280 0x7f82c8068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006fd0 tx=0x7f82d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.779+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82d0053e30 con 0x7f82e81591c0 2023-06-09T04:38:15.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.967+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f82e80ccbd0 con 0x7f82e81591c0 2023-06-09T04:38:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.975+0000 7f82e57fa640 1 -- 172.21.15.18:0/775006950 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f82d00539c0 con 0x7f82e81591c0 2023-06-09T04:38:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 5 to fsmap 2023-06-09T04:38:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82c8066280 msgr2=0x7f82c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82c8066280 0x7f82c8068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006fd0 tx=0x7f82d8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 msgr2=0x7f82e80b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 0x7f82e80b0bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c480 tx=0x7f82d000c940 comp rx=0 tx=0).stop 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 shutdown_connections 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82c8066280 0x7f82c8068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82e8159590 0x7f82e814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82e81591c0 0x7f82e80b0bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 --2- 172.21.15.18:0/775006950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82e80acdf0 0x7f82e80b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 >> 172.21.15.18:0/775006950 conn(0x7f82e80afa90 msgr2=0x7f82e80cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 shutdown_connections 2023-06-09T04:38:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:15.979+0000 7f82ee703640 1 -- 172.21.15.18:0/775006950 wait complete. 2023-06-09T04:38:16.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:16.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 Processor -- start 2023-06-09T04:38:16.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 -- start start 2023-06-09T04:38:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f5415cd00 0x7f1f540b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.124 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 0x7f1f540b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f540ca4a0 con 0x7f1f540b4590 2023-06-09T04:38:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f540cfa90 con 0x7f1f5415cd00 2023-06-09T04:38:16.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f58ce5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540cf280 con 0x7f1f5406e3f0 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 0x7f1f540b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f5259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f5415cd00 0x7f1f540b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 0x7f1f540b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:57462/0 (socket says 172.21.15.18:57462) 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 -- 172.21.15.18:0/4099907781 learned_addr learned my addr 172.21.15.18:0/4099907781 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 -- 172.21.15.18:0/4099907781 >> v2:172.21.15.81:3300/0 conn(0x7f1f5415cd00 msgr2=0x7f1f540b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 --2- 172.21.15.18:0/4099907781 >> v2:172.21.15.81:3300/0 conn(0x7f1f5415cd00 0x7f1f540b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 -- 172.21.15.18:0/4099907781 >> v1:172.21.15.81:6789/0 conn(0x7f1f540b4590 legacy=0x7f1f540b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f4bfff640 1 -- 172.21.15.18:0/4099907781 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540ca010 con 0x7f1f5406e3f0 2023-06-09T04:38:16.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.119+0000 7f1f5259c640 1 --2- 172.21.15.18:0/4099907781 >> v2:172.21.15.81:3300/0 conn(0x7f1f5415cd00 0x7f1f540b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:16.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f4bfff640 1 --2- 172.21.15.18:0/4099907781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 0x7f1f540b4050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009870 tx=0x7f1f3c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6084bfa65473033b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.128 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f51d9b640 1 -- 172.21.15.18:0/4099907781 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0ab600 con 0x7f1f5406e3f0 2023-06-09T04:38:16.128 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f51d9b640 1 -- 172.21.15.18:0/4099907781 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0a7050 con 0x7f1f5406e3f0 2023-06-09T04:38:16.128 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f51d9b640 1 -- 172.21.15.18:0/4099907781 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0ab980 con 0x7f1f5406e3f0 2023-06-09T04:38:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 -- 172.21.15.18:0/4099907781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 msgr2=0x7f1f540b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/4099907781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 0x7f1f540b4050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009870 tx=0x7f1f3c01c4b0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 -- 172.21.15.18:0/4099907781 shutdown_connections 2023-06-09T04:38:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/4099907781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f5406e3f0 0x7f1f540b4050 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/4099907781 >> v2:172.21.15.81:3300/0 conn(0x7f1f5415cd00 0x7f1f540b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 -- 172.21.15.18:0/4099907781 >> 172.21.15.18:0/4099907781 conn(0x7f1f540b2720 msgr2=0x7f1f540ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 -- 172.21.15.18:0/4099907781 shutdown_connections 2023-06-09T04:38:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 -- 172.21.15.18:0/4099907781 wait complete. 2023-06-09T04:38:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 Processor -- start 2023-06-09T04:38:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.123+0000 7f1f58ce5640 1 -- start start 2023-06-09T04:38:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5406e3f0 0x7f1f54163b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f540b4590 0x7f1f54161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 0x7f1f5414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540ce040 con 0x7f1f5415cd00 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5414ec10 con 0x7f1f5406e3f0 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54156210 con 0x7f1f540b4590 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 0x7f1f5414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 0x7f1f5414e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37486/0 (socket says 172.21.15.18:37486) 2023-06-09T04:38:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 -- 172.21.15.18:0/2722122961 learned_addr learned my addr 172.21.15.18:0/2722122961 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f5259c640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5406e3f0 0x7f1f54163b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4bfff640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f540b4590 0x7f1f54161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 -- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f540b4590 msgr2=0x7f1f54161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f540b4590 0x7f1f54161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 -- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5406e3f0 msgr2=0x7f1f54163b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5406e3f0 0x7f1f54163b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 -- 172.21.15.18:0/2722122961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009420 con 0x7f1f5415cd00 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4bfff640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f540b4590 0x7f1f54161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f52d9d640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 0x7f1f5414e6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c710 tx=0x7f1f4c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c006d60 con 0x7f1f5415cd00 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00ce20 con 0x7f1f5415cd00 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0094d0 con 0x7f1f5415cd00 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c003bc0 con 0x7f1f5415cd00 2023-06-09T04:38:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f540ce290 con 0x7f1f5415cd00 2023-06-09T04:38:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f541566c0 con 0x7f1f5415cd00 2023-06-09T04:38:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f4c003d20 con 0x7f1f5415cd00 2023-06-09T04:38:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4affd640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f34066280 0x7f1f34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f4c0848d0 con 0x7f1f5415cd00 2023-06-09T04:38:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.127+0000 7f1f5259c640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f34066280 0x7f1f34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.131+0000 7f1f5259c640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f34066280 0x7f1f34068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009c50 tx=0x7f1f44009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.131+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f4c055580 con 0x7f1f5415cd00 2023-06-09T04:38:16.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.319+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f540caca0 con 0x7f1f5415cd00 2023-06-09T04:38:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.319+0000 7f1f4affd640 1 -- 172.21.15.18:0/2722122961 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f1f4c055110 con 0x7f1f5415cd00 2023-06-09T04:38:16.326 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:16.326 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:15.975182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-09T04:38:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2023-06-09T04:38:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f34066280 msgr2=0x7f1f34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f34066280 0x7f1f34068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009c50 tx=0x7f1f44009190 comp rx=0 tx=0).stop 2023-06-09T04:38:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 msgr2=0x7f1f5414e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 0x7f1f5414e6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c710 tx=0x7f1f4c00cbd0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 shutdown_connections 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5415cd00 0x7f1f5414e6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f34066280 0x7f1f34068730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f540b4590 0x7f1f54161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 --2- 172.21.15.18:0/2722122961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5406e3f0 0x7f1f54163b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 >> 172.21.15.18:0/2722122961 conn(0x7f1f540b2720 msgr2=0x7f1f540ad560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 shutdown_connections 2023-06-09T04:38:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.323+0000 7f1f58ce5640 1 -- 172.21.15.18:0/2722122961 wait complete. 2023-06-09T04:38:16.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:16.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 Processor -- start 2023-06-09T04:38:16.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 -- start start 2023-06-09T04:38:16.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90f015cd00 0x7f90f00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f90f00abb50 0x7f90f00abf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00ca4a0 con 0x7f90f006e3f0 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00cfa90 con 0x7f90f00abb50 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f6819640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00cf280 con 0x7f90f015cd00 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f4db6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f90f00abb50 0x7f90f00abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90ef7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f90f006e3f0 0x7f90f00b4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34708/0 (socket says 172.21.15.18:34708) 2023-06-09T04:38:16.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90ef7fe640 1 -- 172.21.15.18:0/3284633397 learned_addr learned my addr 172.21.15.18:0/3284633397 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f4db6640 1 --2- 172.21.15.18:0/3284633397 >> v2:172.21.15.18:3300/0 conn(0x7f90f00abb50 0x7f90f00abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37500/0 (socket says 172.21.15.18:37500) 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90effff640 1 --2- 172.21.15.18:0/3284633397 >> v2:172.21.15.81:3300/0 conn(0x7f90f015cd00 0x7f90f00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f4db6640 1 -- 172.21.15.18:0/3284633397 >> v2:172.21.15.81:3300/0 conn(0x7f90f015cd00 msgr2=0x7f90f00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f4db6640 1 --2- 172.21.15.18:0/3284633397 >> v2:172.21.15.81:3300/0 conn(0x7f90f015cd00 0x7f90f00b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f4db6640 1 -- 172.21.15.18:0/3284633397 >> v1:172.21.15.18:6789/0 conn(0x7f90f006e3f0 legacy=0x7f90f00b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90eeffd640 1 -- 172.21.15.18:0/3284633397 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691974724 0 0) 0x7f90f00ca4a0 con 0x7f90f006e3f0 2023-06-09T04:38:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.459+0000 7f90f4db6640 1 -- 172.21.15.18:0/3284633397 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00ca010 con 0x7f90f00abb50 2023-06-09T04:38:16.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f4db6640 1 --2- 172.21.15.18:0/3284633397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f00abf70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90f006f450 tx=0x7f90e801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251734d018bc5d78 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90eeffd640 1 -- 172.21.15.18:0/3284633397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80ab600 con 0x7f90f00abb50 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90eeffd640 1 -- 172.21.15.18:0/3284633397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e80a7050 con 0x7f90f00abb50 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90eeffd640 1 -- 172.21.15.18:0/3284633397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80ab980 con 0x7f90f00abb50 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/3284633397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 msgr2=0x7f90f00abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 --2- 172.21.15.18:0/3284633397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f00abf70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90f006f450 tx=0x7f90e801c3d0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/3284633397 shutdown_connections 2023-06-09T04:38:16.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 --2- 172.21.15.18:0/3284633397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f00abf70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 --2- 172.21.15.18:0/3284633397 >> v2:172.21.15.81:3300/0 conn(0x7f90f015cd00 0x7f90f00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/3284633397 >> 172.21.15.18:0/3284633397 conn(0x7f90f00b2720 msgr2=0x7f90f00ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/3284633397 shutdown_connections 2023-06-09T04:38:16.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/3284633397 wait complete. 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 Processor -- start 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- start start 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f006e3f0 0x7f90f00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f90f015cd00 0x7f90f014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b0fd0 con 0x7f90f00abb50 2023-06-09T04:38:16.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01588e0 con 0x7f90f006e3f0 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b0730 con 0x7f90f015cd00 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f014d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37504/0 (socket says 172.21.15.18:37504) 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 -- 172.21.15.18:0/2074330734 learned_addr learned my addr 172.21.15.18:0/2074330734 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90effff640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f006e3f0 0x7f90f00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f4db6640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f90f015cd00 0x7f90f014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 -- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f90f015cd00 msgr2=0x7f90f014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f90f015cd00 0x7f90f014dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 -- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f006e3f0 msgr2=0x7f90f00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f006e3f0 0x7f90f00b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 -- 172.21.15.18:0/2074330734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8009420 con 0x7f90f00abb50 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90effff640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f006e3f0 0x7f90f00b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ef7fe640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f014d9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f90e40011f0 tx=0x7f90e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40074e0 con 0x7f90f00abb50 2023-06-09T04:38:16.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4007640 con 0x7f90f00abb50 2023-06-09T04:38:16.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4004a10 con 0x7f90f00abb50 2023-06-09T04:38:16.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f00b0a10 con 0x7f90f00abb50 2023-06-09T04:38:16.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.463+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f014e700 con 0x7f90f00abb50 2023-06-09T04:38:16.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.467+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f00caca0 con 0x7f90f00abb50 2023-06-09T04:38:16.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.467+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90e4004b70 con 0x7f90f00abb50 2023-06-09T04:38:16.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.467+0000 7f90ecff9640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f90dc066280 0x7f90dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.467+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f90e40832e0 con 0x7f90f00abb50 2023-06-09T04:38:16.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.467+0000 7f90effff640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f90dc066280 0x7f90dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.467+0000 7f90effff640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f90dc066280 0x7f90dc068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90f015ad10 tx=0x7f90e000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.476 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.471+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90e4050460 con 0x7f90f00abb50 2023-06-09T04:38:16.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.631+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f0158640 con 0x7f90f00abb50 2023-06-09T04:38:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90ecff9640 1 -- 172.21.15.18:0/2074330734 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f90f0158640 con 0x7f90f00abb50 2023-06-09T04:38:16.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:16.640 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f90dc066280 msgr2=0x7f90dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f90dc066280 0x7f90dc068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f90f015ad10 tx=0x7f90e000b040 comp rx=0 tx=0).stop 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 msgr2=0x7f90f014d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f014d9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f90e40011f0 tx=0x7f90e400c9b0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 shutdown_connections 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f90dc066280 0x7f90dc068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f90f015cd00 0x7f90f014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f90f00abb50 0x7f90f014d9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 --2- 172.21.15.18:0/2074330734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f006e3f0 0x7f90f00b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 >> 172.21.15.18:0/2074330734 conn(0x7f90f00b2720 msgr2=0x7f90f00ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 shutdown_connections 2023-06-09T04:38:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.635+0000 7f90f6819640 1 -- 172.21.15.18:0/2074330734 wait complete. 2023-06-09T04:38:16.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.767+0000 7f9eb471f640 1 Processor -- start 2023-06-09T04:38:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 -- start start 2023-06-09T04:38:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9eac159320 0x7f9eac15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9eac15d680 0x7f9eac06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15dad0 0x7f9eac0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac15a920 con 0x7f9eac15d680 2023-06-09T04:38:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac15cf10 con 0x7f9eac159320 2023-06-09T04:38:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb471f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c81b0 con 0x7f9eac15dad0 2023-06-09T04:38:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9eac15d680 0x7f9eac06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9eac15d680 0x7f9eac06fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37508/0 (socket says 172.21.15.18:37508) 2023-06-09T04:38:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 -- 172.21.15.18:0/3482263614 learned_addr learned my addr 172.21.15.18:0/3482263614 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb2cbc640 1 --2- 172.21.15.18:0/3482263614 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15dad0 0x7f9eac0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb24bb640 1 --2- 172.21.15.18:0/3482263614 >> v2:172.21.15.81:3300/0 conn(0x7f9eac159320 0x7f9eac15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 -- 172.21.15.18:0/3482263614 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15dad0 msgr2=0x7f9eac0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 --2- 172.21.15.18:0/3482263614 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15dad0 0x7f9eac0700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 -- 172.21.15.18:0/3482263614 >> v2:172.21.15.81:3300/0 conn(0x7f9eac159320 msgr2=0x7f9eac15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 --2- 172.21.15.18:0/3482263614 >> v2:172.21.15.81:3300/0 conn(0x7f9eac159320 0x7f9eac15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 -- 172.21.15.18:0/3482263614 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0c8490 con 0x7f9eac15d680 2023-06-09T04:38:16.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb24bb640 1 --2- 172.21.15.18:0/3482263614 >> v2:172.21.15.81:3300/0 conn(0x7f9eac159320 0x7f9eac15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:16.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.771+0000 7f9eb1cba640 1 --2- 172.21.15.18:0/3482263614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15d680 0x7f9eac06fb60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9eac06f610 tx=0x7f9e9c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a597edd51ca1759e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb14b9640 1 -- 172.21.15.18:0/3482263614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0a7070 con 0x7f9eac15d680 2023-06-09T04:38:16.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb14b9640 1 -- 172.21.15.18:0/3482263614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c0ab430 con 0x7f9eac15d680 2023-06-09T04:38:16.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb14b9640 1 -- 172.21.15.18:0/3482263614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0ab7c0 con 0x7f9eac15d680 2023-06-09T04:38:16.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- 172.21.15.18:0/3482263614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15d680 msgr2=0x7f9eac06fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3482263614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15d680 0x7f9eac06fb60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9eac06f610 tx=0x7f9e9c01c470 comp rx=0 tx=0).stop 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- 172.21.15.18:0/3482263614 shutdown_connections 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3482263614 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15dad0 0x7f9eac0700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3482263614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15d680 0x7f9eac06fb60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3482263614 >> v2:172.21.15.81:3300/0 conn(0x7f9eac159320 0x7f9eac15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- 172.21.15.18:0/3482263614 >> 172.21.15.18:0/3482263614 conn(0x7f9eac0b0240 msgr2=0x7f9eac0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- 172.21.15.18:0/3482263614 shutdown_connections 2023-06-09T04:38:16.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- 172.21.15.18:0/3482263614 wait complete. 2023-06-09T04:38:16.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 Processor -- start 2023-06-09T04:38:16.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- start start 2023-06-09T04:38:16.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eac159320 0x7f9eac163bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15d680 0x7f9eac14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 0x7f9eac14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0cb590 con 0x7f9eac15dad0 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0cb7a0 con 0x7f9eac159320 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb471f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0cba80 con 0x7f9eac15d680 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb2cbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 0x7f9eac14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb2cbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 0x7f9eac14d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37512/0 (socket says 172.21.15.18:37512) 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.775+0000 7f9eb2cbc640 1 -- 172.21.15.18:0/3630172905 learned_addr learned my addr 172.21.15.18:0/3630172905 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb24bb640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eac159320 0x7f9eac163bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb1cba640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15d680 0x7f9eac14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb2cbc640 1 -- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15d680 msgr2=0x7f9eac14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb2cbc640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15d680 0x7f9eac14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb2cbc640 1 -- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eac159320 msgr2=0x7f9eac163bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb2cbc640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eac159320 0x7f9eac163bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb2cbc640 1 -- 172.21.15.18:0/3630172905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0094d0 con 0x7f9eac15dad0 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb24bb640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eac159320 0x7f9eac163bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb2cbc640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 0x7f9eac14d7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400d560 tx=0x7f9ea400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40125f0 con 0x7f9eac15dad0 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4012770 con 0x7f9eac15dad0 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac0c0cc0 con 0x7f9eac15dad0 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4012b20 con 0x7f9eac15dad0 2023-06-09T04:38:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac14dd20 con 0x7f9eac15dad0 2023-06-09T04:38:16.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac0c0f00 con 0x7f9eac15dad0 2023-06-09T04:38:16.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ea4012c80 con 0x7f9eac15dad0 2023-06-09T04:38:16.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9ea2ffd640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9e900662b0 0x7f9e90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ea40844f0 con 0x7f9eac15dad0 2023-06-09T04:38:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb24bb640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9e900662b0 0x7f9e90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.779+0000 7f9eb24bb640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9e900662b0 0x7f9e90068760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800e550 tx=0x7f9ea8007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.783+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9eac0c0f00 con 0x7f9eac15dad0 2023-06-09T04:38:16.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.935+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9eac0c0f00 con 0x7f9eac15dad0 2023-06-09T04:38:16.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.939+0000 7f9ea2ffd640 1 -- 172.21.15.18:0/3630172905 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f9eac0c0f00 con 0x7f9eac15dad0 2023-06-09T04:38:16.946 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:16.946 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:16.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9e900662b0 msgr2=0x7f9e90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9e900662b0 0x7f9e90068760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800e550 tx=0x7f9ea8007ab0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 msgr2=0x7f9eac14d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 0x7f9eac14d7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400d560 tx=0x7f9ea400da20 comp rx=0 tx=0).stop 2023-06-09T04:38:16.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 shutdown_connections 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15dad0 0x7f9eac14d7e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9e900662b0 0x7f9e90068760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9eac15d680 0x7f9eac14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 --2- 172.21.15.18:0/3630172905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eac159320 0x7f9eac163bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 >> 172.21.15.18:0/3630172905 conn(0x7f9eac0b0240 msgr2=0x7f9eac1520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 shutdown_connections 2023-06-09T04:38:16.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:16.943+0000 7f9eb471f640 1 -- 172.21.15.18:0/3630172905 wait complete. 2023-06-09T04:38:16.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:17.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.087+0000 7f459b09b640 1 Processor -- start 2023-06-09T04:38:17.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f459b09b640 1 -- start start 2023-06-09T04:38:17.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f459b09b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f45940ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f459b09b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f459406c3c0 0x7f459415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f459b09b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459406a900 con 0x7f4594158310 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f459b09b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45940cd0f0 con 0x7f459406c3c0 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f459b09b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459415ceb0 con 0x7f45941586e0 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4598e37640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4594158310 0x7f459406bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56170/0 (socket says 172.21.15.18:56170) 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4598e37640 1 -- 172.21.15.18:0/2637128441 learned_addr learned my addr 172.21.15.18:0/2637128441 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4593fff640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f45940ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 --2- 172.21.15.18:0/2637128441 >> v2:172.21.15.81:3300/0 conn(0x7f459406c3c0 0x7f459415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935735147 0 0) 0x7f459406a900 con 0x7f4594158310 2023-06-09T04:38:17.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f457c003530 con 0x7f4594158310 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2140212980 0 0) 0x7f457c003530 con 0x7f4594158310 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 msgr2=0x7f45940ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f45940ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 >> v2:172.21.15.81:3300/0 conn(0x7f459406c3c0 msgr2=0x7f459415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 --2- 172.21.15.18:0/2637128441 >> v2:172.21.15.81:3300/0 conn(0x7f459406c3c0 0x7f459415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459415cbd0 con 0x7f4594158310 2023-06-09T04:38:17.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4588001680 con 0x7f4594158310 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 >> v1:172.21.15.18:6789/0 conn(0x7f4594158310 legacy=0x7f459406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f457c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f457c003f00 0x7f457c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457c004d10 0x7f457c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cd0f0 con 0x7f457c004d10 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459415ceb0 con 0x7f457c003f00 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c00b990 con 0x7f45941586e0 2023-06-09T04:38:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457c004d10 0x7f457c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4598e37640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f457c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4593fff640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f457c003f00 0x7f457c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 -- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 msgr2=0x7f457c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f457c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 -- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f457c003f00 msgr2=0x7f457c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f457c003f00 0x7f457c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4599638640 1 -- 172.21.15.18:0/2637128441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c003530 con 0x7f457c004d10 2023-06-09T04:38:17.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4593fff640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f457c003f00 0x7f457c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:17.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.091+0000 7f4598e37640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f45941586e0 0x7f457c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4599638640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457c004d10 0x7f457c005180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f458c009f90 tx=0x7f458c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b4ef129edef34 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0a5c70 con 0x7f457c004d10 2023-06-09T04:38:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00f040 con 0x7f457c004d10 2023-06-09T04:38:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f45937fe640 1 -- 172.21.15.18:0/2637128441 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0ad640 con 0x7f457c004d10 2023-06-09T04:38:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- 172.21.15.18:0/2637128441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457c004d10 msgr2=0x7f457c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 --2- 172.21.15.18:0/2637128441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f457c004d10 0x7f457c005180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f458c009f90 tx=0x7f458c01cc60 comp rx=0 tx=0).stop 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4599638640 1 -- 172.21.15.18:0/2637128441 reap_dead start 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- 172.21.15.18:0/2637128441 shutdown_connections 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- 172.21.15.18:0/2637128441 >> 172.21.15.18:0/2637128441 conn(0x7f45940b0240 msgr2=0x7f45940cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- 172.21.15.18:0/2637128441 shutdown_connections 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- 172.21.15.18:0/2637128441 wait complete. 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 Processor -- start 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- start start 2023-06-09T04:38:17.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f457c004d10 0x7f45941efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 0x7f459415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45940b30c0 0x7f45940b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941511f0 con 0x7f45941f0060 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4594151a90 con 0x7f45940b30c0 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f459b09b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459415b910 con 0x7f457c004d10 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 0x7f459415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 0x7f459415b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37460/0 (socket says 172.21.15.18:37460) 2023-06-09T04:38:17.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 -- 172.21.15.18:0/3812722906 learned_addr learned my addr 172.21.15.18:0/3812722906 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:17.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4598e37640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f457c004d10 0x7f45941efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4599638640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45940b30c0 0x7f45940b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 -- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f457c004d10 msgr2=0x7f45941efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f457c004d10 0x7f45941efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 -- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45940b30c0 msgr2=0x7f45940b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45940b30c0 0x7f45940b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 -- 172.21.15.18:0/3812722906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459415bbe0 con 0x7f45941f0060 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.095+0000 7f4593fff640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 0x7f459415b3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45840108d0 tx=0x7f4584010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584004220 con 0x7f45941f0060 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584004380 con 0x7f45941f0060 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400eba0 con 0x7f45941f0060 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4594151440 con 0x7f45941f0060 2023-06-09T04:38:17.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45941f04d0 con 0x7f45941f0060 2023-06-09T04:38:17.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4594151bd0 con 0x7f45941f0060 2023-06-09T04:38:17.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f458400ed00 con 0x7f45941f0060 2023-06-09T04:38:17.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f45917fa640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4580066280 0x7f4580068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4584083ff0 con 0x7f45941f0060 2023-06-09T04:38:17.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f4598e37640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4580066280 0x7f4580068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.099+0000 7f4598e37640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4580066280 0x7f4580068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4588005ba0 tx=0x7f4588009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.103+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45840b4700 con 0x7f45941f0060 2023-06-09T04:38:17.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.283+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f459406a390 con 0x7f45941f0060 2023-06-09T04:38:17.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f45917fa640 1 -- 172.21.15.18:0/3812722906 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f45840511b0 con 0x7f45941f0060 2023-06-09T04:38:17.292 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:17.292 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:15.975182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-09T04:38:17.292 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2023-06-09T04:38:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4580066280 msgr2=0x7f4580068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4580066280 0x7f4580068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4588005ba0 tx=0x7f4588009040 comp rx=0 tx=0).stop 2023-06-09T04:38:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 msgr2=0x7f459415b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 0x7f459415b3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45840108d0 tx=0x7f4584010d90 comp rx=0 tx=0).stop 2023-06-09T04:38:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 shutdown_connections 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45940b30c0 0x7f45940b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45941f0060 0x7f459415b3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4580066280 0x7f4580068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 --2- 172.21.15.18:0/3812722906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f457c004d10 0x7f45941efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 >> 172.21.15.18:0/3812722906 conn(0x7f45940b0240 msgr2=0x7f4594149c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 shutdown_connections 2023-06-09T04:38:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.287+0000 7f459b09b640 1 -- 172.21.15.18:0/3812722906 wait complete. 2023-06-09T04:38:17.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 Processor -- start 2023-06-09T04:38:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 -- start start 2023-06-09T04:38:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 0x7f4af00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4af00cd550 0x7f4af015c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af0070f40 con 0x7f4af00b12a0 2023-06-09T04:38:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00ccdc0 con 0x7f4af00cd550 2023-06-09T04:38:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4af5240640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00cb400 con 0x7f4af00cd180 2023-06-09T04:38:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4af00b12a0 0x7f4af00cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56178/0 (socket says 172.21.15.18:56178) 2023-06-09T04:38:17.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 -- 172.21.15.18:0/2473298538 learned_addr learned my addr 172.21.15.18:0/2473298538 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aeed9d640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 0x7f4af00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689940152 0 0) 0x7f4af0070f40 con 0x7f4af00b12a0 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad8005740 con 0x7f4af00b12a0 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aef59e640 1 --2- 172.21.15.18:0/2473298538 >> v2:172.21.15.81:3300/0 conn(0x7f4af00cd550 0x7f4af015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3271098914 0 0) 0x7f4ad8005740 con 0x7f4af00b12a0 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 msgr2=0x7f4af00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 0x7f4af00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 >> v2:172.21.15.81:3300/0 conn(0x7f4af00cd550 msgr2=0x7f4af015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 --2- 172.21.15.18:0/2473298538 >> v2:172.21.15.81:3300/0 conn(0x7f4af00cd550 0x7f4af015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00ae3b0 con 0x7f4af00b12a0 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4ae4001680 con 0x7f4af00b12a0 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 >> v1:172.21.15.18:6789/0 conn(0x7f4af00b12a0 legacy=0x7f4af00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 0x7f4ad8005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad8006110 0x7f4ad80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8006f20 0x7f4ad8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00ccdc0 con 0x7f4ad8006110 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00cb400 con 0x7f4ad8006f20 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad800dba0 con 0x7f4af00cd180 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad8006110 0x7f4ad80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aeed9d640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 0x7f4ad8005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aef59e640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8006f20 0x7f4ad8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 -- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 msgr2=0x7f4ad8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4af00cd180 0x7f4ad8005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 -- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8006f20 msgr2=0x7f4ad8007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8006f20 0x7f4ad8007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aee59c640 1 -- 172.21.15.18:0/2473298538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8005740 con 0x7f4ad8006110 2023-06-09T04:38:17.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.415+0000 7f4aef59e640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ad8006f20 0x7f4ad8007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad8006110 0x7f4ad80069e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400c240 tx=0x7f4ae401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8653a0ef9fe017 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4005ae0 con 0x7f4ad8006110 2023-06-09T04:38:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40ab070 con 0x7f4ad8006110 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aedd9b640 1 -- 172.21.15.18:0/2473298538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4007070 con 0x7f4ad8006110 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- 172.21.15.18:0/2473298538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad8006110 msgr2=0x7f4ad80069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 --2- 172.21.15.18:0/2473298538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad8006110 0x7f4ad80069e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400c240 tx=0x7f4ae401f3d0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aef59e640 1 -- 172.21.15.18:0/2473298538 reap_dead start 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- 172.21.15.18:0/2473298538 shutdown_connections 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- 172.21.15.18:0/2473298538 >> 172.21.15.18:0/2473298538 conn(0x7f4af00b2720 msgr2=0x7f4af00ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- 172.21.15.18:0/2473298538 shutdown_connections 2023-06-09T04:38:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- 172.21.15.18:0/2473298538 wait complete. 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 Processor -- start 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- start start 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ad8006110 0x7f4af0156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 0x7f4af00c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af00acaa0 0x7f4af00acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c5020 con 0x7f4af00c38e0 2023-06-09T04:38:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00ad450 con 0x7f4af00acaa0 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4af5240640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c5440 con 0x7f4ad8006110 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 0x7f4af00c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 0x7f4af00c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37478/0 (socket says 172.21.15.18:37478) 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 -- 172.21.15.18:0/764321212 learned_addr learned my addr 172.21.15.18:0/764321212 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aeed9d640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ad8006110 0x7f4af0156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aef59e640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af00acaa0 0x7f4af00acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 -- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ad8006110 msgr2=0x7f4af0156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ad8006110 0x7f4af0156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 -- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af00acaa0 msgr2=0x7f4af00acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af00acaa0 0x7f4af00acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aee59c640 1 -- 172.21.15.18:0/764321212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00c43a0 con 0x7f4af00c38e0 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aef59e640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af00acaa0 0x7f4af00acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.419+0000 7f4aeed9d640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ad8006110 0x7f4af0156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4aee59c640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 0x7f4af00c3d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ae401f200 tx=0x7f4ad8007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40b7070 con 0x7f4af00c38e0 2023-06-09T04:38:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40047f0 con 0x7f4af00c38e0 2023-06-09T04:38:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af00c4680 con 0x7f4af00c38e0 2023-06-09T04:38:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004b60 con 0x7f4af00c38e0 2023-06-09T04:38:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af00c4c40 con 0x7f4af00c38e0 2023-06-09T04:38:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af00c5160 con 0x7f4af00c38e0 2023-06-09T04:38:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ae40ad020 con 0x7f4af00c38e0 2023-06-09T04:38:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4ad77fe640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4adc0662b0 0x7f4adc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ae4120650 con 0x7f4af00c38e0 2023-06-09T04:38:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4aeed9d640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4adc0662b0 0x7f4adc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.423+0000 7f4aeed9d640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4adc0662b0 0x7f4adc068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009990 tx=0x7f4ae0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.427+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4af00c5160 con 0x7f4af00c38e0 2023-06-09T04:38:17.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.579+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4af00c5160 con 0x7f4af00c38e0 2023-06-09T04:38:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.583+0000 7f4ad77fe640 1 -- 172.21.15.18:0/764321212 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f4af00c5160 con 0x7f4af00c38e0 2023-06-09T04:38:17.589 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:17.589 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4adc0662b0 msgr2=0x7f4adc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4adc0662b0 0x7f4adc068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009990 tx=0x7f4ae0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:17.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 msgr2=0x7f4af00c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 0x7f4af00c3d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ae401f200 tx=0x7f4ad8007a10 comp rx=0 tx=0).stop 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 shutdown_connections 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af00acaa0 0x7f4af00acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4af00c38e0 0x7f4af00c3d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4adc0662b0 0x7f4adc068760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 --2- 172.21.15.18:0/764321212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ad8006110 0x7f4af0156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 >> 172.21.15.18:0/764321212 conn(0x7f4af00b2720 msgr2=0x7f4af00c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 shutdown_connections 2023-06-09T04:38:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:17.587+0000 7f4af5240640 1 -- 172.21.15.18:0/764321212 wait complete. 2023-06-09T04:38:18.009 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:38:11.545685+0000', 'modified': '2023-06-09T04:38:15.975182+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/1214100469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 1214100469}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 1214100469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-09T04:38:18.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:38:18.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-09T04:38:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 Processor -- start 2023-06-09T04:38:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 -- start start 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a40159300 0x7f2a4015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2a400cbe00 0x7f2a400cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a400cd820 con 0x7f2a400ccba0 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400ca2a0 con 0x7f2a400cbe00 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a450a4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4015dee0 con 0x7f2a40159300 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a37fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2a400cbe00 0x7f2a400cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a37fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2a400cbe00 0x7f2a400cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37490/0 (socket says 172.21.15.18:37490) 2023-06-09T04:38:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.139+0000 7f2a37fff640 1 -- 172.21.15.18:0/3663718149 learned_addr learned my addr 172.21.15.18:0/3663718149 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/3663718149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a40159300 0x7f2a4015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a37fff640 1 -- 172.21.15.18:0/3663718149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a40159300 msgr2=0x7f2a4015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a37fff640 1 --2- 172.21.15.18:0/3663718149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a40159300 0x7f2a4015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a37fff640 1 -- 172.21.15.18:0/3663718149 >> v1:172.21.15.81:6789/0 conn(0x7f2a400ccba0 legacy=0x7f2a400b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a37fff640 1 -- 172.21.15.18:0/3663718149 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400ccfd0 con 0x7f2a400cbe00 2023-06-09T04:38:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a37fff640 1 --2- 172.21.15.18:0/3663718149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400cbe00 0x7f2a400cc660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009870 tx=0x7f2a2801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45092ccb26942117 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a3e59c640 1 -- 172.21.15.18:0/3663718149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280ab600 con 0x7f2a400cbe00 2023-06-09T04:38:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a3e59c640 1 -- 172.21.15.18:0/3663718149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280a7050 con 0x7f2a400cbe00 2023-06-09T04:38:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a3e59c640 1 -- 172.21.15.18:0/3663718149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280ab980 con 0x7f2a400cbe00 2023-06-09T04:38:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 -- 172.21.15.18:0/3663718149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400cbe00 msgr2=0x7f2a400cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 --2- 172.21.15.18:0/3663718149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400cbe00 0x7f2a400cc660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009870 tx=0x7f2a2801c540 comp rx=0 tx=0).stop 2023-06-09T04:38:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 -- 172.21.15.18:0/3663718149 shutdown_connections 2023-06-09T04:38:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 --2- 172.21.15.18:0/3663718149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400cbe00 0x7f2a400cc660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 --2- 172.21.15.18:0/3663718149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a40159300 0x7f2a4015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 -- 172.21.15.18:0/3663718149 >> 172.21.15.18:0/3663718149 conn(0x7f2a4006f850 msgr2=0x7f2a4006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 -- 172.21.15.18:0/3663718149 shutdown_connections 2023-06-09T04:38:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.143+0000 7f2a450a4640 1 -- 172.21.15.18:0/3663718149 wait complete. 2023-06-09T04:38:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 Processor -- start 2023-06-09T04:38:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 -- start start 2023-06-09T04:38:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a400cbe00 0x7f2a400b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 0x7f2a40153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a40159300 0x7f2a4015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40153ec0 con 0x7f2a400ccba0 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4015b140 con 0x7f2a40159300 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4015b420 con 0x7f2a400cbe00 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 0x7f2a40153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 0x7f2a40153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37506/0 (socket says 172.21.15.18:37506) 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 -- 172.21.15.18:0/1950860444 learned_addr learned my addr 172.21.15.18:0/1950860444 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a40159300 0x7f2a4015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a400cbe00 0x7f2a400b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 -- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a400cbe00 msgr2=0x7f2a400b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a400cbe00 0x7f2a400b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 -- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a40159300 msgr2=0x7f2a4015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a40159300 0x7f2a4015c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 -- 172.21.15.18:0/1950860444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280094d0 con 0x7f2a400ccba0 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a400cbe00 0x7f2a400b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a40159300 0x7f2a4015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a37fff640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 0x7f2a40153980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a2801a170 tx=0x7f2a280192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a377fe640 1 -- 172.21.15.18:0/1950860444 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280aa7b0 con 0x7f2a400ccba0 2023-06-09T04:38:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a377fe640 1 -- 172.21.15.18:0/1950860444 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280aa910 con 0x7f2a400ccba0 2023-06-09T04:38:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4015b700 con 0x7f2a400ccba0 2023-06-09T04:38:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a377fe640 1 -- 172.21.15.18:0/1950860444 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280aac80 con 0x7f2a400ccba0 2023-06-09T04:38:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4015bcc0 con 0x7f2a400ccba0 2023-06-09T04:38:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.147+0000 7f2a377fe640 1 -- 172.21.15.18:0/1950860444 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a280b2070 con 0x7f2a400ccba0 2023-06-09T04:38:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a377fe640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2a20066280 0x7f2a20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a377fe640 1 -- 172.21.15.18:0/1950860444 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a2811d9e0 con 0x7f2a400ccba0 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2a20066280 0x7f2a20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 Processor -- start 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- start start 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2a20066280 0x7f2a20068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097a0 tx=0x7f2a30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 0x5591c54011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5401700 0x5591c53b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53b7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c527f540 con 0x5591c5400df0 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c51b8840 con 0x5591c5401700 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591c520be60 con 0x5591c53b75c0 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 0x5591c54011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 0x5591c54011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37520/0 (socket says 172.21.15.18:37520) 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/2237000344 learned_addr learned my addr 172.21.15.18:0/2237000344 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a37fff640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5401700 0x5591c53b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 msgr2=0x5591c53b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5401700 msgr2=0x5591c53b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5401700 0x5591c53b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/2237000344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591c4f01890 con 0x5591c5400df0 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a37fff640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5401700 0x5591c53b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 0x5591c54011c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a30004350 tx=0x7f2a30011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a739a2db5501dd06 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a34ff9640 1 -- 172.21.15.18:0/2237000344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3001d070 con 0x5591c5400df0 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a34ff9640 1 -- 172.21.15.18:0/2237000344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30004380 con 0x5591c5400df0 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a34ff9640 1 -- 172.21.15.18:0/2237000344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3000ee80 con 0x5591c5400df0 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- 172.21.15.18:0/2237000344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 msgr2=0x5591c54011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 0x5591c54011c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a30004350 tx=0x7f2a30011000 comp rx=0 tx=0).stop 2023-06-09T04:38:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- 172.21.15.18:0/2237000344 shutdown_connections 2023-06-09T04:38:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5401700 0x5591c53b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2237000344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5400df0 0x5591c54011c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- 172.21.15.18:0/2237000344 >> 172.21.15.18:0/2237000344 conn(0x5591c525d370 msgr2=0x5591c53b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- 172.21.15.18:0/2237000344 shutdown_connections 2023-06-09T04:38:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.151+0000 7f2a481c0000 1 -- 172.21.15.18:0/2237000344 wait complete. 2023-06-09T04:38:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- start start 2023-06-09T04:38:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 Processor -- start 2023-06-09T04:38:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53bc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5400df0 0x5591c53c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 0x5591c53c2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c5204f00 con 0x5591c5401700 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c51c1ae0 con 0x5591c5400df0 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591c51c1780 con 0x5591c53b75c0 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 10 client.0 _ll_register_callbacks cb 0x5591c51fe7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 0x5591c53c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 0x5591c53c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37532/0 (socket says 172.21.15.18:37532) 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 -- 172.21.15.18:0/2887163634 learned_addr learned my addr 172.21.15.18:0/2887163634 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53bc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 -- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 msgr2=0x5591c53bc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53bc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a37fff640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5400df0 0x5591c53c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 -- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5400df0 msgr2=0x5591c53c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5400df0 0x5591c53c21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 -- 172.21.15.18:0/2887163634 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a30004030 con 0x5591c5401700 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 0x5591c53c2710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800e4d0 tx=0x7f2a3800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d97beb5d475fb45 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2887163634 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38003d90 con 0x5591c5401700 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2887163634 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a38005070 con 0x5591c5401700 2023-06-09T04:38:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591c51be2d0 con 0x5591c5401700 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2887163634 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a38005230 con 0x5591c5401700 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 10 client.4443 fetch_fsmap learned FSMap version 6 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5591c51c9d10 con 0x5591c5401700 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2887163634 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591c51be2d0 con 0x5591c5401700 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2887163634 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f2a38005390 con 0x5591c5401700 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 10 client.4443 fetch_fsmap finished waiting for FSMap version 6 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 10 client.4443 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:38:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 20 client.4443 populate_metadata read hostname 'smithi018' 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5407410 0x5591c54077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 4 client.4443 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 --> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591c5203850 con 0x5591c5407410 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5407410 0x5591c54077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5407410 0x5591c54077e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c50d1360a6b55602 server_cookie=9a6a43ea837b0b38 in_seq=0 out_seq=0 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.155+0000 7f2a1dffb640 10 client.4443 ms_handle_connect on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2887163634 <== mds.0 v2:172.21.15.81:6835/1214100469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5591c5203850 con 0x5591c5407410 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a1dffb640 10 client.4443 handle_command_reply: tid=0 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 client.4443 shutdown 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 msgr2=0x5591c53c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 0x5591c53c2710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800e4d0 tx=0x7f2a3800e990 comp rx=0 tx=0).stop 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 shutdown_connections 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c5401700 0x5591c53c2710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c5400df0 0x5591c53c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5407410 0x5591c54077e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2887163634 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c53b75c0 0x5591c53bc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a1dffb640 0 client.4443 ms_handle_reset on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 >> 172.21.15.18:0/2887163634 conn(0x5591c525d370 msgr2=0x5591c53b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 shutdown_connections 2023-06-09T04:38:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 1 -- 172.21.15.18:0/2887163634 wait complete. 2023-06-09T04:38:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.159+0000 7f2a481c0000 20 client.4443 trim_cache size 0 max 16384 2023-06-09T04:38:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 Processor -- start 2023-06-09T04:38:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- start start 2023-06-09T04:38:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 0x5591c545a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c53b75c0 0x5591c545acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c545b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c4ec2940 con 0x5591c525d370 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c53aedd0 con 0x5591c53b75c0 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591c5200870 con 0x5591c5400df0 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 0x5591c545a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 0x5591c545a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37538/0 (socket says 172.21.15.18:37538) 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/1832899654 learned_addr learned my addr 172.21.15.18:0/1832899654 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/1832899654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 msgr2=0x5591c545b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c545b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/1832899654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c53b75c0 msgr2=0x5591c545acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c53b75c0 0x5591c545acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 -- 172.21.15.18:0/1832899654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591c51affa0 con 0x5591c525d370 2023-06-09T04:38:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 0x5591c545a7b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a30008010 tx=0x7f2a30012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7138b2013d7bf551 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a357fa640 1 -- 172.21.15.18:0/1832899654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3001d050 con 0x5591c525d370 2023-06-09T04:38:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a357fa640 1 -- 172.21.15.18:0/1832899654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3000ec80 con 0x5591c525d370 2023-06-09T04:38:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a357fa640 1 -- 172.21.15.18:0/1832899654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30003aa0 con 0x5591c525d370 2023-06-09T04:38:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- 172.21.15.18:0/1832899654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 msgr2=0x5591c545a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 0x5591c545a7b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a30008010 tx=0x7f2a30012000 comp rx=0 tx=0).stop 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- 172.21.15.18:0/1832899654 shutdown_connections 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c545b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c53b75c0 0x5591c545acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 --2- 172.21.15.18:0/1832899654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c525d370 0x5591c545a7b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- 172.21.15.18:0/1832899654 >> 172.21.15.18:0/1832899654 conn(0x5591c53bd350 msgr2=0x5591c53ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- 172.21.15.18:0/1832899654 shutdown_connections 2023-06-09T04:38:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- 172.21.15.18:0/1832899654 wait complete. 2023-06-09T04:38:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 -- start start 2023-06-09T04:38:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.175+0000 7f2a481c0000 1 Processor -- start 2023-06-09T04:38:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c525d370 0x5591c545ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 0x5591c545ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c5404330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c51c5fe0 con 0x5591c53b75c0 2023-06-09T04:38:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591c5207a60 con 0x5591c525d370 2023-06-09T04:38:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591c5406c60 con 0x5591c5400df0 2023-06-09T04:38:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 10 client.0 _ll_register_callbacks cb 0x5591c5208260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 0x5591c545ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 0x5591c545ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37544/0 (socket says 172.21.15.18:37544) 2023-06-09T04:38:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 -- 172.21.15.18:0/2888406220 learned_addr learned my addr 172.21.15.18:0/2888406220 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a3f59e640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c5404330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c525d370 0x5591c545ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 -- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 msgr2=0x5591c5404330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c5404330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 -- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c525d370 msgr2=0x5591c545ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c525d370 0x5591c545ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 -- 172.21.15.18:0/2888406220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a30026040 con 0x5591c53b75c0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c525d370 0x5591c545ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a37fff640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 0x5591c545ef40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a28097e10 tx=0x7f2a280f6c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41cafa2fe2e982e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2888406220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280f6980 con 0x5591c53b75c0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2888406220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a280f2ae0 con 0x5591c53b75c0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591c518ca80 con 0x5591c53b75c0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2888406220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a281060b0 con 0x5591c53b75c0 2023-06-09T04:38:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 10 client.4449 fetch_fsmap learned FSMap version 6 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5591c4f01cc0 con 0x5591c53b75c0 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2888406220 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591c518ca80 con 0x5591c53b75c0 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2888406220 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f2a280f2ca0 con 0x5591c53b75c0 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 10 client.4449 fetch_fsmap finished waiting for FSMap version 6 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 10 client.4449 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 20 client.4449 populate_metadata read hostname 'smithi018' 2023-06-09T04:38:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5401700 0x5591c5404870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 4 client.4449 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-06-09T04:38:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 --> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5591c51fdee0 con 0x5591c5401700 2023-06-09T04:38:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5401700 0x5591c5404870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 10 client.4449 ms_handle_connect on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a3ed9d640 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5401700 0x5591c5404870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=671292d74c84291e server_cookie=cd86c41c5f52a90c in_seq=0 out_seq=0 2023-06-09T04:38:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 1 -- 172.21.15.18:0/2888406220 <== mds.0 v2:172.21.15.81:6835/1214100469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5591c51fdee0 con 0x5591c5401700 2023-06-09T04:38:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 10 client.4449 handle_command_reply: tid=0 2023-06-09T04:38:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 client.4449 shutdown 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 msgr2=0x5591c545ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 0x5591c545ef40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a28097e10 tx=0x7f2a280f6c10 comp rx=0 tx=0).stop 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 shutdown_connections 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x5591c5401700 0x5591c5404870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x5591c5400df0 0x5591c5404330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5591c53b75c0 0x5591c545ef40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a1dffb640 0 client.4449 ms_handle_reset on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 --2- 172.21.15.18:0/2888406220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5591c525d370 0x5591c545ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 >> 172.21.15.18:0/2888406220 conn(0x5591c53bd350 msgr2=0x5591c53ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 shutdown_connections 2023-06-09T04:38:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 1 -- 172.21.15.18:0/2888406220 wait complete. 2023-06-09T04:38:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a481c0000 20 client.4449 trim_cache size 0 max 16384 2023-06-09T04:38:18.195 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:38:18.195 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "eb85c981-43c8-4596-9c30-77e5bafdb8a3", 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4294, 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 6.6343333759999998, 2023-06-09T04:38:18.196 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 6, 2023-06-09T04:38:18.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 28, 2023-06-09T04:38:18.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 27, 2023-06-09T04:38:18.197 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 11.073492054999999 2023-06-09T04:38:18.197 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2a20066280 msgr2=0x7f2a20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2a20066280 0x7f2a20068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097a0 tx=0x7f2a30008040 comp rx=0 tx=0).stop 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 msgr2=0x7f2a40153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 0x7f2a40153980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a2801a170 tx=0x7f2a280192e0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 shutdown_connections 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a40159300 0x7f2a4015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a400ccba0 0x7f2a40153980 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2a20066280 0x7f2a20068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 --2- 172.21.15.18:0/1950860444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2a400cbe00 0x7f2a400b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 >> 172.21.15.18:0/1950860444 conn(0x7f2a4006f850 msgr2=0x7f2a400b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.179+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 shutdown_connections 2023-06-09T04:38:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.183+0000 7f2a450a4640 1 -- 172.21.15.18:0/1950860444 wait complete. 2023-06-09T04:38:18.202 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:18.203 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:18.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:18.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 Processor -- start 2023-06-09T04:38:18.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 -- start start 2023-06-09T04:38:18.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62ac159320 0x7f62ac15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f62ac070270 0x7f62ac06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac15cf10 con 0x7f62ac15d680 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac15a920 con 0x7f62ac070270 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b2be9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac0c81b0 con 0x7f62ac159320 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f62ac070270 0x7f62ac06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f62ac070270 0x7f62ac06bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37546/0 (socket says 172.21.15.18:37546) 2023-06-09T04:38:18.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 -- 172.21.15.18:0/4222595134 learned_addr learned my addr 172.21.15.18:0/4222595134 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b0985640 1 --2- 172.21.15.18:0/4222595134 >> v2:172.21.15.81:3300/0 conn(0x7f62ac159320 0x7f62ac15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 -- 172.21.15.18:0/4222595134 >> v2:172.21.15.81:3300/0 conn(0x7f62ac159320 msgr2=0x7f62ac15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 --2- 172.21.15.18:0/4222595134 >> v2:172.21.15.81:3300/0 conn(0x7f62ac159320 0x7f62ac15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 -- 172.21.15.18:0/4222595134 >> v1:172.21.15.81:6789/0 conn(0x7f62ac15d680 legacy=0x7f62ac06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b1186640 1 -- 172.21.15.18:0/4222595134 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0c8490 con 0x7f62ac070270 2023-06-09T04:38:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.303+0000 7f62b0985640 1 --2- 172.21.15.18:0/4222595134 >> v2:172.21.15.81:3300/0 conn(0x7f62ac159320 0x7f62ac15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b1186640 1 --2- 172.21.15.18:0/4222595134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac070270 0x7f62ac06bcb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06f610 tx=0x7f629c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb46d1a15fc21111 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62ab7fe640 1 -- 172.21.15.18:0/4222595134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0ab600 con 0x7f62ac070270 2023-06-09T04:38:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62ab7fe640 1 -- 172.21.15.18:0/4222595134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c0ab760 con 0x7f62ac070270 2023-06-09T04:38:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62ab7fe640 1 -- 172.21.15.18:0/4222595134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0abaf0 con 0x7f62ac070270 2023-06-09T04:38:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 -- 172.21.15.18:0/4222595134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac070270 msgr2=0x7f62ac06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 --2- 172.21.15.18:0/4222595134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac070270 0x7f62ac06bcb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06f610 tx=0x7f629c01c400 comp rx=0 tx=0).stop 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 -- 172.21.15.18:0/4222595134 shutdown_connections 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 --2- 172.21.15.18:0/4222595134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac070270 0x7f62ac06bcb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 --2- 172.21.15.18:0/4222595134 >> v2:172.21.15.81:3300/0 conn(0x7f62ac159320 0x7f62ac15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 -- 172.21.15.18:0/4222595134 >> 172.21.15.18:0/4222595134 conn(0x7f62ac0b0240 msgr2=0x7f62ac0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 -- 172.21.15.18:0/4222595134 shutdown_connections 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 -- 172.21.15.18:0/4222595134 wait complete. 2023-06-09T04:38:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.307+0000 7f62b2be9640 1 Processor -- start 2023-06-09T04:38:18.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- start start 2023-06-09T04:38:18.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62ac070270 0x7f62ac14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 0x7f62ac0b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15d680 0x7f62ac0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac14f650 con 0x7f62ac159320 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac14c2c0 con 0x7f62ac15d680 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac14c4e0 con 0x7f62ac070270 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 0x7f62ac0b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 0x7f62ac0b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37554/0 (socket says 172.21.15.18:37554) 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 -- 172.21.15.18:0/840030486 learned_addr learned my addr 172.21.15.18:0/840030486 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b0985640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62ac070270 0x7f62ac14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 -- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62ac070270 msgr2=0x7f62ac14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b1186640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15d680 0x7f62ac0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62ac070270 0x7f62ac14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 -- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15d680 msgr2=0x7f62ac0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15d680 0x7f62ac0c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 -- 172.21.15.18:0/840030486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0094d0 con 0x7f62ac159320 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62abfff640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 0x7f62ac0b1900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62a000b440 tx=0x7f62a000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0011890 con 0x7f62ac159320 2023-06-09T04:38:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a00119f0 con 0x7f62ac159320 2023-06-09T04:38:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac1561b0 con 0x7f62ac159320 2023-06-09T04:38:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0011da0 con 0x7f62ac159320 2023-06-09T04:38:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac156490 con 0x7f62ac159320 2023-06-09T04:38:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac14c9c0 con 0x7f62ac159320 2023-06-09T04:38:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62a001a400 con 0x7f62ac159320 2023-06-09T04:38:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62a97fa640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6298066280 0x7f6298068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f62a0084060 con 0x7f62ac159320 2023-06-09T04:38:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.311+0000 7f62b0985640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6298066280 0x7f6298068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.315+0000 7f62b0985640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6298066280 0x7f6298068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62a4008f80 tx=0x7f62a40084d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.315+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62ac14c9c0 con 0x7f62ac159320 2023-06-09T04:38:18.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.503+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f62ac14c9c0 con 0x7f62ac159320 2023-06-09T04:38:18.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.503+0000 7f62a97fa640 1 -- 172.21.15.18:0/840030486 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f62a0015070 con 0x7f62ac159320 2023-06-09T04:38:18.510 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:38:18.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6298066280 msgr2=0x7f6298068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6298066280 0x7f6298068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62a4008f80 tx=0x7f62a40084d0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 msgr2=0x7f62ac0b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 0x7f62ac0b1900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62a000b440 tx=0x7f62a000b900 comp rx=0 tx=0).stop 2023-06-09T04:38:18.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 shutdown_connections 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15d680 0x7f62ac0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62ac159320 0x7f62ac0b1900 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6298066280 0x7f6298068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 --2- 172.21.15.18:0/840030486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62ac070270 0x7f62ac14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 >> 172.21.15.18:0/840030486 conn(0x7f62ac0b0240 msgr2=0x7f62ac15b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 shutdown_connections 2023-06-09T04:38:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:18.507+0000 7f62b2be9640 1 -- 172.21.15.18:0/840030486 wait complete. 2023-06-09T04:38:18.529 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T04:38:18.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:18.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2023-06-09T04:38:18.530 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-09T04:38:18.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:18.530 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T04:38:18.531 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:18.531 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:18.531 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-09T04:38:18.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.532 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2023-06-09T04:38:18.536 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:18.537 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2023-06-09T04:38:18.538 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42491sec preferred_lft 42491sec 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2023-06-09T04:38:18.539 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:38:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:12:fb:92:ca brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:38:18.540 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:18.540 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:38:18.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.541 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:18.541 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:18.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:38:18.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2023-06-09T04:38:18.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2023-06-09T04:38:18.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:38:18.542 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:18.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.613 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:18.663 INFO:teuthology.orchestra.run.smithi018.stdout:1 2023-06-09T04:38:18.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.664 DEBUG:teuthology.orchestra.run.smithi018:> route 2023-06-09T04:38:18.726 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2023-06-09T04:38:18.726 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:18.727 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-09T04:38:18.727 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:38:18.727 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-09T04:38:18.727 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:18.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.728 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:18.728 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:18.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:38:18.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:38:18.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:38:18.729 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:18.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.804 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2023-06-09T04:38:18.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.852 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2023-06-09T04:38:18.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.899 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:18.899 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:18.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-09T04:38:18.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-09T04:38:18.900 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:18.971 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-09T04:38:18.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:18.972 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:18.972 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:18.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-09T04:38:18.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:18.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-09T04:38:18.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-09T04:38:18.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-09T04:38:18.974 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:19.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:19.079 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:19.079 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:19.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2023-06-09T04:38:19.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:38:19.080 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:19.098 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-09T04:38:19.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:19.099 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:19.142 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-09T04:38:19.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:19.143 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:19.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:19.249 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:19.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:19.305 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:19.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:19.306 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:19.351 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:38:19.351 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-09T04:38:19.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:19.409 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:19.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:19.466 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:19.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:19.467 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:19.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2023-06-09T04:38:19.479+0000 7fee51ec7580 -1 init, newargv = 0x55d1495e95b0 newargc=15 2023-06-09T04:38:19.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[43325]: starting ceph client 2023-06-09T04:38:19.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[43325]: starting fuse 2023-06-09T04:38:20.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:20.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:20.664 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:20.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.665 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:20.711 INFO:teuthology.orchestra.run.smithi018.stdout:45 2023-06-09T04:38:20.711 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-09T04:38:20.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:20.712 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2023-06-09T04:38:20.712 DEBUG:teuthology.orchestra.run.smithi018:> import re 2023-06-09T04:38:20.712 DEBUG:teuthology.orchestra.run.smithi018:> import os 2023-06-09T04:38:20.713 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2023-06-09T04:38:20.713 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:20.713 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2023-06-09T04:38:20.713 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-09T04:38:20.714 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2023-06-09T04:38:20.714 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-09T04:38:20.714 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:20.715 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2023-06-09T04:38:20.715 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2023-06-09T04:38:20.715 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2023-06-09T04:38:20.715 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2023-06-09T04:38:20.716 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:20.716 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2023-06-09T04:38:20.716 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:20.716 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:20.717 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:20.717 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2023-06-09T04:38:20.717 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2023-06-09T04:38:20.718 DEBUG:teuthology.orchestra.run.smithi018:> return f 2023-06-09T04:38:20.718 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:20.718 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:20.718 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2023-06-09T04:38:20.719 DEBUG:teuthology.orchestra.run.smithi018:> ' 2023-06-09T04:38:20.836 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.43325.asok 2023-06-09T04:38:21.017 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43325.asok 2023-06-09T04:38:21.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43325.asok status 2023-06-09T04:38:21.178 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:38:21.178 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2023-06-09T04:38:21.178 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:21.178 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:21.178 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "43325", 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:21.179 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4464, 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4464 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:38:21.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3041946124 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:38:21.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3041946124 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4464 192.168.0.1:0/3041946124", 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/3041946124", 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 6, 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 28, 2023-06-09T04:38:21.182 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:21.183 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2023-06-09T04:38:21.183 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2023-06-09T04:38:21.183 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:38:21.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.192 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2023-06-09T04:38:21.192 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:21.198 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2023-06-09T04:38:21.199 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:21.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:21.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.256 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-09T04:38:21.344 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2023-06-09T04:38:21.344 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-09T04:38:21.344 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:21.345 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:38:21.345 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:21.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.559+0000 7f0573bc6640 1 Processor -- start 2023-06-09T04:38:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.559+0000 7f0573bc6640 1 -- start start 2023-06-09T04:38:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0573bc6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f056c15a3e0 0x7f056c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0573bc6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c15cf10 con 0x7f056c0700a0 2023-06-09T04:38:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0573bc6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c070520 con 0x7f056c159320 2023-06-09T04:38:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0573bc6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c15dd90 con 0x7f056c15a3e0 2023-06-09T04:38:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0571161640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f056c15a3e0 0x7f056c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0572163640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f056c0700a0 0x7f056c06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56184/0 (socket says 172.21.15.18:56184) 2023-06-09T04:38:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0571161640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f056c15a3e0 0x7f056c06fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37566/0 (socket says 172.21.15.18:37566) 2023-06-09T04:38:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0572163640 1 -- 172.21.15.18:0/852107748 learned_addr learned my addr 172.21.15.18:0/852107748 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0571161640 1 -- 172.21.15.18:0/852107748 >> v1:172.21.15.81:6789/0 conn(0x7f056c159320 legacy=0x7f056c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0571161640 1 -- 172.21.15.18:0/852107748 >> v1:172.21.15.18:6789/0 conn(0x7f056c0700a0 legacy=0x7f056c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0571161640 1 -- 172.21.15.18:0/852107748 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0c81b0 con 0x7f056c15a3e0 2023-06-09T04:38:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0570960640 1 -- 172.21.15.18:0/852107748 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154914439 0 0) 0x7f056c15cf10 con 0x7f056c0700a0 2023-06-09T04:38:21.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.563+0000 7f0571161640 1 --2- 172.21.15.18:0/852107748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c15a3e0 0x7f056c06fb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f055c0097c0 tx=0x7f055c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e3c3240ab42a50 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0570960640 1 -- 172.21.15.18:0/852107748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0ab600 con 0x7f056c15a3e0 2023-06-09T04:38:21.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0570960640 1 -- 172.21.15.18:0/852107748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0a7050 con 0x7f056c15a3e0 2023-06-09T04:38:21.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0570960640 1 -- 172.21.15.18:0/852107748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0ab980 con 0x7f056c15a3e0 2023-06-09T04:38:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- 172.21.15.18:0/852107748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c15a3e0 msgr2=0x7f056c06fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 --2- 172.21.15.18:0/852107748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c15a3e0 0x7f056c06fb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f055c0097c0 tx=0x7f055c01c3c0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- 172.21.15.18:0/852107748 shutdown_connections 2023-06-09T04:38:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 --2- 172.21.15.18:0/852107748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c15a3e0 0x7f056c06fb60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- 172.21.15.18:0/852107748 >> 172.21.15.18:0/852107748 conn(0x7f056c0b0240 msgr2=0x7f056c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- 172.21.15.18:0/852107748 shutdown_connections 2023-06-09T04:38:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- 172.21.15.18:0/852107748 wait complete. 2023-06-09T04:38:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 Processor -- start 2023-06-09T04:38:21.573 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- start start 2023-06-09T04:38:21.574 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 0x7f056c143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c159320 0x7f056c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f056c15a3e0 0x7f056c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c14f830 con 0x7f056c0700a0 2023-06-09T04:38:21.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0c4fe0 con 0x7f056c159320 2023-06-09T04:38:21.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0573bc6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0b1ea0 con 0x7f056c15a3e0 2023-06-09T04:38:21.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 0x7f056c143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 0x7f056c143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37572/0 (socket says 172.21.15.18:37572) 2023-06-09T04:38:21.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 -- 172.21.15.18:0/4163524647 learned_addr learned my addr 172.21.15.18:0/4163524647 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0572163640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f056c15a3e0 0x7f056c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571161640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c159320 0x7f056c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 -- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f056c15a3e0 msgr2=0x7f056c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f056c15a3e0 0x7f056c158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 -- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c159320 msgr2=0x7f056c157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c159320 0x7f056c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.578 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.567+0000 7f0571962640 1 -- 172.21.15.18:0/4163524647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c009420 con 0x7f056c0700a0 2023-06-09T04:38:21.579 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f0571962640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 0x7f056c143960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f056800c500 tx=0x7f056800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568005220 con 0x7f056c0700a0 2023-06-09T04:38:21.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568005380 con 0x7f056c0700a0 2023-06-09T04:38:21.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568007270 con 0x7f056c0700a0 2023-06-09T04:38:21.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0b2180 con 0x7f056c0700a0 2023-06-09T04:38:21.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c0b2740 con 0x7f056c0700a0 2023-06-09T04:38:21.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.571+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c0ce690 con 0x7f056c0700a0 2023-06-09T04:38:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.575+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05680073d0 con 0x7f056c0700a0 2023-06-09T04:38:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.575+0000 7f05627fc640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0550066280 0x7f0550068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.575+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0568083980 con 0x7f056c0700a0 2023-06-09T04:38:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.575+0000 7f0571161640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0550066280 0x7f0550068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.575+0000 7f0571161640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0550066280 0x7f0550068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f055c0ad000 tx=0x7f055c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.579+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0568050b20 con 0x7f056c0700a0 2023-06-09T04:38:21.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.735+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f056c0ce420 con 0x7f056c0700a0 2023-06-09T04:38:21.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.735+0000 7f05627fc640 1 -- 172.21.15.18:0/4163524647 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f0568054140 con 0x7f056c0700a0 2023-06-09T04:38:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:21.743 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:21.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0550066280 msgr2=0x7f0550068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0550066280 0x7f0550068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f055c0ad000 tx=0x7f055c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 msgr2=0x7f056c143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 0x7f056c143960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f056800c500 tx=0x7f056800c9c0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 shutdown_connections 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0550066280 0x7f0550068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f056c15a3e0 0x7f056c158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f056c159320 0x7f056c157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 --2- 172.21.15.18:0/4163524647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f056c0700a0 0x7f056c143960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 >> 172.21.15.18:0/4163524647 conn(0x7f056c0b0240 msgr2=0x7f056c15d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 shutdown_connections 2023-06-09T04:38:21.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.739+0000 7f0573bc6640 1 -- 172.21.15.18:0/4163524647 wait complete. 2023-06-09T04:38:21.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:38:21.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:21.887 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 Processor -- start 2023-06-09T04:38:21.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 -- start start 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9bd0155d20 0x7f9bd015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bd01595d0 0x7f9bd006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd00c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd015ce40 con 0x7f9bd0155d20 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00cc450 con 0x7f9bd01595d0 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd6791640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd015c880 con 0x7f9bd006c310 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9bd0155d20 0x7f9bd015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9bd0155d20 0x7f9bd015bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37580/0 (socket says 172.21.15.18:37580) 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 -- 172.21.15.18:0/329050971 learned_addr learned my addr 172.21.15.18:0/329050971 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcf7fe640 1 --2- 172.21.15.18:0/329050971 >> v2:172.21.15.81:3300/0 conn(0x7f9bd01595d0 0x7f9bd006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bd4d2e640 1 --2- 172.21.15.18:0/329050971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd00c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 -- 172.21.15.18:0/329050971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 msgr2=0x7f9bd00c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 --2- 172.21.15.18:0/329050971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd00c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 -- 172.21.15.18:0/329050971 >> v2:172.21.15.81:3300/0 conn(0x7f9bd01595d0 msgr2=0x7f9bd006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:21.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 --2- 172.21.15.18:0/329050971 >> v2:172.21.15.81:3300/0 conn(0x7f9bd01595d0 0x7f9bd006bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.883+0000 7f9bcffff640 1 -- 172.21.15.18:0/329050971 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd015cb60 con 0x7f9bd0155d20 2023-06-09T04:38:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bcffff640 1 --2- 172.21.15.18:0/329050971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd015bf10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd006de60 tx=0x7f9bc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06b02136101a85a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bceffd640 1 -- 172.21.15.18:0/329050971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00ac600 con 0x7f9bd0155d20 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bceffd640 1 -- 172.21.15.18:0/329050971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc00a8050 con 0x7f9bd0155d20 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bceffd640 1 -- 172.21.15.18:0/329050971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00ac980 con 0x7f9bd0155d20 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- 172.21.15.18:0/329050971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 msgr2=0x7f9bd015bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- 172.21.15.18:0/329050971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd015bf10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bd006de60 tx=0x7f9bc001c4d0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- 172.21.15.18:0/329050971 shutdown_connections 2023-06-09T04:38:21.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- 172.21.15.18:0/329050971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd00c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- 172.21.15.18:0/329050971 >> v2:172.21.15.81:3300/0 conn(0x7f9bd01595d0 0x7f9bd006bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- 172.21.15.18:0/329050971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd015bf10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- 172.21.15.18:0/329050971 >> 172.21.15.18:0/329050971 conn(0x7f9bd00afa90 msgr2=0x7f9bd00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- 172.21.15.18:0/329050971 shutdown_connections 2023-06-09T04:38:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- 172.21.15.18:0/329050971 wait complete. 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 Processor -- start 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- start start 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd01455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd01595d0 0x7f9bd01599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd015ae30 con 0x7f9bd0155d20 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00b1f70 con 0x7f9bd01595d0 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.887+0000 7f9bd6791640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0145b10 con 0x7f9bd006c310 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd01455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd01455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37582/0 (socket says 172.21.15.18:37582) 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 -- 172.21.15.18:0/3017193725 learned_addr learned my addr 172.21.15.18:0/3017193725 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcffff640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bd4d2e640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd01595d0 0x7f9bd01599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 -- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 msgr2=0x7f9bd015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 -- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd01595d0 msgr2=0x7f9bd01599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd01595d0 0x7f9bd01599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 -- 172.21.15.18:0/3017193725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc0009470 con 0x7f9bd0155d20 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcf7fe640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd01455d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d620 tx=0x7f9bc400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40125f0 con 0x7f9bd0155d20 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4012750 con 0x7f9bd0155d20 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd015a220 con 0x7f9bd0155d20 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4012ae0 con 0x7f9bd0155d20 2023-06-09T04:38:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd015a5b0 con 0x7f9bd0155d20 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd0073380 con 0x7f9bd0155d20 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9bc4012c40 con 0x7f9bd0155d20 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bccff9640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9bbc066280 0x7f9bbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9bc4084410 con 0x7f9bd0155d20 2023-06-09T04:38:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.891+0000 7f9bcffff640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9bbc066280 0x7f9bbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.895+0000 7f9bcffff640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9bbc066280 0x7f9bbc068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00ae000 tx=0x7f9bc00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:21.895+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bc4051630 con 0x7f9bd0155d20 2023-06-09T04:38:22.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.051+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bd00b20b0 con 0x7f9bd0155d20 2023-06-09T04:38:22.059 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bccff9640 1 -- 172.21.15.18:0/3017193725 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bc4007380 con 0x7f9bd0155d20 2023-06-09T04:38:22.059 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:22.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9bbc066280 msgr2=0x7f9bbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9bbc066280 0x7f9bbc068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00ae000 tx=0x7f9bc00a7000 comp rx=0 tx=0).stop 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 msgr2=0x7f9bd01455d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd01455d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400d620 tx=0x7f9bc400dae0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 shutdown_connections 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd01595d0 0x7f9bd01599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9bd0155d20 0x7f9bd01455d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9bbc066280 0x7f9bbc068730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 --2- 172.21.15.18:0/3017193725 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bd006c310 0x7f9bd015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 >> 172.21.15.18:0/3017193725 conn(0x7f9bd00afa90 msgr2=0x7f9bd0069330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 shutdown_connections 2023-06-09T04:38:22.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.055+0000 7f9bd6791640 1 -- 172.21.15.18:0/3017193725 wait complete. 2023-06-09T04:38:22.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:22.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f236aa89640 1 Processor -- start 2023-06-09T04:38:22.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f236aa89640 1 -- start start 2023-06-09T04:38:22.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f236aa89640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 0x7f23641609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f236aa89640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23641639a0 con 0x7f2364156af0 2023-06-09T04:38:22.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f236aa89640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2364163c80 con 0x7f2364163530 2023-06-09T04:38:22.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f236aa89640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236406fbd0 con 0x7f23640ad170 2023-06-09T04:38:22.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2364156af0 0x7f23640aca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56198/0 (socket says 172.21.15.18:56198) 2023-06-09T04:38:22.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 -- 172.21.15.18:0/1058126035 learned_addr learned my addr 172.21.15.18:0/1058126035 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:22.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2369026640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 0x7f23641609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817032307 0 0) 0x7f23641639a0 con 0x7f2364156af0 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c003530 con 0x7f2364156af0 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2743558947 0 0) 0x7f234c003530 con 0x7f2364156af0 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 msgr2=0x7f23641609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 0x7f23641609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 >> v1:172.21.15.81:6789/0 conn(0x7f2364163530 legacy=0x7f2364070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364163f60 con 0x7f2364156af0 2023-06-09T04:38:22.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f2354001b80 con 0x7f2364156af0 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 >> v1:172.21.15.18:6789/0 conn(0x7f2364156af0 legacy=0x7f23640aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f234c0039b0 0x7f234c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234c0047d0 0x7f234c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 0x7f234c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236406fbd0 con 0x7f234c0039b0 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00ba40 con 0x7f234c0047d0 2023-06-09T04:38:22.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00bbd0 con 0x7f23640ad170 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f234c0039b0 0x7f234c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2369026640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 0x7f234c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2363fff640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234c0047d0 0x7f234c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 -- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 msgr2=0x7f234c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23640ad170 0x7f234c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 -- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234c0047d0 msgr2=0x7f234c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234c0047d0 0x7f234c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.203+0000 7f2368825640 1 -- 172.21.15.18:0/1058126035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c003530 con 0x7f234c0039b0 2023-06-09T04:38:22.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f2368825640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f234c0039b0 0x7f234c003dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f235400c520 tx=0x7f235401da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869dc812a6ffa279 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540a5b90 con 0x7f234c0039b0 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540a5cf0 con 0x7f234c0039b0 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f23637fe640 1 -- 172.21.15.18:0/1058126035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540a5ea0 con 0x7f234c0039b0 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f236aa89640 1 -- 172.21.15.18:0/1058126035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f234c0039b0 msgr2=0x7f234c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f236aa89640 1 --2- 172.21.15.18:0/1058126035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f234c0039b0 0x7f234c003dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f235400c520 tx=0x7f235401da00 comp rx=0 tx=0).stop 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f2369026640 1 -- 172.21.15.18:0/1058126035 reap_dead start 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f236aa89640 1 -- 172.21.15.18:0/1058126035 shutdown_connections 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f236aa89640 1 -- 172.21.15.18:0/1058126035 >> 172.21.15.18:0/1058126035 conn(0x7f23640afa90 msgr2=0x7f23640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f236aa89640 1 -- 172.21.15.18:0/1058126035 shutdown_connections 2023-06-09T04:38:22.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.207+0000 7f236aa89640 1 -- 172.21.15.18:0/1058126035 wait complete. 2023-06-09T04:38:22.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 Processor -- start 2023-06-09T04:38:22.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- start start 2023-06-09T04:38:22.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2364142cc0 0x7f23641527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2364143090 0x7f23640b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 0x7f2364069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23641523c0 con 0x7f23640b30b0 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364151a90 con 0x7f2364143090 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2364151d00 con 0x7f2364142cc0 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 0x7f2364069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 0x7f2364069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37604/0 (socket says 172.21.15.18:37604) 2023-06-09T04:38:22.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 -- 172.21.15.18:0/188801096 learned_addr learned my addr 172.21.15.18:0/188801096 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2368825640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2364142cc0 0x7f23641527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2363fff640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2364143090 0x7f23640b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 -- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2364142cc0 msgr2=0x7f23641527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2364142cc0 0x7f23641527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 -- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2364143090 msgr2=0x7f23640b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2364143090 0x7f23640b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 -- 172.21.15.18:0/188801096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364151fe0 con 0x7f23640b30b0 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2363fff640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2364143090 0x7f23640b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f2369026640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 0x7f2364069430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f236406ab80 tx=0x7f235c011490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c004500 con 0x7f23640b30b0 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c011810 con 0x7f23640b30b0 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2364152d20 con 0x7f23640b30b0 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c011be0 con 0x7f23640b30b0 2023-06-09T04:38:22.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23640b36e0 con 0x7f23640b30b0 2023-06-09T04:38:22.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.211+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2364152500 con 0x7f23640b30b0 2023-06-09T04:38:22.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.215+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f235c011d40 con 0x7f23640b30b0 2023-06-09T04:38:22.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.215+0000 7f23617fa640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2350066280 0x7f2350068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.215+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f235c083cd0 con 0x7f23640b30b0 2023-06-09T04:38:22.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.215+0000 7f2368825640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2350066280 0x7f2350068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.215+0000 7f2368825640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2350066280 0x7f2350068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23540aa000 tx=0x7f23540b0040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.215+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f235c050fd0 con 0x7f23640b30b0 2023-06-09T04:38:22.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.375+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2364152500 con 0x7f23640b30b0 2023-06-09T04:38:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f23617fa640 1 -- 172.21.15.18:0/188801096 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2364152500 con 0x7f23640b30b0 2023-06-09T04:38:22.383 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2350066280 msgr2=0x7f2350068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2350066280 0x7f2350068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23540aa000 tx=0x7f23540b0040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 msgr2=0x7f2364069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 0x7f2364069430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f236406ab80 tx=0x7f235c011490 comp rx=0 tx=0).stop 2023-06-09T04:38:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 shutdown_connections 2023-06-09T04:38:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23640b30b0 0x7f2364069430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2364143090 0x7f23640b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2350066280 0x7f2350068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 --2- 172.21.15.18:0/188801096 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2364142cc0 0x7f23641527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 >> 172.21.15.18:0/188801096 conn(0x7f23640afa90 msgr2=0x7f23640cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 shutdown_connections 2023-06-09T04:38:22.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.379+0000 7f236aa89640 1 -- 172.21.15.18:0/188801096 wait complete. 2023-06-09T04:38:22.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:22.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b2e50640 1 Processor -- start 2023-06-09T04:38:22.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b2e50640 1 -- start start 2023-06-09T04:38:22.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b2e50640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82ac0ccc00 0x7f82ac0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b2e50640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac15bbb0 con 0x7f82ac15b7e0 2023-06-09T04:38:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b2e50640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac0cd080 con 0x7f82ac0cc780 2023-06-09T04:38:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b2e50640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ac0ca3c0 con 0x7f82ac0ccc00 2023-06-09T04:38:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b0bec640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f82ac15b7e0 0x7f82ac15f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56212/0 (socket says 172.21.15.18:56212) 2023-06-09T04:38:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b0bec640 1 -- 172.21.15.18:0/3161229048 learned_addr learned my addr 172.21.15.18:0/3161229048 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b13ed640 1 --2- 172.21.15.18:0/3161229048 >> v2:172.21.15.81:3300/0 conn(0x7f82ac0ccc00 0x7f82ac0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482496175 0 0) 0x7f82ac15bbb0 con 0x7f82ac15b7e0 2023-06-09T04:38:22.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8294003530 con 0x7f82ac15b7e0 2023-06-09T04:38:22.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3847916565 0 0) 0x7f8294003530 con 0x7f82ac15b7e0 2023-06-09T04:38:22.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 >> v2:172.21.15.81:3300/0 conn(0x7f82ac0ccc00 msgr2=0x7f82ac0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 --2- 172.21.15.18:0/3161229048 >> v2:172.21.15.81:3300/0 conn(0x7f82ac0ccc00 0x7f82ac0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 >> v1:172.21.15.81:6789/0 conn(0x7f82ac0cc780 legacy=0x7f82ac0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac15fd80 con 0x7f82ac15b7e0 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f829c001680 con 0x7f82ac15b7e0 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 >> v1:172.21.15.18:6789/0 conn(0x7f82ac15b7e0 legacy=0x7f82ac15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8294003980 0x7f8294003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82940047d0 0x7f8294004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8294005180 0x7f829400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0ca3c0 con 0x7f82940047d0 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829400c000 con 0x7f8294005180 2023-06-09T04:38:22.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829400c1c0 con 0x7f8294003980 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82abfff640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82940047d0 0x7f8294004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b13ed640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8294005180 0x7f829400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b0bec640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8294003980 0x7f8294003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82abfff640 1 -- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8294003980 msgr2=0x7f8294003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82abfff640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8294003980 0x7f8294003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82abfff640 1 -- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8294005180 msgr2=0x7f829400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82abfff640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8294005180 0x7f829400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82abfff640 1 -- 172.21.15.18:0/3161229048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294003530 con 0x7f82940047d0 2023-06-09T04:38:22.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b13ed640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8294005180 0x7f829400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:22.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.519+0000 7f82b13ed640 1 -- 172.21.15.18:0/3161229048 reap_dead start 2023-06-09T04:38:22.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82abfff640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82940047d0 0x7f8294004c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82a0001780 tx=0x7f82a001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6746495ad204ba5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00052d0 con 0x7f82940047d0 2023-06-09T04:38:22.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a00a7050 con 0x7f82940047d0 2023-06-09T04:38:22.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82ab7fe640 1 -- 172.21.15.18:0/3161229048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0003600 con 0x7f82940047d0 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 -- 172.21.15.18:0/3161229048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82940047d0 msgr2=0x7f8294004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82940047d0 0x7f8294004c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82a0001780 tx=0x7f82a001c3e0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 -- 172.21.15.18:0/3161229048 shutdown_connections 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3161229048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82940047d0 0x7f8294004c40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 -- 172.21.15.18:0/3161229048 >> 172.21.15.18:0/3161229048 conn(0x7f82ac06ce60 msgr2=0x7f82ac06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 -- 172.21.15.18:0/3161229048 shutdown_connections 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 -- 172.21.15.18:0/3161229048 wait complete. 2023-06-09T04:38:22.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 Processor -- start 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.523+0000 7f82b2e50640 1 -- start start 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82940047d0 0x7f82ac0af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ac0b1470 0x7f82ac159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 0x7f82ac0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac15a7e0 con 0x7f82ac15a370 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0c8d10 con 0x7f82ac0b1470 2023-06-09T04:38:22.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0c83e0 con 0x7f82940047d0 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 0x7f82ac0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 0x7f82ac0b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37624/0 (socket says 172.21.15.18:37624) 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 -- 172.21.15.18:0/3796458278 learned_addr learned my addr 172.21.15.18:0/3796458278 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b0bec640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82940047d0 0x7f82ac0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82abfff640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ac0b1470 0x7f82ac159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 -- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82940047d0 msgr2=0x7f82ac0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82940047d0 0x7f82ac0af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 -- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ac0b1470 msgr2=0x7f82ac159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ac0b1470 0x7f82ac159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 -- 172.21.15.18:0/3796458278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0c86c0 con 0x7f82ac15a370 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b13ed640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 0x7f82ac0b3760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0b2900 tx=0x7f82a4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400f8a0 con 0x7f82ac15a370 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a400fa00 con 0x7f82ac15a370 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac0c89a0 con 0x7f82ac15a370 2023-06-09T04:38:22.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400fd70 con 0x7f82ac15a370 2023-06-09T04:38:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac0b4620 con 0x7f82ac15a370 2023-06-09T04:38:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ac0cc110 con 0x7f82ac15a370 2023-06-09T04:38:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82a4016420 con 0x7f82ac15a370 2023-06-09T04:38:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82a97fa640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8298066280 0x7f8298068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82a4084570 con 0x7f82ac15a370 2023-06-09T04:38:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.527+0000 7f82b0bec640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8298066280 0x7f8298068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.531+0000 7f82b0bec640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8298066280 0x7f8298068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f829c001060 tx=0x7f829c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.535+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82a4051700 con 0x7f82ac15a370 2023-06-09T04:38:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82ac0b4620 con 0x7f82ac15a370 2023-06-09T04:38:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82a97fa640 1 -- 172.21.15.18:0/3796458278 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f82ac0b4620 con 0x7f82ac15a370 2023-06-09T04:38:22.693 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:22.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8298066280 msgr2=0x7f8298068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8298066280 0x7f8298068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f829c001060 tx=0x7f829c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 msgr2=0x7f82ac0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 0x7f82ac0b3760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0b2900 tx=0x7f82a4009f50 comp rx=0 tx=0).stop 2023-06-09T04:38:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.687+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 shutdown_connections 2023-06-09T04:38:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ac15a370 0x7f82ac0b3760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ac0b1470 0x7f82ac159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8298066280 0x7f8298068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 --2- 172.21.15.18:0/3796458278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82940047d0 0x7f82ac0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 >> 172.21.15.18:0/3796458278 conn(0x7f82ac06ce60 msgr2=0x7f82ac0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 shutdown_connections 2023-06-09T04:38:22.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.691+0000 7f82b2e50640 1 -- 172.21.15.18:0/3796458278 wait complete. 2023-06-09T04:38:22.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:22.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 Processor -- start 2023-06-09T04:38:22.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 -- start start 2023-06-09T04:38:22.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e6c1595b0 0x7f4e6c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e6c0cf890 0x7f4e6c0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c159980 con 0x7f4e6c0cc9a0 2023-06-09T04:38:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c0cbfc0 con 0x7f4e6c0cf890 2023-06-09T04:38:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e747d7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c0ce710 con 0x7f4e6c1595b0 2023-06-09T04:38:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e6c0cf890 0x7f4e6c0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e6c0cf890 0x7f4e6c0cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37636/0 (socket says 172.21.15.18:37636) 2023-06-09T04:38:22.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 -- 172.21.15.18:0/4055357267 learned_addr learned my addr 172.21.15.18:0/4055357267 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e72573640 1 --2- 172.21.15.18:0/4055357267 >> v2:172.21.15.81:3300/0 conn(0x7f4e6c1595b0 0x7f4e6c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 -- 172.21.15.18:0/4055357267 >> v2:172.21.15.81:3300/0 conn(0x7f4e6c1595b0 msgr2=0x7f4e6c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 --2- 172.21.15.18:0/4055357267 >> v2:172.21.15.81:3300/0 conn(0x7f4e6c1595b0 0x7f4e6c0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 -- 172.21.15.18:0/4055357267 >> v1:172.21.15.81:6789/0 conn(0x7f4e6c0cc9a0 legacy=0x7f4e6c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e71d72640 1 -- 172.21.15.18:0/4055357267 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0cabb0 con 0x7f4e6c0cf890 2023-06-09T04:38:22.847 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.839+0000 7f4e72573640 1 --2- 172.21.15.18:0/4055357267 >> v2:172.21.15.81:3300/0 conn(0x7f4e6c1595b0 0x7f4e6c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e71d72640 1 --2- 172.21.15.18:0/4055357267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c0cf890 0x7f4e6c0cc460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c06db50 tx=0x7f4e5c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce353f80db19057 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e71571640 1 -- 172.21.15.18:0/4055357267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0ab610 con 0x7f4e6c0cf890 2023-06-09T04:38:22.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e71571640 1 -- 172.21.15.18:0/4055357267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c0ab770 con 0x7f4e6c0cf890 2023-06-09T04:38:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e71571640 1 -- 172.21.15.18:0/4055357267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0abb00 con 0x7f4e6c0cf890 2023-06-09T04:38:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 -- 172.21.15.18:0/4055357267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c0cf890 msgr2=0x7f4e6c0cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 --2- 172.21.15.18:0/4055357267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c0cf890 0x7f4e6c0cc460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c06db50 tx=0x7f4e5c01c500 comp rx=0 tx=0).stop 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 -- 172.21.15.18:0/4055357267 shutdown_connections 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 --2- 172.21.15.18:0/4055357267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c0cf890 0x7f4e6c0cc460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 --2- 172.21.15.18:0/4055357267 >> v2:172.21.15.81:3300/0 conn(0x7f4e6c1595b0 0x7f4e6c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 -- 172.21.15.18:0/4055357267 >> 172.21.15.18:0/4055357267 conn(0x7f4e6c06ce60 msgr2=0x7f4e6c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 -- 172.21.15.18:0/4055357267 shutdown_connections 2023-06-09T04:38:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 -- 172.21.15.18:0/4055357267 wait complete. 2023-06-09T04:38:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 Processor -- start 2023-06-09T04:38:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.843+0000 7f4e747d7640 1 -- start start 2023-06-09T04:38:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c0cc9a0 0x7f4e6c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c0cf890 0x7f4e6c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 0x7f4e6c06b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c06cac0 con 0x7f4e6c1595b0 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c06bf40 con 0x7f4e6c0cc9a0 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c06c220 con 0x7f4e6c0cf890 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 0x7f4e6c06b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 0x7f4e6c06b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37642/0 (socket says 172.21.15.18:37642) 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 -- 172.21.15.18:0/2320760719 learned_addr learned my addr 172.21.15.18:0/2320760719 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72573640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c0cc9a0 0x7f4e6c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e71d72640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c0cf890 0x7f4e6c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 -- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c0cf890 msgr2=0x7f4e6c15a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c0cf890 0x7f4e6c15a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 -- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c0cc9a0 msgr2=0x7f4e6c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c0cc9a0 0x7f4e6c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 -- 172.21.15.18:0/2320760719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c0094d0 con 0x7f4e6c1595b0 2023-06-09T04:38:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72573640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c0cc9a0 0x7f4e6c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72d74640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 0x7f4e6c06b0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c730 tx=0x7f4e6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64003b80 con 0x7f4e6c1595b0 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e64003ce0 con 0x7f4e6c1595b0 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400aa30 con 0x7f4e6c1595b0 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c0ce9f0 con 0x7f4e6c1595b0 2023-06-09T04:38:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c06c7e0 con 0x7f4e6c1595b0 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c073380 con 0x7f4e6c1595b0 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e6400ab90 con 0x7f4e6c1595b0 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e62ffd640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e50066280 0x7f4e50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e64083d80 con 0x7f4e6c1595b0 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.847+0000 7f4e72573640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e50066280 0x7f4e50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.851+0000 7f4e72573640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e50066280 0x7f4e50068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009970 tx=0x7f4e68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:22.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:22.851+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e64050f10 con 0x7f4e6c1595b0 2023-06-09T04:38:23.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.007+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e6c06ecb0 con 0x7f4e6c1595b0 2023-06-09T04:38:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e62ffd640 1 -- 172.21.15.18:0/2320760719 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e64054530 con 0x7f4e6c1595b0 2023-06-09T04:38:23.015 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:38:23.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e50066280 msgr2=0x7f4e50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e50066280 0x7f4e50068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009970 tx=0x7f4e68008040 comp rx=0 tx=0).stop 2023-06-09T04:38:23.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 msgr2=0x7f4e6c06b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 0x7f4e6c06b0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c730 tx=0x7f4e6400cbf0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 shutdown_connections 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e6c1595b0 0x7f4e6c06b0e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e50066280 0x7f4e50068730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e6c0cf890 0x7f4e6c15a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 --2- 172.21.15.18:0/2320760719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c0cc9a0 0x7f4e6c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 >> 172.21.15.18:0/2320760719 conn(0x7f4e6c06ce60 msgr2=0x7f4e6c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 shutdown_connections 2023-06-09T04:38:23.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.011+0000 7f4e747d7640 1 -- 172.21.15.18:0/2320760719 wait complete. 2023-06-09T04:38:23.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:38:23.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec24dd640 1 Processor -- start 2023-06-09T04:38:23.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec24dd640 1 -- start start 2023-06-09T04:38:23.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec24dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faebc15b7e0 0x7faebc15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec24dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc15bbb0 con 0x7faebc0cce90 2023-06-09T04:38:23.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec24dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc15fd80 con 0x7faebc15f800 2023-06-09T04:38:23.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec24dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faebc0ca3c0 con 0x7faebc15b7e0 2023-06-09T04:38:23.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec0a7a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faebc0cce90 0x7faebc0cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56222/0 (socket says 172.21.15.18:56222) 2023-06-09T04:38:23.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec0a7a640 1 -- 172.21.15.18:0/3911194119 learned_addr learned my addr 172.21.15.18:0/3911194119 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:23.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebbfff640 1 --2- 172.21.15.18:0/3911194119 >> v2:172.21.15.81:3300/0 conn(0x7faebc15b7e0 0x7faebc15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542423904 0 0) 0x7faebc15bbb0 con 0x7faebc0cce90 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faea8003530 con 0x7faebc0cce90 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1194141748 0 0) 0x7faea8003530 con 0x7faebc0cce90 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 >> v2:172.21.15.81:3300/0 conn(0x7faebc15b7e0 msgr2=0x7faebc15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 --2- 172.21.15.18:0/3911194119 >> v2:172.21.15.81:3300/0 conn(0x7faebc15b7e0 0x7faebc15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 >> v1:172.21.15.81:6789/0 conn(0x7faebc15f800 legacy=0x7faebc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc160060 con 0x7faebc0cce90 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7faeb4001a00 con 0x7faebc0cce90 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 >> v1:172.21.15.18:6789/0 conn(0x7faebc0cce90 legacy=0x7faebc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8003980 0x7faea8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faea80047d0 0x7faea8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faea8005180 0x7faea800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0ca3c0 con 0x7faea80047d0 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea800c000 con 0x7faea8003980 2023-06-09T04:38:23.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea800c1c0 con 0x7faea8005180 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faeb3fff640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faea80047d0 0x7faea8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faebbfff640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8003980 0x7faea8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faeb3fff640 1 -- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faea8005180 msgr2=0x7faea800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec0a7a640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faea8005180 0x7faea800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faeb3fff640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faea8005180 0x7faea800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faeb3fff640 1 -- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8003980 msgr2=0x7faea8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faeb3fff640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea8003980 0x7faea8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faec0a7a640 1 -- 172.21.15.18:0/3911194119 reap_dead start 2023-06-09T04:38:23.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.159+0000 7faeb3fff640 1 -- 172.21.15.18:0/3911194119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8003530 con 0x7faea80047d0 2023-06-09T04:38:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faeb3fff640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faea80047d0 0x7faea8004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faea4001780 tx=0x7faea401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2eac109b8ad087 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40052d0 con 0x7faea80047d0 2023-06-09T04:38:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea40a7050 con 0x7faea80047d0 2023-06-09T04:38:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faebb7fe640 1 -- 172.21.15.18:0/3911194119 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4003600 con 0x7faea80047d0 2023-06-09T04:38:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 -- 172.21.15.18:0/3911194119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faea80047d0 msgr2=0x7faea8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faea80047d0 0x7faea8004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faea4001780 tx=0x7faea401c400 comp rx=0 tx=0).stop 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 -- 172.21.15.18:0/3911194119 shutdown_connections 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 --2- 172.21.15.18:0/3911194119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faea80047d0 0x7faea8004c40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 -- 172.21.15.18:0/3911194119 >> 172.21.15.18:0/3911194119 conn(0x7faebc06ce60 msgr2=0x7faebc06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 -- 172.21.15.18:0/3911194119 shutdown_connections 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 -- 172.21.15.18:0/3911194119 wait complete. 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 Processor -- start 2023-06-09T04:38:23.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.163+0000 7faec24dd640 1 -- start start 2023-06-09T04:38:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea80047d0 0x7faebc1ee720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faebc1f47d0 0x7faebc1f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 0x7faebc0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1f5180 con 0x7faebc0b0630 2023-06-09T04:38:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1eec60 con 0x7faea80047d0 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0c7070 con 0x7faebc1f47d0 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 0x7faebc0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 0x7faebc0b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37662/0 (socket says 172.21.15.18:37662) 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 -- 172.21.15.18:0/879333475 learned_addr learned my addr 172.21.15.18:0/879333475 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb3fff640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faebc1f47d0 0x7faebc1f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faebbfff640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea80047d0 0x7faebc1ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 -- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faebc1f47d0 msgr2=0x7faebc1f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faebc1f47d0 0x7faebc1f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 -- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea80047d0 msgr2=0x7faebc1ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea80047d0 0x7faebc1ee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 -- 172.21.15.18:0/879333475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc1f5620 con 0x7faebc0b0630 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec0a7a640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 0x7faebc0b0aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faebc15fbd0 tx=0x7faeb4010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4012670 con 0x7faebc0b0630 2023-06-09T04:38:23.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb40127d0 con 0x7faebc0b0630 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc0b1310 con 0x7faebc0b0630 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4012b80 con 0x7faebc0b0630 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc0b18d0 con 0x7faebc0b0630 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc0c6e40 con 0x7faebc0b0630 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faeb4012ce0 con 0x7faebc0b0630 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb97fa640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fae9c0662b0 0x7fae9c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faeb40864f0 con 0x7faebc0b0630 2023-06-09T04:38:23.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.167+0000 7faebbfff640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fae9c0662b0 0x7fae9c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.171+0000 7faebbfff640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fae9c0662b0 0x7fae9c068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faebc0c8c00 tx=0x7faeac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.171+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faebc0c6e40 con 0x7faebc0b0630 2023-06-09T04:38:23.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.327+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faebc0b1af0 con 0x7faebc0b0630 2023-06-09T04:38:23.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.327+0000 7faeb97fa640 1 -- 172.21.15.18:0/879333475 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7faeb4053710 con 0x7faebc0b0630 2023-06-09T04:38:23.335 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:23.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fae9c0662b0 msgr2=0x7fae9c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fae9c0662b0 0x7fae9c068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faebc0c8c00 tx=0x7faeac008040 comp rx=0 tx=0).stop 2023-06-09T04:38:23.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 msgr2=0x7faebc0b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 0x7faebc0b0aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faebc15fbd0 tx=0x7faeb4010bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 shutdown_connections 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faebc0b0630 0x7faebc0b0aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fae9c0662b0 0x7fae9c068760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faebc1f47d0 0x7faebc1f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 --2- 172.21.15.18:0/879333475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faea80047d0 0x7faebc1ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 >> 172.21.15.18:0/879333475 conn(0x7faebc06ce60 msgr2=0x7faebc0b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 shutdown_connections 2023-06-09T04:38:23.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.331+0000 7faec24dd640 1 -- 172.21.15.18:0/879333475 wait complete. 2023-06-09T04:38:23.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:23.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 Processor -- start 2023-06-09T04:38:23.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 -- start start 2023-06-09T04:38:23.476 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f020c0cc9b0 0x7f020c15f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.476 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f020c0b3fe0 0x7f020c15f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c15c950 con 0x7f020c0b7480 2023-06-09T04:38:23.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c0ce320 con 0x7f020c0b3fe0 2023-06-09T04:38:23.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0213ed3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c0cc4b0 con 0x7f020c0cc9b0 2023-06-09T04:38:23.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0212470640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f020c0b3fe0 0x7f020c15f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0211c6f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f020c0b7480 0x7f020c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56232/0 (socket says 172.21.15.18:56232) 2023-06-09T04:38:23.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0211c6f640 1 -- 172.21.15.18:0/3604845509 learned_addr learned my addr 172.21.15.18:0/3604845509 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:23.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f021146e640 1 --2- 172.21.15.18:0/3604845509 >> v2:172.21.15.81:3300/0 conn(0x7f020c0cc9b0 0x7f020c15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0212470640 1 -- 172.21.15.18:0/3604845509 >> v2:172.21.15.81:3300/0 conn(0x7f020c0cc9b0 msgr2=0x7f020c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0212470640 1 --2- 172.21.15.18:0/3604845509 >> v2:172.21.15.81:3300/0 conn(0x7f020c0cc9b0 0x7f020c15f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0212470640 1 -- 172.21.15.18:0/3604845509 >> v1:172.21.15.18:6789/0 conn(0x7f020c0b7480 legacy=0x7f020c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0210c6d640 1 -- 172.21.15.18:0/3604845509 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525264258 0 0) 0x7f020c15c950 con 0x7f020c0b7480 2023-06-09T04:38:23.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.471+0000 7f0212470640 1 -- 172.21.15.18:0/3604845509 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0ce010 con 0x7f020c0b3fe0 2023-06-09T04:38:23.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 --2- 172.21.15.18:0/3604845509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c0b3fe0 0x7f020c15f690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f020c0cf620 tx=0x7f01fc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec377ae82bf2037f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0210c6d640 1 -- 172.21.15.18:0/3604845509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0ab680 con 0x7f020c0b3fe0 2023-06-09T04:38:23.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0210c6d640 1 -- 172.21.15.18:0/3604845509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0ab7e0 con 0x7f020c0b3fe0 2023-06-09T04:38:23.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0210c6d640 1 -- 172.21.15.18:0/3604845509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0abb70 con 0x7f020c0b3fe0 2023-06-09T04:38:23.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- 172.21.15.18:0/3604845509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c0b3fe0 msgr2=0x7f020c15f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 --2- 172.21.15.18:0/3604845509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c0b3fe0 0x7f020c15f690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f020c0cf620 tx=0x7f01fc01c460 comp rx=0 tx=0).stop 2023-06-09T04:38:23.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- 172.21.15.18:0/3604845509 shutdown_connections 2023-06-09T04:38:23.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 --2- 172.21.15.18:0/3604845509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c0b3fe0 0x7f020c15f690 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 --2- 172.21.15.18:0/3604845509 >> v2:172.21.15.81:3300/0 conn(0x7f020c0cc9b0 0x7f020c15f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- 172.21.15.18:0/3604845509 >> 172.21.15.18:0/3604845509 conn(0x7f020c0d2ae0 msgr2=0x7f020c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- 172.21.15.18:0/3604845509 shutdown_connections 2023-06-09T04:38:23.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- 172.21.15.18:0/3604845509 wait complete. 2023-06-09T04:38:23.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 Processor -- start 2023-06-09T04:38:23.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- start start 2023-06-09T04:38:23.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f020c0b3fe0 0x7f020c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c0b7480 0x7f020c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 0x7f020c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0c8230 con 0x7f020c153050 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1500d0 con 0x7f020c0b7480 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0213ed3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c153660 con 0x7f020c0b3fe0 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 0x7f020c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 0x7f020c151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37692/0 (socket says 172.21.15.18:37692) 2023-06-09T04:38:23.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 -- 172.21.15.18:0/573711822 learned_addr learned my addr 172.21.15.18:0/573711822 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:23.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f021146e640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c0b7480 0x7f020c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0211c6f640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f020c0b3fe0 0x7f020c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 -- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f020c0b3fe0 msgr2=0x7f020c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f020c0b3fe0 0x7f020c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 -- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c0b7480 msgr2=0x7f020c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c0b7480 0x7f020c152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.475+0000 7f0212470640 1 -- 172.21.15.18:0/573711822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009420 con 0x7f020c153050 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f021146e640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c0b7480 0x7f020c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0211c6f640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f020c0b3fe0 0x7f020c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0212470640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 0x7f020c151a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ad040 tx=0x7f01fc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0bf610 con 0x7f020c153050 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0bf770 con 0x7f020c153050 2023-06-09T04:38:23.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0bfb20 con 0x7f020c153050 2023-06-09T04:38:23.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c153940 con 0x7f020c153050 2023-06-09T04:38:23.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c153f00 con 0x7f020c153050 2023-06-09T04:38:23.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c073380 con 0x7f020c153050 2023-06-09T04:38:23.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01fc0bfc80 con 0x7f020c153050 2023-06-09T04:38:23.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f02027fc640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01f80662b0 0x7f01f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f01fc11ebc0 con 0x7f020c153050 2023-06-09T04:38:23.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0211c6f640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01f80662b0 0x7f01f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.479+0000 7f0211c6f640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01f80662b0 0x7f01f8068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0204007fd0 tx=0x7f0204009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.483+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01fc0ebde0 con 0x7f020c153050 2023-06-09T04:38:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f020c1582f0 con 0x7f020c153050 2023-06-09T04:38:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f02027fc640 1 -- 172.21.15.18:0/573711822 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f01fc0ef400 con 0x7f020c153050 2023-06-09T04:38:23.661 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:38:23.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01f80662b0 msgr2=0x7f01f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01f80662b0 0x7f01f8068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0204007fd0 tx=0x7f0204009040 comp rx=0 tx=0).stop 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 msgr2=0x7f020c151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 0x7f020c151a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ad040 tx=0x7f01fc01aca0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 shutdown_connections 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f020c153050 0x7f020c151a10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c0b7480 0x7f020c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f01f80662b0 0x7f01f8068760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 --2- 172.21.15.18:0/573711822 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f020c0b3fe0 0x7f020c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 >> 172.21.15.18:0/573711822 conn(0x7f020c0d2ae0 msgr2=0x7f020c0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 shutdown_connections 2023-06-09T04:38:23.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.655+0000 7f0213ed3640 1 -- 172.21.15.18:0/573711822 wait complete. 2023-06-09T04:38:23.679 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:38:23.679 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:23.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:23.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.843+0000 7fdf21fbb640 1 Processor -- start 2023-06-09T04:38:23.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.843+0000 7fdf21fbb640 1 -- start start 2023-06-09T04:38:23.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf21fbb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdf1c070270 0x7fdf1c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf21fbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf1c0c0f80 0x7fdf1c06a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf21fbb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c069350 con 0x7fdf1c15f8f0 2023-06-09T04:38:23.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf21fbb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0ce8a0 con 0x7fdf1c070270 2023-06-09T04:38:23.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf21fbb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0695f0 con 0x7fdf1c0c0f80 2023-06-09T04:38:23.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdf1c15f8f0 0x7fdf1c06fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56238/0 (socket says 172.21.15.18:56238) 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1b7fe640 1 -- 172.21.15.18:0/272271213 learned_addr learned my addr 172.21.15.18:0/272271213 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1affd640 1 --2- 172.21.15.18:0/272271213 >> v2:172.21.15.18:3300/0 conn(0x7fdf1c070270 0x7fdf1c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1bfff640 1 --2- 172.21.15.18:0/272271213 >> v2:172.21.15.81:3300/0 conn(0x7fdf1c0c0f80 0x7fdf1c06a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1a7fc640 1 -- 172.21.15.18:0/272271213 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974893555 0 0) 0x7fdf1c069350 con 0x7fdf1c15f8f0 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1a7fc640 1 -- 172.21.15.18:0/272271213 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf04003530 con 0x7fdf1c15f8f0 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1affd640 1 -- 172.21.15.18:0/272271213 >> v2:172.21.15.81:3300/0 conn(0x7fdf1c0c0f80 msgr2=0x7fdf1c06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:23.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1affd640 1 --2- 172.21.15.18:0/272271213 >> v2:172.21.15.81:3300/0 conn(0x7fdf1c0c0f80 0x7fdf1c06a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1affd640 1 -- 172.21.15.18:0/272271213 >> v1:172.21.15.18:6789/0 conn(0x7fdf1c15f8f0 legacy=0x7fdf1c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1affd640 1 -- 172.21.15.18:0/272271213 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c0698d0 con 0x7fdf1c070270 2023-06-09T04:38:23.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1affd640 1 --2- 172.21.15.18:0/272271213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0708a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0cc170 tx=0x7fdf1001d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaabd933c5da83f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1a7fc640 1 -- 172.21.15.18:0/272271213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100a58e0 con 0x7fdf1c070270 2023-06-09T04:38:23.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1a7fc640 1 -- 172.21.15.18:0/272271213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100a5a40 con 0x7fdf1c070270 2023-06-09T04:38:23.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.847+0000 7fdf1a7fc640 1 -- 172.21.15.18:0/272271213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100a5dd0 con 0x7fdf1c070270 2023-06-09T04:38:23.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/272271213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 msgr2=0x7fdf1c0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/272271213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0708a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0cc170 tx=0x7fdf1001d370 comp rx=0 tx=0).stop 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/272271213 shutdown_connections 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/272271213 >> v2:172.21.15.81:3300/0 conn(0x7fdf1c0c0f80 0x7fdf1c06a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/272271213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0708a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/272271213 >> 172.21.15.18:0/272271213 conn(0x7fdf1c0b0240 msgr2=0x7fdf1c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/272271213 shutdown_connections 2023-06-09T04:38:23.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/272271213 wait complete. 2023-06-09T04:38:23.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 Processor -- start 2023-06-09T04:38:23.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- start start 2023-06-09T04:38:23.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0f80 0x7fdf1c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c15f8f0 0x7fdf1c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0b1210 con 0x7fdf1c070270 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15d320 con 0x7fdf1c15f8f0 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15d600 con 0x7fdf1c0c0f80 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37712/0 (socket says 172.21.15.18:37712) 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 -- 172.21.15.18:0/96256683 learned_addr learned my addr 172.21.15.18:0/96256683 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:23.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1affd640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0f80 0x7fdf1c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1bfff640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c15f8f0 0x7fdf1c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 -- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0f80 msgr2=0x7fdf1c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0f80 0x7fdf1c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 -- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c15f8f0 msgr2=0x7fdf1c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c15f8f0 0x7fdf1c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 -- 172.21.15.18:0/96256683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009a70 con 0x7fdf1c070270 2023-06-09T04:38:23.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1bfff640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c15f8f0 0x7fdf1c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:23.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf1b7fe640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0b3340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c3c0 tx=0x7fdf1400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14005cf0 con 0x7fdf1c070270 2023-06-09T04:38:23.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14005e50 con 0x7fdf1c070270 2023-06-09T04:38:23.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c15d8e0 con 0x7fdf1c070270 2023-06-09T04:38:23.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140072f0 con 0x7fdf1c070270 2023-06-09T04:38:23.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c15dea0 con 0x7fdf1c070270 2023-06-09T04:38:23.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.851+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c151a00 con 0x7fdf1c070270 2023-06-09T04:38:23.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.855+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf14007450 con 0x7fdf1c070270 2023-06-09T04:38:23.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.855+0000 7fdf03fff640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdf08066280 0x7fdf08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:23.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.855+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf14083580 con 0x7fdf1c070270 2023-06-09T04:38:23.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.855+0000 7fdf1affd640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdf08066280 0x7fdf08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:23.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.855+0000 7fdf1affd640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdf08066280 0x7fdf08068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf100af000 tx=0x7fdf10004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:23.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:23.859+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf1c151a00 con 0x7fdf1c070270 2023-06-09T04:38:24.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.015+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf1c151a00 con 0x7fdf1c070270 2023-06-09T04:38:24.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.015+0000 7fdf03fff640 1 -- 172.21.15.18:0/96256683 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fdf1c151a00 con 0x7fdf1c070270 2023-06-09T04:38:24.022 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:24.022 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdf08066280 msgr2=0x7fdf08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdf08066280 0x7fdf08068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf100af000 tx=0x7fdf10004ac0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 msgr2=0x7fdf1c0b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0b3340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c3c0 tx=0x7fdf1400c880 comp rx=0 tx=0).stop 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 shutdown_connections 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf1c15f8f0 0x7fdf1c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdf08066280 0x7fdf08068730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdf1c0c0f80 0x7fdf1c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 --2- 172.21.15.18:0/96256683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf1c070270 0x7fdf1c0b3340 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 >> 172.21.15.18:0/96256683 conn(0x7fdf1c0b0240 msgr2=0x7fdf1c06c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 shutdown_connections 2023-06-09T04:38:24.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.019+0000 7fdf21fbb640 1 -- 172.21.15.18:0/96256683 wait complete. 2023-06-09T04:38:24.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:38:24.044 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 Processor -- start 2023-06-09T04:38:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 -- start start 2023-06-09T04:38:24.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f56601579a0 0x7f56600cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56600ad220 0x7f566015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56600699a0 con 0x7f566006fbd0 2023-06-09T04:38:24.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566015bef0 con 0x7f56601579a0 2023-06-09T04:38:24.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5667f4c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566015c1d0 con 0x7f56600ad220 2023-06-09T04:38:24.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f56601579a0 0x7f56600cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f56601579a0 0x7f56600cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37720/0 (socket says 172.21.15.18:37720) 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 -- 172.21.15.18:0/2989808101 learned_addr learned my addr 172.21.15.18:0/2989808101 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f56654e7640 1 --2- 172.21.15.18:0/2989808101 >> v2:172.21.15.81:3300/0 conn(0x7f56600ad220 0x7f566015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 -- 172.21.15.18:0/2989808101 >> v2:172.21.15.81:3300/0 conn(0x7f56600ad220 msgr2=0x7f566015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 --2- 172.21.15.18:0/2989808101 >> v2:172.21.15.81:3300/0 conn(0x7f56600ad220 0x7f566015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 -- 172.21.15.18:0/2989808101 >> v1:172.21.15.81:6789/0 conn(0x7f566006fbd0 legacy=0x7f5660069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f5665ce8640 1 -- 172.21.15.18:0/2989808101 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566015c4b0 con 0x7f56601579a0 2023-06-09T04:38:24.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.163+0000 7f56654e7640 1 --2- 172.21.15.18:0/2989808101 >> v2:172.21.15.81:3300/0 conn(0x7f56600ad220 0x7f566015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:24.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5665ce8640 1 --2- 172.21.15.18:0/2989808101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56601579a0 0x7f56600cbbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56600aca50 tx=0x7f565c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239d6cacda1e5731 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5664ce6640 1 -- 172.21.15.18:0/2989808101 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c0ab600 con 0x7f56601579a0 2023-06-09T04:38:24.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5664ce6640 1 -- 172.21.15.18:0/2989808101 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c0a7050 con 0x7f56601579a0 2023-06-09T04:38:24.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5664ce6640 1 -- 172.21.15.18:0/2989808101 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c0ab980 con 0x7f56601579a0 2023-06-09T04:38:24.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- 172.21.15.18:0/2989808101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56601579a0 msgr2=0x7f56600cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2989808101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56601579a0 0x7f56600cbbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56600aca50 tx=0x7f565c01c490 comp rx=0 tx=0).stop 2023-06-09T04:38:24.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- 172.21.15.18:0/2989808101 shutdown_connections 2023-06-09T04:38:24.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2989808101 >> v2:172.21.15.81:3300/0 conn(0x7f56600ad220 0x7f566015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2989808101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56601579a0 0x7f56600cbbd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- 172.21.15.18:0/2989808101 >> 172.21.15.18:0/2989808101 conn(0x7f56600afa90 msgr2=0x7f56600afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- 172.21.15.18:0/2989808101 shutdown_connections 2023-06-09T04:38:24.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- 172.21.15.18:0/2989808101 wait complete. 2023-06-09T04:38:24.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 Processor -- start 2023-06-09T04:38:24.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- start start 2023-06-09T04:38:24.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f566006fbd0 0x7f56600b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56601579a0 0x7f5660147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 0x7f5660149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601430d0 con 0x7f56600b2800 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601433b0 con 0x7f56601579a0 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566013cfe0 con 0x7f566006fbd0 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 0x7f5660149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 0x7f5660149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37726/0 (socket says 172.21.15.18:37726) 2023-06-09T04:38:24.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 -- 172.21.15.18:0/2412366342 learned_addr learned my addr 172.21.15.18:0/2412366342 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5665ce8640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f566006fbd0 0x7f56600b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56654e7640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56601579a0 0x7f5660147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 -- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f566006fbd0 msgr2=0x7f56600b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f566006fbd0 0x7f56600b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 -- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56601579a0 msgr2=0x7f5660147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56601579a0 0x7f5660147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 -- 172.21.15.18:0/2412366342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c009480 con 0x7f56600b2800 2023-06-09T04:38:24.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56654e7640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56601579a0 0x7f5660147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:24.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56664e9640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 0x7f5660149bd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f565800c7b0 tx=0x7f565800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658004b70 con 0x7f56600b2800 2023-06-09T04:38:24.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5658004cd0 con 0x7f56600b2800 2023-06-09T04:38:24.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565800aa90 con 0x7f56600b2800 2023-06-09T04:38:24.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.167+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56600b2cc0 con 0x7f56600b2800 2023-06-09T04:38:24.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56600b3280 con 0x7f56600b2800 2023-06-09T04:38:24.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56601434f0 con 0x7f56600b2800 2023-06-09T04:38:24.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f565800abf0 con 0x7f56600b2800 2023-06-09T04:38:24.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f56567fc640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5644066280 0x7f5644068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f56580840d0 con 0x7f56600b2800 2023-06-09T04:38:24.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f5665ce8640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5644066280 0x7f5644068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.171+0000 7f5665ce8640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5644066280 0x7f5644068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f565c0ad000 tx=0x7f565c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.175+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56601434f0 con 0x7f56600b2800 2023-06-09T04:38:24.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56601434f0 con 0x7f56600b2800 2023-06-09T04:38:24.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f56567fc640 1 -- 172.21.15.18:0/2412366342 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56601434f0 con 0x7f56600b2800 2023-06-09T04:38:24.329 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5644066280 msgr2=0x7f5644068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5644066280 0x7f5644068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f565c0ad000 tx=0x7f565c0a6000 comp rx=0 tx=0).stop 2023-06-09T04:38:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 msgr2=0x7f5660149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 0x7f5660149bd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f565800c7b0 tx=0x7f565800cc70 comp rx=0 tx=0).stop 2023-06-09T04:38:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 shutdown_connections 2023-06-09T04:38:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56600b2800 0x7f5660149bd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56601579a0 0x7f5660147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5644066280 0x7f5644068730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 --2- 172.21.15.18:0/2412366342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f566006fbd0 0x7f56600b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.323+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 >> 172.21.15.18:0/2412366342 conn(0x7f56600afa90 msgr2=0x7f56600ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.327+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 shutdown_connections 2023-06-09T04:38:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.327+0000 7f5667f4c640 1 -- 172.21.15.18:0/2412366342 wait complete. 2023-06-09T04:38:24.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:24.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 Processor -- start 2023-06-09T04:38:24.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 -- start start 2023-06-09T04:38:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa26c155d20 0x7fa26c15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c1595d0 0x7fa26c06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa26c06c310 0x7fa26c0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c15ce40 con 0x7fa26c06c310 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c0cc450 con 0x7fa26c155d20 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa2743ea640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c15c880 con 0x7fa26c1595d0 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa26c06c310 0x7fa26c0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa26c06c310 0x7fa26c0c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37742/0 (socket says 172.21.15.18:37742) 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 -- 172.21.15.18:0/1720827839 learned_addr learned my addr 172.21.15.18:0/1720827839 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa271985640 1 --2- 172.21.15.18:0/1720827839 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c1595d0 0x7fa26c06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272186640 1 --2- 172.21.15.18:0/1720827839 >> v2:172.21.15.81:3300/0 conn(0x7fa26c155d20 0x7fa26c15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 -- 172.21.15.18:0/1720827839 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c1595d0 msgr2=0x7fa26c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 --2- 172.21.15.18:0/1720827839 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c1595d0 0x7fa26c06bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 -- 172.21.15.18:0/1720827839 >> v2:172.21.15.81:3300/0 conn(0x7fa26c155d20 msgr2=0x7fa26c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 --2- 172.21.15.18:0/1720827839 >> v2:172.21.15.81:3300/0 conn(0x7fa26c155d20 0x7fa26c15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.455+0000 7fa272987640 1 -- 172.21.15.18:0/1720827839 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c15cb60 con 0x7fa26c06c310 2023-06-09T04:38:24.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272987640 1 --2- 172.21.15.18:0/1720827839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c0c3940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0c3910 tx=0x7fa26801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef04af03fced6a77 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa271184640 1 -- 172.21.15.18:0/1720827839 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800b2d0 con 0x7fa26c06c310 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa271184640 1 -- 172.21.15.18:0/1720827839 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800b430 con 0x7fa26c06c310 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa271184640 1 -- 172.21.15.18:0/1720827839 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2680a7b60 con 0x7fa26c06c310 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- 172.21.15.18:0/1720827839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 msgr2=0x7fa26c0c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- 172.21.15.18:0/1720827839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c0c3940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0c3910 tx=0x7fa26801eba0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- 172.21.15.18:0/1720827839 shutdown_connections 2023-06-09T04:38:24.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- 172.21.15.18:0/1720827839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c0c3940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- 172.21.15.18:0/1720827839 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c1595d0 0x7fa26c06bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- 172.21.15.18:0/1720827839 >> v2:172.21.15.81:3300/0 conn(0x7fa26c155d20 0x7fa26c15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- 172.21.15.18:0/1720827839 >> 172.21.15.18:0/1720827839 conn(0x7fa26c0afa90 msgr2=0x7fa26c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- 172.21.15.18:0/1720827839 shutdown_connections 2023-06-09T04:38:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- 172.21.15.18:0/1720827839 wait complete. 2023-06-09T04:38:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 Processor -- start 2023-06-09T04:38:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- start start 2023-06-09T04:38:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c155d20 0x7fa26c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa26c1595d0 0x7fa26c15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0b1490 con 0x7fa26c06c310 2023-06-09T04:38:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0b1770 con 0x7fa26c1595d0 2023-06-09T04:38:24.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa2743ea640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c154430 con 0x7fa26c155d20 2023-06-09T04:38:24.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37744/0 (socket says 172.21.15.18:37744) 2023-06-09T04:38:24.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 -- 172.21.15.18:0/3093537191 learned_addr learned my addr 172.21.15.18:0/3093537191 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:24.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 -- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c155d20 msgr2=0x7fa26c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c155d20 0x7fa26c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 -- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa26c1595d0 msgr2=0x7fa26c15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa26c1595d0 0x7fa26c15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 -- 172.21.15.18:0/3093537191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26800bd40 con 0x7fa26c06c310 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.459+0000 7fa272186640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c141590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa26400d800 tx=0x7fa26400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640096a0 con 0x7fa26c06c310 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264009800 con 0x7fa26c06c310 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264009b70 con 0x7fa26c06c310 2023-06-09T04:38:24.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c154710 con 0x7fa26c06c310 2023-06-09T04:38:24.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c141ad0 con 0x7fa26c06c310 2023-06-09T04:38:24.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c073380 con 0x7fa26c06c310 2023-06-09T04:38:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa264009cd0 con 0x7fa26c06c310 2023-06-09T04:38:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa262ffd640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa250066280 0x7fa250068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa2640847b0 con 0x7fa26c06c310 2023-06-09T04:38:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa271985640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa250066280 0x7fa250068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.463+0000 7fa271985640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa250066280 0x7fa250068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0b3a90 tx=0x7fa25c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.467+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa264055460 con 0x7fa26c06c310 2023-06-09T04:38:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.619+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa26c0cbd50 con 0x7fa26c06c310 2023-06-09T04:38:24.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.619+0000 7fa262ffd640 1 -- 172.21.15.18:0/3093537191 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa26400b420 con 0x7fa26c06c310 2023-06-09T04:38:24.626 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:24.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa250066280 msgr2=0x7fa250068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa250066280 0x7fa250068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0b3a90 tx=0x7fa25c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 msgr2=0x7fa26c141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c141590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa26400d800 tx=0x7fa26400dcc0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 shutdown_connections 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa26c1595d0 0x7fa26c15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa250066280 0x7fa250068730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa26c155d20 0x7fa26c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 --2- 172.21.15.18:0/3093537191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c06c310 0x7fa26c141590 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 >> 172.21.15.18:0/3093537191 conn(0x7fa26c0afa90 msgr2=0x7fa26c0aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 shutdown_connections 2023-06-09T04:38:24.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.623+0000 7fa2743ea640 1 -- 172.21.15.18:0/3093537191 wait complete. 2023-06-09T04:38:24.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:24.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 Processor -- start 2023-06-09T04:38:24.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 -- start start 2023-06-09T04:38:24.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff69c0cc780 0x7ff69c0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff69c0cadd0 0x7ff69c0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c15bbb0 con 0x7ff69c15b7e0 2023-06-09T04:38:24.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0ca3c0 con 0x7ff69c0cadd0 2023-06-09T04:38:24.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff6a1eb1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0cd140 con 0x7ff69c0cc780 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff69c0cadd0 0x7ff69c0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff69c15b7e0 0x7ff69c15f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56248/0 (socket says 172.21.15.18:56248) 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69b7fe640 1 -- 172.21.15.18:0/1397700899 learned_addr learned my addr 172.21.15.18:0/1397700899 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69bfff640 1 --2- 172.21.15.18:0/1397700899 >> v2:172.21.15.18:3300/0 conn(0x7ff69c0cadd0 0x7ff69c0cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37758/0 (socket says 172.21.15.18:37758) 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69affd640 1 --2- 172.21.15.18:0/1397700899 >> v2:172.21.15.81:3300/0 conn(0x7ff69c0cc780 0x7ff69c0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69bfff640 1 -- 172.21.15.18:0/1397700899 >> v2:172.21.15.81:3300/0 conn(0x7ff69c0cc780 msgr2=0x7ff69c0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69bfff640 1 --2- 172.21.15.18:0/1397700899 >> v2:172.21.15.81:3300/0 conn(0x7ff69c0cc780 0x7ff69c0ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69bfff640 1 -- 172.21.15.18:0/1397700899 >> v1:172.21.15.18:6789/0 conn(0x7ff69c15b7e0 legacy=0x7ff69c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69bfff640 1 -- 172.21.15.18:0/1397700899 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c15fd80 con 0x7ff69c0cadd0 2023-06-09T04:38:24.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.771+0000 7ff69a7fc640 1 -- 172.21.15.18:0/1397700899 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053138004 0 0) 0x7ff69c15bbb0 con 0x7ff69c15b7e0 2023-06-09T04:38:24.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69bfff640 1 --2- 172.21.15.18:0/1397700899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cadd0 0x7ff69c0cb250 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff69c06e2c0 tx=0x7ff69401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6887d3b8b89c504c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69a7fc640 1 -- 172.21.15.18:0/1397700899 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940a59a0 con 0x7ff69c0cadd0 2023-06-09T04:38:24.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69a7fc640 1 -- 172.21.15.18:0/1397700899 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940a5b00 con 0x7ff69c0cadd0 2023-06-09T04:38:24.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69a7fc640 1 -- 172.21.15.18:0/1397700899 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940a5e90 con 0x7ff69c0cadd0 2023-06-09T04:38:24.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/1397700899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cadd0 msgr2=0x7ff69c0cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/1397700899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cadd0 0x7ff69c0cb250 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff69c06e2c0 tx=0x7ff69401c8e0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/1397700899 shutdown_connections 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/1397700899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cadd0 0x7ff69c0cb250 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/1397700899 >> v2:172.21.15.81:3300/0 conn(0x7ff69c0cc780 0x7ff69c0ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/1397700899 >> 172.21.15.18:0/1397700899 conn(0x7ff69c06ce60 msgr2=0x7ff69c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/1397700899 shutdown_connections 2023-06-09T04:38:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/1397700899 wait complete. 2023-06-09T04:38:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 Processor -- start 2023-06-09T04:38:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- start start 2023-06-09T04:38:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff69c0cadd0 0x7ff69c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 0x7ff69c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff69c15b7e0 0x7ff69c1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c155270 con 0x7ff69c0cc780 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c153b00 con 0x7ff69c0cadd0 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff6a1eb1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b0fd0 con 0x7ff69c15b7e0 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 0x7ff69c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 0x7ff69c0b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37772/0 (socket says 172.21.15.18:37772) 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 -- 172.21.15.18:0/3982222018 learned_addr learned my addr 172.21.15.18:0/3982222018 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:24.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69b7fe640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff69c0cadd0 0x7ff69c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69bfff640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff69c15b7e0 0x7ff69c1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 -- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff69c15b7e0 msgr2=0x7ff69c1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff69c15b7e0 0x7ff69c1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 -- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff69c0cadd0 msgr2=0x7ff69c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff69c0cadd0 0x7ff69c1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 -- 172.21.15.18:0/3982222018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009a70 con 0x7ff69c0cc780 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69bfff640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff69c15b7e0 0x7ff69c1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff69affd640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 0x7ff69c0b3bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d800 tx=0x7ff69000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000b6c0 con 0x7ff69c0cc780 2023-06-09T04:38:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69000b820 con 0x7ff69c0cc780 2023-06-09T04:38:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.775+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000bb90 con 0x7ff69c0cc780 2023-06-09T04:38:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c156930 con 0x7ff69c0cc780 2023-06-09T04:38:24.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c156ef0 con 0x7ff69c0cc780 2023-06-09T04:38:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c06f0c0 con 0x7ff69c0cc780 2023-06-09T04:38:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff69000bcf0 con 0x7ff69c0cc780 2023-06-09T04:38:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff683fff640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff690084520 con 0x7ff69c0cc780 2023-06-09T04:38:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff69b7fe640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.779+0000 7ff69b7fe640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff688066280 0x7ff688068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff68c000f70 tx=0x7ff68c007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.783+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6900551d0 con 0x7ff69c0cc780 2023-06-09T04:38:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.927+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff69c073380 con 0x7ff69c0cc780 2023-06-09T04:38:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff683fff640 1 -- 172.21.15.18:0/3982222018 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff690054d60 con 0x7ff69c0cc780 2023-06-09T04:38:24.936 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff688066280 msgr2=0x7ff688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff688066280 0x7ff688068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff68c000f70 tx=0x7ff68c007c10 comp rx=0 tx=0).stop 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 msgr2=0x7ff69c0b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 0x7ff69c0b3bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d800 tx=0x7ff69000dcc0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 shutdown_connections 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff69c15b7e0 0x7ff69c1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff69c0cc780 0x7ff69c0b3bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 --2- 172.21.15.18:0/3982222018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff69c0cadd0 0x7ff69c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 >> 172.21.15.18:0/3982222018 conn(0x7ff69c06ce60 msgr2=0x7ff69c158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 shutdown_connections 2023-06-09T04:38:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:24.931+0000 7ff6a1eb1640 1 -- 172.21.15.18:0/3982222018 wait complete. 2023-06-09T04:38:24.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:25.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.063+0000 7f754bee1640 1 Processor -- start 2023-06-09T04:38:25.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754bee1640 1 -- start start 2023-06-09T04:38:25.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754bee1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 0x7f75440ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754bee1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f754406c520 0x7f754406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754bee1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75440c9d40 con 0x7f7544159460 2023-06-09T04:38:25.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754bee1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754415cec0 con 0x7f754406c520 2023-06-09T04:38:25.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754bee1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754406cea0 con 0x7f7544159830 2023-06-09T04:38:25.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7544159460 0x7f75440c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56258/0 (socket says 172.21.15.18:56258) 2023-06-09T04:38:25.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 -- 172.21.15.18:0/296170800 learned_addr learned my addr 172.21.15.18:0/296170800 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:25.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754947c640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 0x7f75440ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754a47e640 1 --2- 172.21.15.18:0/296170800 >> v2:172.21.15.81:3300/0 conn(0x7f754406c520 0x7f754406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844150079 0 0) 0x7f753c0014a0 con 0x7f7544159460 2023-06-09T04:38:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7530003530 con 0x7f7544159460 2023-06-09T04:38:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3416834305 0 0) 0x7f7530003530 con 0x7f7544159460 2023-06-09T04:38:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 msgr2=0x7f75440ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 0x7f75440ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 >> v2:172.21.15.81:3300/0 conn(0x7f754406c520 msgr2=0x7f754406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 --2- 172.21.15.18:0/296170800 >> v2:172.21.15.81:3300/0 conn(0x7f754406c520 0x7f754406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544159e20 con 0x7f7544159460 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f753c001b90 con 0x7f7544159460 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 >> v1:172.21.15.18:6789/0 conn(0x7f7544159460 legacy=0x7f75440c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7530003980 0x7f7530003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 0x7f75300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530004d10 0x7f7530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754415cec0 con 0x7f7530003980 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754406cea0 con 0x7f7530004d10 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753000b990 con 0x7f7544159830 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7530003980 0x7f7530003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754947c640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 0x7f75300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 -- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 msgr2=0x7f75300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7544159830 0x7f75300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 -- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530004d10 msgr2=0x7f7530005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f754a47e640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530004d10 0x7f7530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530004d10 0x7f7530005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.067+0000 7f7549c7d640 1 -- 172.21.15.18:0/296170800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530003530 con 0x7f7530003980 2023-06-09T04:38:25.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f7549c7d640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7530003980 0x7f7530003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f753c00a840 tx=0x7f753c01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c32d5ddea2a19c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0ad630 con 0x7f7530003980 2023-06-09T04:38:25.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c0a8070 con 0x7f7530003980 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f7548c7b640 1 -- 172.21.15.18:0/296170800 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0ad9f0 con 0x7f7530003980 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- 172.21.15.18:0/296170800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7530003980 msgr2=0x7f7530003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 --2- 172.21.15.18:0/296170800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7530003980 0x7f7530003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f753c00a840 tx=0x7f753c01d310 comp rx=0 tx=0).stop 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754a47e640 1 -- 172.21.15.18:0/296170800 reap_dead start 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- 172.21.15.18:0/296170800 shutdown_connections 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- 172.21.15.18:0/296170800 >> 172.21.15.18:0/296170800 conn(0x7f75440b0b10 msgr2=0x7f75440ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- 172.21.15.18:0/296170800 shutdown_connections 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- 172.21.15.18:0/296170800 wait complete. 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 Processor -- start 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- start start 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530003980 0x7f75440aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75440b3b80 0x7f75441f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 0x7f754415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754415f150 con 0x7f754415e7a0 2023-06-09T04:38:25.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75440aaf50 con 0x7f7530003980 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754bee1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75440ab230 con 0x7f75440b3b80 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754a47e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 0x7f754415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754a47e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 0x7f754415ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37786/0 (socket says 172.21.15.18:37786) 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754a47e640 1 -- 172.21.15.18:0/1268045535 learned_addr learned my addr 172.21.15.18:0/1268045535 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f754947c640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75440b3b80 0x7f75441f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.071+0000 7f7549c7d640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530003980 0x7f75440aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754a47e640 1 -- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75440b3b80 msgr2=0x7f75441f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754a47e640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75440b3b80 0x7f75441f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754a47e640 1 -- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530003980 msgr2=0x7f75440aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754a47e640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530003980 0x7f75440aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754a47e640 1 -- 172.21.15.18:0/1268045535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440ab510 con 0x7f754415e7a0 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f7549c7d640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530003980 0x7f75440aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754a47e640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 0x7f754415ec10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75440cbe00 tx=0x7f75400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400143f0 con 0x7f754415e7a0 2023-06-09T04:38:25.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540014550 con 0x7f754415e7a0 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75440ab7f0 con 0x7f754415e7a0 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540014900 con 0x7f754415e7a0 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75441f6e60 con 0x7f754415e7a0 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75440ceeb0 con 0x7f754415e7a0 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7540014a60 con 0x7f754415e7a0 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f753a7fc640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7528066280 0x7f7528068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75400832a0 con 0x7f754415e7a0 2023-06-09T04:38:25.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f7549c7d640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7528066280 0x7f7528068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.075+0000 7f7549c7d640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7528066280 0x7f7528068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f753c0ad000 tx=0x7f753c001f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.079+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7540050430 con 0x7f754415e7a0 2023-06-09T04:38:25.237 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.231+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7544158de0 con 0x7f754415e7a0 2023-06-09T04:38:25.237 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.231+0000 7f753a7fc640 1 -- 172.21.15.18:0/1268045535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7540053a50 con 0x7f754415e7a0 2023-06-09T04:38:25.237 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:38:25.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7528066280 msgr2=0x7f7528068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7528066280 0x7f7528068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f753c0ad000 tx=0x7f753c001f20 comp rx=0 tx=0).stop 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 msgr2=0x7f754415ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 0x7f754415ec10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75440cbe00 tx=0x7f75400107a0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 shutdown_connections 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f754415e7a0 0x7f754415ec10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7528066280 0x7f7528068730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75440b3b80 0x7f75441f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 --2- 172.21.15.18:0/1268045535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7530003980 0x7f75440aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.241 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 >> 172.21.15.18:0/1268045535 conn(0x7f75440b0b10 msgr2=0x7f7544070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.241 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 shutdown_connections 2023-06-09T04:38:25.241 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.235+0000 7f754bee1640 1 -- 172.21.15.18:0/1268045535 wait complete. 2023-06-09T04:38:25.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:38:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa528e4d640 1 Processor -- start 2023-06-09T04:38:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa528e4d640 1 -- start start 2023-06-09T04:38:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa528e4d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 0x7fa5240cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa528e4d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52415de50 con 0x7fa524159590 2023-06-09T04:38:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa528e4d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52406cbf0 con 0x7fa5240acdf0 2023-06-09T04:38:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa528e4d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52415d2d0 con 0x7fa5241591c0 2023-06-09T04:38:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa524159590 0x7fa52406bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56262/0 (socket says 172.21.15.18:56262) 2023-06-09T04:38:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 -- 172.21.15.18:0/2149566373 learned_addr learned my addr 172.21.15.18:0/2149566373 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52259c640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 0x7fa5240cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811688254 0 0) 0x7fa52415de50 con 0x7fa524159590 2023-06-09T04:38:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003530 con 0x7fa524159590 2023-06-09T04:38:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474594756 0 0) 0x7fa52406cbf0 con 0x7fa5240acdf0 2023-06-09T04:38:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa52415de50 con 0x7fa5240acdf0 2023-06-09T04:38:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322456294 0 0) 0x7fa50c003530 con 0x7fa524159590 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 msgr2=0x7fa5240cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 0x7fa5240cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 >> v1:172.21.15.81:6789/0 conn(0x7fa5240acdf0 legacy=0x7fa52406c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52415d5b0 con 0x7fa524159590 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fa518001680 con 0x7fa524159590 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 >> v1:172.21.15.18:6789/0 conn(0x7fa524159590 legacy=0x7fa52406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50c003b40 0x7fa50c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa50c0047d0 0x7fa50c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 0x7fa50c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52415d2d0 con 0x7fa50c0047d0 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00fe50 con 0x7fa50c003b40 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c010010 con 0x7fa5241591c0 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa50c0047d0 0x7fa50c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa52259c640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50c003b40 0x7fa50c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa522d9d640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 0x7fa50c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 -- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 msgr2=0x7fa50c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5241591c0 0x7fa50c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 -- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50c003b40 msgr2=0x7fa50c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa50c003b40 0x7fa50c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.367+0000 7fa521d9b640 1 -- 172.21.15.18:0/2149566373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c003530 con 0x7fa50c0047d0 2023-06-09T04:38:25.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa521d9b640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa50c0047d0 0x7fa50c004c40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa518001ec0 tx=0x7fa51801caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc9926de234151 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518005ae0 con 0x7fa50c0047d0 2023-06-09T04:38:25.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518005c40 con 0x7fa50c0047d0 2023-06-09T04:38:25.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa52159a640 1 -- 172.21.15.18:0/2149566373 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5180a5790 con 0x7fa50c0047d0 2023-06-09T04:38:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 -- 172.21.15.18:0/2149566373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa50c0047d0 msgr2=0x7fa50c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 --2- 172.21.15.18:0/2149566373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa50c0047d0 0x7fa50c004c40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa518001ec0 tx=0x7fa51801caa0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa522d9d640 1 -- 172.21.15.18:0/2149566373 reap_dead start 2023-06-09T04:38:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 -- 172.21.15.18:0/2149566373 shutdown_connections 2023-06-09T04:38:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 -- 172.21.15.18:0/2149566373 >> 172.21.15.18:0/2149566373 conn(0x7fa5240afa90 msgr2=0x7fa5240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 -- 172.21.15.18:0/2149566373 shutdown_connections 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 -- 172.21.15.18:0/2149566373 wait complete. 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 Processor -- start 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.371+0000 7fa528e4d640 1 -- start start 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 0x7fa524150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa52414e190 0x7fa5240b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52414e600 0x7fa5240b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414efd0 con 0x7fa52414c1a0 2023-06-09T04:38:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414f2b0 con 0x7fa52414e600 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414f590 con 0x7fa52414e190 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 0x7fa524150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 0x7fa524150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37794/0 (socket says 172.21.15.18:37794) 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 -- 172.21.15.18:0/398998036 learned_addr learned my addr 172.21.15.18:0/398998036 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa521d9b640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa52414e190 0x7fa5240b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa522d9d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52414e600 0x7fa5240b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 -- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa52414e190 msgr2=0x7fa5240b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa52414e190 0x7fa5240b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 -- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52414e600 msgr2=0x7fa5240b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52414e600 0x7fa5240b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 -- 172.21.15.18:0/398998036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52414f870 con 0x7fa52414c1a0 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa521d9b640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa52414e190 0x7fa5240b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa52259c640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 0x7fa524150350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa51c007f80 tx=0x7fa51c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00e030 con 0x7fa52414c1a0 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c011e90 con 0x7fa52414c1a0 2023-06-09T04:38:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52414fb50 con 0x7fa52414c1a0 2023-06-09T04:38:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0168c0 con 0x7fa52414c1a0 2023-06-09T04:38:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52414d1c0 con 0x7fa52414c1a0 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5240b3910 con 0x7fa52414c1a0 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa51c006d50 con 0x7fa52414c1a0 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa512ffd640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa504066280 0x7fa504068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa51c00f070 con 0x7fa52414c1a0 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa521d9b640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa504066280 0x7fa504068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.375+0000 7fa521d9b640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa504066280 0x7fa504068730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa518001ec0 tx=0x7fa5180a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.379+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa51c051ed0 con 0x7fa52414c1a0 2023-06-09T04:38:25.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa5240698f0 con 0x7fa52414c1a0 2023-06-09T04:38:25.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa512ffd640 1 -- 172.21.15.18:0/398998036 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa51c0554f0 con 0x7fa52414c1a0 2023-06-09T04:38:25.532 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:25.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa504066280 msgr2=0x7fa504068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa504066280 0x7fa504068730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa518001ec0 tx=0x7fa5180a7070 comp rx=0 tx=0).stop 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 msgr2=0x7fa524150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 0x7fa524150350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa51c007f80 tx=0x7fa51c011660 comp rx=0 tx=0).stop 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 shutdown_connections 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa52414e600 0x7fa5240b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa504066280 0x7fa504068730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa52414e190 0x7fa5240b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 --2- 172.21.15.18:0/398998036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa52414c1a0 0x7fa524150350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 >> 172.21.15.18:0/398998036 conn(0x7fa5240afa90 msgr2=0x7fa52406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 shutdown_connections 2023-06-09T04:38:25.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.527+0000 7fa528e4d640 1 -- 172.21.15.18:0/398998036 wait complete. 2023-06-09T04:38:25.550 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:38:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 Processor -- start 2023-06-09T04:38:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 -- start start 2023-06-09T04:38:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1c00c9190 0x7fe1c015c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c015c2d0 con 0x7fe1c00c8dc0 2023-06-09T04:38:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c006cc70 con 0x7fe1c00c9190 2023-06-09T04:38:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1c5267640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c015fce0 con 0x7fe1c006c310 2023-06-09T04:38:25.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1be7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1c00c9190 0x7fe1c015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1beffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe1c00c8dc0 0x7fe1c015f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56272/0 (socket says 172.21.15.18:56272) 2023-06-09T04:38:25.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1beffd640 1 -- 172.21.15.18:0/3951983322 learned_addr learned my addr 172.21.15.18:0/3951983322 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:25.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1bf7fe640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1be7fc640 1 -- 172.21.15.18:0/3951983322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 msgr2=0x7fe1c006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1be7fc640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1be7fc640 1 -- 172.21.15.18:0/3951983322 >> v1:172.21.15.18:6789/0 conn(0x7fe1c00c8dc0 legacy=0x7fe1c015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1be7fc640 1 -- 172.21.15.18:0/3951983322 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c015ffc0 con 0x7fe1c00c9190 2023-06-09T04:38:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1bdffb640 1 -- 172.21.15.18:0/3951983322 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976323563 0 0) 0x7fe1c015c2d0 con 0x7fe1c00c8dc0 2023-06-09T04:38:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.663+0000 7fe1bf7fe640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1be7fc640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c015c760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80097c0 tx=0x7fe1a801ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d5c0b3b1662815 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1bdffb640 1 -- 172.21.15.18:0/3951983322 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80ab670 con 0x7fe1c00c9190 2023-06-09T04:38:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1bdffb640 1 -- 172.21.15.18:0/3951983322 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a80ab7d0 con 0x7fe1c00c9190 2023-06-09T04:38:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1bdffb640 1 -- 172.21.15.18:0/3951983322 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80abb60 con 0x7fe1c00c9190 2023-06-09T04:38:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- 172.21.15.18:0/3951983322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 msgr2=0x7fe1c015c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c015c760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80097c0 tx=0x7fe1a801ceb0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- 172.21.15.18:0/3951983322 shutdown_connections 2023-06-09T04:38:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 --2- 172.21.15.18:0/3951983322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c015c760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- 172.21.15.18:0/3951983322 >> 172.21.15.18:0/3951983322 conn(0x7fe1c00cb960 msgr2=0x7fe1c00ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- 172.21.15.18:0/3951983322 shutdown_connections 2023-06-09T04:38:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- 172.21.15.18:0/3951983322 wait complete. 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 Processor -- start 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- start start 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c00c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c00c8dc0 0x7fe1c01529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c00c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0152ef0 con 0x7fe1c00c9190 2023-06-09T04:38:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c75c0 con 0x7fe1c00c8dc0 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1c5267640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c5450 con 0x7fe1c006c310 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c00c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c00c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37818/0 (socket says 172.21.15.18:37818) 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1bf7fe640 1 -- 172.21.15.18:0/562520206 learned_addr learned my addr 172.21.15.18:0/562520206 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.667+0000 7fe1beffd640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c00c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1be7fc640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c00c8dc0 0x7fe1c01529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1bf7fe640 1 -- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 msgr2=0x7fe1c00c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1bf7fe640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c00c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1bf7fe640 1 -- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c00c8dc0 msgr2=0x7fe1c01529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1bf7fe640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c00c8dc0 0x7fe1c01529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1bf7fe640 1 -- 172.21.15.18:0/562520206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8009420 con 0x7fe1c00c9190 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1bf7fe640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c00c6a50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000cef0 tx=0x7fe1b000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000d840 con 0x7fe1c00c9190 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b000d9c0 con 0x7fe1c00c9190 2023-06-09T04:38:25.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c015fab0 con 0x7fe1c00c9190 2023-06-09T04:38:25.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000dd70 con 0x7fe1c00c9190 2023-06-09T04:38:25.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00c5a10 con 0x7fe1c00c9190 2023-06-09T04:38:25.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0073380 con 0x7fe1c00c9190 2023-06-09T04:38:25.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1b001e3b0 con 0x7fe1c00c9190 2023-06-09T04:38:25.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1b77fe640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe1a0066280 0x7fe1a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:25.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe1b0084a40 con 0x7fe1c00c9190 2023-06-09T04:38:25.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1beffd640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe1a0066280 0x7fe1a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:25.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.671+0000 7fe1beffd640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe1a0066280 0x7fe1a0068730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8000f70 tx=0x7fe1b8007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:25.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.675+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1b0086e60 con 0x7fe1c00c9190 2023-06-09T04:38:25.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.835+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1c00ceeb0 con 0x7fe1c00c9190 2023-06-09T04:38:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.835+0000 7fe1b77fe640 1 -- 172.21.15.18:0/562520206 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe1b0051d20 con 0x7fe1c00c9190 2023-06-09T04:38:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:38:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe1a0066280 msgr2=0x7fe1a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe1a0066280 0x7fe1a0068730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8000f70 tx=0x7fe1b8007b80 comp rx=0 tx=0).stop 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 msgr2=0x7fe1c00c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c00c6a50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000cef0 tx=0x7fe1b000a710 comp rx=0 tx=0).stop 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 shutdown_connections 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c00c9190 0x7fe1c00c6a50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1c00c8dc0 0x7fe1c01529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe1a0066280 0x7fe1a0068730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 --2- 172.21.15.18:0/562520206 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe1c006c310 0x7fe1c00c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 >> 172.21.15.18:0/562520206 conn(0x7fe1c00cb960 msgr2=0x7fe1c006a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 shutdown_connections 2023-06-09T04:38:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:25.839+0000 7fe1c5267640 1 -- 172.21.15.18:0/562520206 wait complete. 2023-06-09T04:38:25.858 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2023-06-09T04:38:25.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:25.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:38:25.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[43325]: fuse finished with error 0 and tester_r 0 2023-06-09T04:38:25.884 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:31.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:38:31.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:31.987 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-09T04:38:32.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 Processor -- start 2023-06-09T04:38:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 -- start start 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7500158310 0x7f75000ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75001586e0 0x7f750006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750006a900 con 0x7f750006c1f0 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000cd0f0 con 0x7f75001586e0 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f7506593640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750006c5c0 con 0x7f7500158310 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75001586e0 0x7f750006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75001586e0 0x7f750006bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58106/0 (socket says 172.21.15.18:58106) 2023-06-09T04:38:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 -- 172.21.15.18:0/1711834695 learned_addr learned my addr 172.21.15.18:0/1711834695 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74fffff640 1 --2- 172.21.15.18:0/1711834695 >> v2:172.21.15.81:3300/0 conn(0x7f7500158310 0x7f75000ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 -- 172.21.15.18:0/1711834695 >> v2:172.21.15.81:3300/0 conn(0x7f7500158310 msgr2=0x7f75000ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 --2- 172.21.15.18:0/1711834695 >> v2:172.21.15.81:3300/0 conn(0x7f7500158310 0x7f75000ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 -- 172.21.15.18:0/1711834695 >> v1:172.21.15.81:6789/0 conn(0x7f750006c1f0 legacy=0x7f750015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 -- 172.21.15.18:0/1711834695 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750015ceb0 con 0x7f75001586e0 2023-06-09T04:38:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.175+0000 7f74ff7fe640 1 --2- 172.21.15.18:0/1711834695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75001586e0 0x7f750006bcb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75000cd230 tx=0x7f74f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503e4deb93e3617b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74feffd640 1 -- 172.21.15.18:0/1711834695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40aa5f0 con 0x7f75001586e0 2023-06-09T04:38:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74feffd640 1 -- 172.21.15.18:0/1711834695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f40aa750 con 0x7f75001586e0 2023-06-09T04:38:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74feffd640 1 -- 172.21.15.18:0/1711834695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40aaae0 con 0x7f75001586e0 2023-06-09T04:38:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- 172.21.15.18:0/1711834695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75001586e0 msgr2=0x7f750006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 --2- 172.21.15.18:0/1711834695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75001586e0 0x7f750006bcb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75000cd230 tx=0x7f74f401c490 comp rx=0 tx=0).stop 2023-06-09T04:38:32.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- 172.21.15.18:0/1711834695 shutdown_connections 2023-06-09T04:38:32.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 --2- 172.21.15.18:0/1711834695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75001586e0 0x7f750006bcb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 --2- 172.21.15.18:0/1711834695 >> v2:172.21.15.81:3300/0 conn(0x7f7500158310 0x7f75000ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- 172.21.15.18:0/1711834695 >> 172.21.15.18:0/1711834695 conn(0x7f75000b0240 msgr2=0x7f75000cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:32.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- 172.21.15.18:0/1711834695 shutdown_connections 2023-06-09T04:38:32.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- 172.21.15.18:0/1711834695 wait complete. 2023-06-09T04:38:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 Processor -- start 2023-06-09T04:38:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- start start 2023-06-09T04:38:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f750006c1f0 0x7f750014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 0x7f750013d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75001586e0 0x7f750013dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750014e110 con 0x7f7500158310 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75001622a0 con 0x7f75001586e0 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7506593640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7500162580 con 0x7f750006c1f0 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 0x7f750013d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 0x7f750013d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58118/0 (socket says 172.21.15.18:58118) 2023-06-09T04:38:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 -- 172.21.15.18:0/3182752927 learned_addr learned my addr 172.21.15.18:0/3182752927 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74fffff640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f750006c1f0 0x7f750014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f7504b30640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75001586e0 0x7f750013dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 -- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f750006c1f0 msgr2=0x7f750014d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f750006c1f0 0x7f750014d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 -- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75001586e0 msgr2=0x7f750013dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75001586e0 0x7f750013dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 -- 172.21.15.18:0/3182752927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40094d0 con 0x7f7500158310 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74fffff640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f750006c1f0 0x7f750014d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.179+0000 7f74ff7fe640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 0x7f750013d810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f74f401a0c0 tx=0x7f74f401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40b3800 con 0x7f7500158310 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f40b3980 con 0x7f7500158310 2023-06-09T04:38:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7500162860 con 0x7f7500158310 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40b3d30 con 0x7f7500158310 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7500161ec0 con 0x7f7500158310 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7500073380 con 0x7f7500158310 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74f40b2380 con 0x7f7500158310 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fcff9640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74ec0662b0 0x7f74ec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74f40a7070 con 0x7f7500158310 2023-06-09T04:38:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fffff640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74ec0662b0 0x7f74ec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.183+0000 7f74fffff640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74ec0662b0 0x7f74ec068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7500141eb0 tx=0x7f74f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.187+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74f40eb360 con 0x7f7500158310 2023-06-09T04:38:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.343+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75000c7fe0 con 0x7f7500158310 2023-06-09T04:38:32.350 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.343+0000 7f74fcff9640 1 -- 172.21.15.18:0/3182752927 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f74f40ee980 con 0x7f7500158310 2023-06-09T04:38:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:32.351 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74ec0662b0 msgr2=0x7f74ec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74ec0662b0 0x7f74ec068760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7500141eb0 tx=0x7f74f0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 msgr2=0x7f750013d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 0x7f750013d810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f74f401a0c0 tx=0x7f74f401acd0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 shutdown_connections 2023-06-09T04:38:32.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75001586e0 0x7f750013dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7500158310 0x7f750013d810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74ec0662b0 0x7f74ec068760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 --2- 172.21.15.18:0/3182752927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f750006c1f0 0x7f750014d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 >> 172.21.15.18:0/3182752927 conn(0x7f75000b0240 msgr2=0x7f7500070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 shutdown_connections 2023-06-09T04:38:32.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.347+0000 7f7506593640 1 -- 172.21.15.18:0/3182752927 wait complete. 2023-06-09T04:38:32.370 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:32.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.487+0000 7fd76837a640 1 Processor -- start 2023-06-09T04:38:32.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.487+0000 7fd76837a640 1 -- start start 2023-06-09T04:38:32.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd76015a3e0 0x7fd76006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd7600700a0 0x7fd76006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76015cf10 con 0x7fd760159320 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd760070520 con 0x7fd7600700a0 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76015dd90 con 0x7fd76015a3e0 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd7600700a0 0x7fd76006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766116640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd760159320 0x7fd76015d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59146/0 (socket says 172.21.15.18:59146) 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766116640 1 -- 172.21.15.18:0/1481002146 learned_addr learned my addr 172.21.15.18:0/1481002146 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:32.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 --2- 172.21.15.18:0/1481002146 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd76015a3e0 0x7fd76006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 -- 172.21.15.18:0/1481002146 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd76015a3e0 msgr2=0x7fd76006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 --2- 172.21.15.18:0/1481002146 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd76015a3e0 0x7fd76006fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 -- 172.21.15.18:0/1481002146 >> v1:172.21.15.18:6789/0 conn(0x7fd760159320 legacy=0x7fd76015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 -- 172.21.15.18:0/1481002146 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600c81b0 con 0x7fd7600700a0 2023-06-09T04:38:32.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765114640 1 -- 172.21.15.18:0/1481002146 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335939677 0 0) 0x7fd76015cf10 con 0x7fd760159320 2023-06-09T04:38:32.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 --2- 172.21.15.18:0/1481002146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7600700a0 0x7fd76006bcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd758009d90 tx=0x7fd75801c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b647fcf988a299 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765114640 1 -- 172.21.15.18:0/1481002146 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580a66a0 con 0x7fd7600700a0 2023-06-09T04:38:32.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765114640 1 -- 172.21.15.18:0/1481002146 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7580a6800 con 0x7fd7600700a0 2023-06-09T04:38:32.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765114640 1 -- 172.21.15.18:0/1481002146 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580a6b90 con 0x7fd7600700a0 2023-06-09T04:38:32.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/1481002146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7600700a0 msgr2=0x7fd76006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- 172.21.15.18:0/1481002146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7600700a0 0x7fd76006bcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd758009d90 tx=0x7fd75801c5d0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/1481002146 shutdown_connections 2023-06-09T04:38:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- 172.21.15.18:0/1481002146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7600700a0 0x7fd76006bcb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- 172.21.15.18:0/1481002146 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd76015a3e0 0x7fd76006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/1481002146 >> 172.21.15.18:0/1481002146 conn(0x7fd7600b0240 msgr2=0x7fd7600cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/1481002146 shutdown_connections 2023-06-09T04:38:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/1481002146 wait complete. 2023-06-09T04:38:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 Processor -- start 2023-06-09T04:38:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- start start 2023-06-09T04:38:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd7600700a0 0x7fd76015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 0x7fd7601f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd76015a3e0 0x7fd7601f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76015c940 con 0x7fd760159320 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76015aaf0 con 0x7fd76015a3e0 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76015add0 con 0x7fd7600700a0 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 0x7fd7601f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 0x7fd7601f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58142/0 (socket says 172.21.15.18:58142) 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 -- 172.21.15.18:0/260685467 learned_addr learned my addr 172.21.15.18:0/260685467 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766116640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd7600700a0 0x7fd76015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766917640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd76015a3e0 0x7fd7601f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 -- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd7600700a0 msgr2=0x7fd76015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd7600700a0 0x7fd76015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 -- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd76015a3e0 msgr2=0x7fd7601f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd76015a3e0 0x7fd7601f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 -- 172.21.15.18:0/260685467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009a70 con 0x7fd760159320 2023-06-09T04:38:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd766116640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd7600700a0 0x7fd76015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd765915640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 0x7fd7601f2d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd75000d5f0 tx=0x7fd75000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7500125f0 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750012750 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750012ae0 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76015b0b0 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.491+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76015b670 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.495+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76015b830 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.495+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd750012c40 con 0x7fd760159320 2023-06-09T04:38:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.495+0000 7fd756ffd640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd7440662b0 0x7fd744068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.503 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.495+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd750084500 con 0x7fd760159320 2023-06-09T04:38:32.503 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.495+0000 7fd766116640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd7440662b0 0x7fd744068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.503 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.495+0000 7fd766116640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd7440662b0 0x7fd744068760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000f70 tx=0x7fd75c007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.504 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.503+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd750051690 con 0x7fd760159320 2023-06-09T04:38:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.655+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7600ce690 con 0x7fd760159320 2023-06-09T04:38:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.655+0000 7fd756ffd640 1 -- 172.21.15.18:0/260685467 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fd750054cb0 con 0x7fd760159320 2023-06-09T04:38:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:32.662 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd7440662b0 msgr2=0x7fd744068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd7440662b0 0x7fd744068760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000f70 tx=0x7fd75c007c40 comp rx=0 tx=0).stop 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 msgr2=0x7fd7601f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 0x7fd7601f2d50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd75000d5f0 tx=0x7fd75000dab0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 shutdown_connections 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd76015a3e0 0x7fd7601f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd760159320 0x7fd7601f2d50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd7440662b0 0x7fd744068760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 --2- 172.21.15.18:0/260685467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd7600700a0 0x7fd76015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 >> 172.21.15.18:0/260685467 conn(0x7fd7600b0240 msgr2=0x7fd760064f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:32.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 shutdown_connections 2023-06-09T04:38:32.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.659+0000 7fd76837a640 1 -- 172.21.15.18:0/260685467 wait complete. 2023-06-09T04:38:32.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:38:32.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 Processor -- start 2023-06-09T04:38:32.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 -- start start 2023-06-09T04:38:32.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 0x7faa580cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa580acdf0 0x7faa580cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5815de50 con 0x7faa58159590 2023-06-09T04:38:32.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5815d2d0 con 0x7faa580acdf0 2023-06-09T04:38:32.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5fdd5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5815d5b0 con 0x7faa581591c0 2023-06-09T04:38:32.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa58159590 0x7faa5806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59162/0 (socket says 172.21.15.18:59162) 2023-06-09T04:38:32.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 -- 172.21.15.18:0/4019792108 learned_addr learned my addr 172.21.15.18:0/4019792108 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:32.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5db71640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 0x7faa580cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5e372640 1 --2- 172.21.15.18:0/4019792108 >> v2:172.21.15.81:3300/0 conn(0x7faa580acdf0 0x7faa580cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025683754 0 0) 0x7faa5815de50 con 0x7faa58159590 2023-06-09T04:38:32.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa44003530 con 0x7faa58159590 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420681051 0 0) 0x7faa44003530 con 0x7faa58159590 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 msgr2=0x7faa580cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 0x7faa580cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 >> v2:172.21.15.81:3300/0 conn(0x7faa580acdf0 msgr2=0x7faa580cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 --2- 172.21.15.18:0/4019792108 >> v2:172.21.15.81:3300/0 conn(0x7faa580acdf0 0x7faa580cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5815d890 con 0x7faa58159590 2023-06-09T04:38:32.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7faa48001680 con 0x7faa58159590 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 >> v1:172.21.15.18:6789/0 conn(0x7faa58159590 legacy=0x7faa5806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 0x7faa44003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa44003f00 0x7faa440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44004d10 0x7faa44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5815d2d0 con 0x7faa44003f00 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5815d5b0 con 0x7faa44004d10 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4400b990 con 0x7faa581591c0 2023-06-09T04:38:32.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa44003f00 0x7faa440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 -- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 msgr2=0x7faa44003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581591c0 0x7faa44003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 -- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44004d10 msgr2=0x7faa44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5e372640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44004d10 0x7faa44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa44004d10 0x7faa44005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.807+0000 7faa5d370640 1 -- 172.21.15.18:0/4019792108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44003530 con 0x7faa44003f00 2023-06-09T04:38:32.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa44003f00 0x7faa440047d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c290 tx=0x7faa4801f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f919da4c3c4bb62 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48005ae0 con 0x7faa44003f00 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480ab070 con 0x7faa44003f00 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5cb6f640 1 -- 172.21.15.18:0/4019792108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48005e80 con 0x7faa44003f00 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- 172.21.15.18:0/4019792108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa44003f00 msgr2=0x7faa440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/4019792108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa44003f00 0x7faa440047d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c290 tx=0x7faa4801f430 comp rx=0 tx=0).stop 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5e372640 1 -- 172.21.15.18:0/4019792108 reap_dead start 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- 172.21.15.18:0/4019792108 shutdown_connections 2023-06-09T04:38:32.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- 172.21.15.18:0/4019792108 >> 172.21.15.18:0/4019792108 conn(0x7faa580afa90 msgr2=0x7faa580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:32.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- 172.21.15.18:0/4019792108 shutdown_connections 2023-06-09T04:38:32.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- 172.21.15.18:0/4019792108 wait complete. 2023-06-09T04:38:32.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 Processor -- start 2023-06-09T04:38:32.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- start start 2023-06-09T04:38:32.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581ef1d0 0x7faa5815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 0x7faa5815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa581524e0 0x7faa58152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58154d90 con 0x7faa581ef5a0 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58152e90 con 0x7faa581524e0 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5fdd5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa58154900 con 0x7faa581ef1d0 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 0x7faa5815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 0x7faa5815c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58174/0 (socket says 172.21.15.18:58174) 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 -- 172.21.15.18:0/3459023345 learned_addr learned my addr 172.21.15.18:0/3459023345 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:32.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5db71640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581ef1d0 0x7faa5815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5e372640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa581524e0 0x7faa58152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 -- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581ef1d0 msgr2=0x7faa5815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581ef1d0 0x7faa5815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 -- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa581524e0 msgr2=0x7faa58152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa581524e0 0x7faa58152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5d370640 1 -- 172.21.15.18:0/3459023345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58153cf0 con 0x7faa581ef5a0 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.811+0000 7faa5e372640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa581524e0 0x7faa58152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa5d370640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 0x7faa5815c530 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa4801f260 tx=0x7faa44005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480b6070 con 0x7faa581ef5a0 2023-06-09T04:38:32.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480048b0 con 0x7faa581ef5a0 2023-06-09T04:38:32.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa58153fd0 con 0x7faa581ef5a0 2023-06-09T04:38:32.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48004c60 con 0x7faa581ef5a0 2023-06-09T04:38:32.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa58154590 con 0x7faa581ef5a0 2023-06-09T04:38:32.825 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5806a0f0 con 0x7faa581ef5a0 2023-06-09T04:38:32.825 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa480b9070 con 0x7faa581ef5a0 2023-06-09T04:38:32.825 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa4e7fc640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faa3c066280 0x7faa3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:32.825 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa48120a30 con 0x7faa581ef5a0 2023-06-09T04:38:32.825 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa5db71640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faa3c066280 0x7faa3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:32.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.815+0000 7faa5db71640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faa3c066280 0x7faa3c068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa5814f0b0 tx=0x7faa54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:32.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:32.819+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa480f1640 con 0x7faa581ef5a0 2023-06-09T04:38:33.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.015+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faa58069e10 con 0x7faa581ef5a0 2023-06-09T04:38:33.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa4e7fc640 1 -- 172.21.15.18:0/3459023345 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7faa480f11d0 con 0x7faa581ef5a0 2023-06-09T04:38:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faa3c066280 msgr2=0x7faa3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faa3c066280 0x7faa3c068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa5814f0b0 tx=0x7faa54008040 comp rx=0 tx=0).stop 2023-06-09T04:38:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 msgr2=0x7faa5815c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 0x7faa5815c530 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faa4801f260 tx=0x7faa44005800 comp rx=0 tx=0).stop 2023-06-09T04:38:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 shutdown_connections 2023-06-09T04:38:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa581524e0 0x7faa58152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa581ef5a0 0x7faa5815c530 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faa3c066280 0x7faa3c068730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 --2- 172.21.15.18:0/3459023345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7faa581ef1d0 0x7faa5815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 >> 172.21.15.18:0/3459023345 conn(0x7faa580afa90 msgr2=0x7faa58158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 shutdown_connections 2023-06-09T04:38:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.031+0000 7faa5fdd5640 1 -- 172.21.15.18:0/3459023345 wait complete. 2023-06-09T04:38:33.052 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-09T04:38:33.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:38:33.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 Processor -- start 2023-06-09T04:38:33.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 -- start start 2023-06-09T04:38:33.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbd4c15b730 0x7fbd4c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd4c0cbc40 0x7fbd4c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c15f2f0 con 0x7fbd4c0cc8b0 2023-06-09T04:38:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c15f5d0 con 0x7fbd4c15b730 2023-06-09T04:38:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd52112640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c15f8b0 con 0x7fbd4c0cbc40 2023-06-09T04:38:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbd4c15b730 0x7fbd4c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbd4c15b730 0x7fbd4c0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58176/0 (socket says 172.21.15.18:58176) 2023-06-09T04:38:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 -- 172.21.15.18:0/877656726 learned_addr learned my addr 172.21.15.18:0/877656726 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4bfff640 1 --2- 172.21.15.18:0/877656726 >> v2:172.21.15.81:3300/0 conn(0x7fbd4c0cbc40 0x7fbd4c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 -- 172.21.15.18:0/877656726 >> v2:172.21.15.81:3300/0 conn(0x7fbd4c0cbc40 msgr2=0x7fbd4c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:33.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 --2- 172.21.15.18:0/877656726 >> v2:172.21.15.81:3300/0 conn(0x7fbd4c0cbc40 0x7fbd4c0cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 -- 172.21.15.18:0/877656726 >> v1:172.21.15.81:6789/0 conn(0x7fbd4c0cc8b0 legacy=0x7fbd4c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:33.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.175+0000 7fbd4b7fe640 1 -- 172.21.15.18:0/877656726 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c15fb90 con 0x7fbd4c15b730 2023-06-09T04:38:33.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd4b7fe640 1 --2- 172.21.15.18:0/877656726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c0c9e80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c15f090 tx=0x7fbd3c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76c6bad00737058 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:33.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/877656726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c0aa610 con 0x7fbd4c15b730 2023-06-09T04:38:33.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/877656726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0a6040 con 0x7fbd4c15b730 2023-06-09T04:38:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/877656726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c0aa990 con 0x7fbd4c15b730 2023-06-09T04:38:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 -- 172.21.15.18:0/877656726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 msgr2=0x7fbd4c0c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 --2- 172.21.15.18:0/877656726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c0c9e80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c15f090 tx=0x7fbd3c01c490 comp rx=0 tx=0).stop 2023-06-09T04:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 -- 172.21.15.18:0/877656726 shutdown_connections 2023-06-09T04:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 --2- 172.21.15.18:0/877656726 >> v2:172.21.15.81:3300/0 conn(0x7fbd4c0cbc40 0x7fbd4c0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 --2- 172.21.15.18:0/877656726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c0c9e80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 -- 172.21.15.18:0/877656726 >> 172.21.15.18:0/877656726 conn(0x7fbd4c06cdd0 msgr2=0x7fbd4c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 -- 172.21.15.18:0/877656726 shutdown_connections 2023-06-09T04:38:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.179+0000 7fbd52112640 1 -- 172.21.15.18:0/877656726 wait complete. 2023-06-09T04:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 Processor -- start 2023-06-09T04:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- start start 2023-06-09T04:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd4c0cbc40 0x7fbd4c14bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c0cc8b0 0x7fbd4c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c14b480 con 0x7fbd4c15b730 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0ae660 con 0x7fbd4c0cc8b0 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c154ac0 con 0x7fbd4c0cbc40 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c14a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58184/0 (socket says 172.21.15.18:58184) 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 -- 172.21.15.18:0/1390266937 learned_addr learned my addr 172.21.15.18:0/1390266937 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4b7fe640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd4c0cbc40 0x7fbd4c14bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 -- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd4c0cbc40 msgr2=0x7fbd4c14bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd4c0cbc40 0x7fbd4c14bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 -- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c0cc8b0 msgr2=0x7fbd4c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4affd640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c0cc8b0 0x7fbd4c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c0cc8b0 0x7fbd4c154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 -- 172.21.15.18:0/1390266937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c0094d0 con 0x7fbd4c15b730 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4b7fe640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd4c0cbc40 0x7fbd4c14bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd4bfff640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c14a1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbd44007e40 tx=0x7fbd4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44014620 con 0x7fbd4c15b730 2023-06-09T04:38:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4400ee90 con 0x7fbd4c15b730 2023-06-09T04:38:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c14b660 con 0x7fbd4c15b730 2023-06-09T04:38:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440149e0 con 0x7fbd4c15b730 2023-06-09T04:38:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c14bc20 con 0x7fbd4c15b730 2023-06-09T04:38:33.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c0ae7d0 con 0x7fbd4c15b730 2023-06-09T04:38:33.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.183+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd44014b40 con 0x7fbd4c15b730 2023-06-09T04:38:33.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.187+0000 7fbd33fff640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbd38066280 0x7fbd38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:33.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.187+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd440856e0 con 0x7fbd4c15b730 2023-06-09T04:38:33.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.187+0000 7fbd4b7fe640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbd38066280 0x7fbd38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.187+0000 7fbd4b7fe640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbd38066280 0x7fbd38068730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0ae000 tx=0x7fbd3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.187+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd44052950 con 0x7fbd4c15b730 2023-06-09T04:38:33.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:33.375+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd4c0ae7d0 con 0x7fbd4c15b730 2023-06-09T04:38:34.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.043+0000 7fbd33fff640 1 -- 172.21.15.18:0/1390266937 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbd4c0ae7d0 con 0x7fbd4c15b730 2023-06-09T04:38:34.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbd38066280 msgr2=0x7fbd38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbd38066280 0x7fbd38068730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0ae000 tx=0x7fbd3c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 msgr2=0x7fbd4c14a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c14a1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbd44007e40 tx=0x7fbd4400e4b0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 shutdown_connections 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd4c15b730 0x7fbd4c14a1d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd4c0cc8b0 0x7fbd4c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbd38066280 0x7fbd38068730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 --2- 172.21.15.18:0/1390266937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbd4c0cbc40 0x7fbd4c14bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 >> 172.21.15.18:0/1390266937 conn(0x7fbd4c06cdd0 msgr2=0x7fbd4c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 shutdown_connections 2023-06-09T04:38:34.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.047+0000 7fbd52112640 1 -- 172.21.15.18:0/1390266937 wait complete. 2023-06-09T04:38:34.068 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:38:34.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:34.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.187+0000 7ff253d6f640 1 Processor -- start 2023-06-09T04:38:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.187+0000 7ff253d6f640 1 -- start start 2023-06-09T04:38:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff253d6f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff24c159320 0x7ff24c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff253d6f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 0x7ff24c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff253d6f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c15cf10 con 0x7ff24c15dad0 2023-06-09T04:38:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff253d6f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c15a920 con 0x7ff24c159320 2023-06-09T04:38:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff253d6f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0c81b0 con 0x7ff24c15d680 2023-06-09T04:38:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff251b0b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff24c159320 0x7ff24c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 0x7ff24c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 0x7ff24c06fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:36490/0 (socket says 172.21.15.18:36490) 2023-06-09T04:38:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff251b0b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff24c159320 0x7ff24c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33332/0 (socket says 172.21.15.18:33332) 2023-06-09T04:38:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 -- 172.21.15.18:0/388656485 learned_addr learned my addr 172.21.15.18:0/388656485 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 -- 172.21.15.18:0/388656485 >> v2:172.21.15.81:3300/0 conn(0x7ff24c159320 msgr2=0x7ff24c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 --2- 172.21.15.18:0/388656485 >> v2:172.21.15.81:3300/0 conn(0x7ff24c159320 0x7ff24c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 -- 172.21.15.18:0/388656485 >> v1:172.21.15.81:6789/0 conn(0x7ff24c15dad0 legacy=0x7ff24c0692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.191+0000 7ff25130a640 1 -- 172.21.15.18:0/388656485 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c0c8490 con 0x7ff24c15d680 2023-06-09T04:38:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff25130a640 1 --2- 172.21.15.18:0/388656485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 0x7ff24c06fb60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff240009870 tx=0x7ff24001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71eadb771c33127e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff250b09640 1 -- 172.21.15.18:0/388656485 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2400ab680 con 0x7ff24c15d680 2023-06-09T04:38:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff250b09640 1 -- 172.21.15.18:0/388656485 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2400ab7e0 con 0x7ff24c15d680 2023-06-09T04:38:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff250b09640 1 -- 172.21.15.18:0/388656485 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2400abb70 con 0x7ff24c15d680 2023-06-09T04:38:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 -- 172.21.15.18:0/388656485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 msgr2=0x7ff24c06fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 --2- 172.21.15.18:0/388656485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 0x7ff24c06fb60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff240009870 tx=0x7ff24001c480 comp rx=0 tx=0).stop 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 -- 172.21.15.18:0/388656485 shutdown_connections 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 --2- 172.21.15.18:0/388656485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c15d680 0x7ff24c06fb60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 --2- 172.21.15.18:0/388656485 >> v2:172.21.15.81:3300/0 conn(0x7ff24c159320 0x7ff24c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 -- 172.21.15.18:0/388656485 >> 172.21.15.18:0/388656485 conn(0x7ff24c0b0240 msgr2=0x7ff24c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 -- 172.21.15.18:0/388656485 shutdown_connections 2023-06-09T04:38:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 -- 172.21.15.18:0/388656485 wait complete. 2023-06-09T04:38:34.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 Processor -- start 2023-06-09T04:38:34.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 -- start start 2023-06-09T04:38:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c159320 0x7ff24c1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff24c15d680 0x7ff24c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.195+0000 7ff253d6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 0x7ff24c146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff253d6f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c1f65c0 con 0x7ff24c15dad0 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff253d6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c148de0 con 0x7ff24c15d680 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff253d6f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c146c80 con 0x7ff24c159320 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 0x7ff24c146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 0x7ff24c146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58188/0 (socket says 172.21.15.18:58188) 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 -- 172.21.15.18:0/2277199087 learned_addr learned my addr 172.21.15.18:0/2277199087 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25130a640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff24c15d680 0x7ff24c1f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff251b0b640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c159320 0x7ff24c1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 -- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c159320 msgr2=0x7ff24c1480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c159320 0x7ff24c1480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 -- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff24c15d680 msgr2=0x7ff24c1f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff24c15d680 0x7ff24c1f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 -- 172.21.15.18:0/2277199087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400094d0 con 0x7ff24c15dad0 2023-06-09T04:38:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff25230c640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 0x7ff24c146320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c390 tx=0x7ff23c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c0052d0 con 0x7ff24c15dad0 2023-06-09T04:38:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c005430 con 0x7ff24c15dad0 2023-06-09T04:38:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c007240 con 0x7ff24c15dad0 2023-06-09T04:38:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c146f60 con 0x7ff24c15dad0 2023-06-09T04:38:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c147520 con 0x7ff24c15dad0 2023-06-09T04:38:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c0ce690 con 0x7ff24c15dad0 2023-06-09T04:38:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff23c0073a0 con 0x7ff24c15dad0 2023-06-09T04:38:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff24a7fc640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff238066280 0x7ff238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff23c0832b0 con 0x7ff24c15dad0 2023-06-09T04:38:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.199+0000 7ff251b0b640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff238066280 0x7ff238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.203+0000 7ff251b0b640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff238066280 0x7ff238068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff24c151620 tx=0x7ff24400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.203+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff23c0504f0 con 0x7ff24c15dad0 2023-06-09T04:38:34.392 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.391+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff24c1565c0 con 0x7ff24c15dad0 2023-06-09T04:38:34.393 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.391+0000 7ff24a7fc640 1 -- 172.21.15.18:0/2277199087 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7ff23c053b10 con 0x7ff24c15dad0 2023-06-09T04:38:34.394 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:34.394 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:34.394 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff238066280 msgr2=0x7ff238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff238066280 0x7ff238068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff24c151620 tx=0x7ff24400b040 comp rx=0 tx=0).stop 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 msgr2=0x7ff24c146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 0x7ff24c146320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c390 tx=0x7ff23c00c850 comp rx=0 tx=0).stop 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 shutdown_connections 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff24c15dad0 0x7ff24c146320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff24c15d680 0x7ff24c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff238066280 0x7ff238068730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 --2- 172.21.15.18:0/2277199087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff24c159320 0x7ff24c1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 >> 172.21.15.18:0/2277199087 conn(0x7ff24c0b0240 msgr2=0x7ff24c15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 shutdown_connections 2023-06-09T04:38:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.395+0000 7ff253d6f640 1 -- 172.21.15.18:0/2277199087 wait complete. 2023-06-09T04:38:34.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.531+0000 7f7504e92640 1 Processor -- start 2023-06-09T04:38:34.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.531+0000 7f7504e92640 1 -- start start 2023-06-09T04:38:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f7504e92640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7500159300 0x7f750015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f7504e92640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000cd820 con 0x7f75000cbe00 2023-06-09T04:38:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f7504e92640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000cc2a0 con 0x7f75000ccd70 2023-06-09T04:38:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f7504e92640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000ca2a0 con 0x7f7500159300 2023-06-09T04:38:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fdd9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f75000cbe00 0x7f75000cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59174/0 (socket says 172.21.15.18:59174) 2023-06-09T04:38:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fdd9b640 1 -- 172.21.15.18:0/2083440891 learned_addr learned my addr 172.21.15.18:0/2083440891 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 --2- 172.21.15.18:0/2083440891 >> v2:172.21.15.81:3300/0 conn(0x7f7500159300 0x7f750015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251150241 0 0) 0x7f75000cd820 con 0x7f75000cbe00 2023-06-09T04:38:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74ec003530 con 0x7f75000cbe00 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553222277 0 0) 0x7f74ec003530 con 0x7f75000cbe00 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 >> v2:172.21.15.81:3300/0 conn(0x7f7500159300 msgr2=0x7f750015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 --2- 172.21.15.18:0/2083440891 >> v2:172.21.15.81:3300/0 conn(0x7f7500159300 0x7f750015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 >> v1:172.21.15.81:6789/0 conn(0x7f75000ccd70 legacy=0x7f75000cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000ca4b0 con 0x7f75000cbe00 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f74e8001680 con 0x7f75000cbe00 2023-06-09T04:38:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 >> v1:172.21.15.18:6789/0 conn(0x7f75000cbe00 legacy=0x7f75000cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74ec003980 0x7f74ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec0047d0 0x7f74ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74ec005180 0x7f74ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000ca2a0 con 0x7f74ec003980 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec00c090 con 0x7f74ec005180 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec00c250 con 0x7f74ec0047d0 2023-06-09T04:38:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74ec003980 0x7f74ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fed9d640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74ec005180 0x7f74ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fdd9b640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec0047d0 0x7f74ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 -- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec0047d0 msgr2=0x7f74ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec0047d0 0x7f74ec004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 -- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74ec005180 msgr2=0x7f74ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74ec005180 0x7f74ec00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 -- 172.21.15.18:0/2083440891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec003530 con 0x7f74ec003980 2023-06-09T04:38:34.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fed9d640 1 -- 172.21.15.18:0/2083440891 reap_dead start 2023-06-09T04:38:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fe59c640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74ec003980 0x7f74ec003d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009fc0 tx=0x7f74f801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e83959527cd061 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80a5bf0 con 0x7f74ec003980 2023-06-09T04:38:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f800f040 con 0x7f74ec003980 2023-06-09T04:38:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.535+0000 7f74fd59a640 1 -- 172.21.15.18:0/2083440891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80ad440 con 0x7f74ec003980 2023-06-09T04:38:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/2083440891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74ec003980 msgr2=0x7f74ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74ec003980 0x7f74ec003d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009fc0 tx=0x7f74f801cc60 comp rx=0 tx=0).stop 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/2083440891 shutdown_connections 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 --2- 172.21.15.18:0/2083440891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74ec003980 0x7f74ec003d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/2083440891 >> 172.21.15.18:0/2083440891 conn(0x7f750006f850 msgr2=0x7f750006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/2083440891 shutdown_connections 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/2083440891 wait complete. 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 Processor -- start 2023-06-09T04:38:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- start start 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec003980 0x7f75000ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 0x7f75000ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75000cdbb0 0x7f75000ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000ce560 con 0x7f75000b4570 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000b5710 con 0x7f75000cdbb0 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75000b5ba0 con 0x7f74ec003980 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 0x7f75000ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fe59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec003980 0x7f75000ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 0x7f75000ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58208/0 (socket says 172.21.15.18:58208) 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3069022242 learned_addr learned my addr 172.21.15.18:0/3069022242 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fed9d640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75000cdbb0 0x7f75000ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec003980 msgr2=0x7f75000ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec003980 0x7f75000ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75000cdbb0 msgr2=0x7f75000ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75000cdbb0 0x7f75000ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3069022242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000b4b00 con 0x7f75000b4570 2023-06-09T04:38:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74fdd9b640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 0x7f75000ad390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74e800d910 tx=0x7f74e800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e80074e0 con 0x7f75000b4570 2023-06-09T04:38:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8007640 con 0x7f75000b4570 2023-06-09T04:38:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75000b4de0 con 0x7f75000b4570 2023-06-09T04:38:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8004a10 con 0x7f75000b4570 2023-06-09T04:38:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.539+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75000b53a0 con 0x7f75000b4570 2023-06-09T04:38:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.543+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000b5560 con 0x7f75000b4570 2023-06-09T04:38:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.543+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74e8004b70 con 0x7f75000b4570 2023-06-09T04:38:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.543+0000 7f74f6ffd640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74e0066280 0x7f74e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.543+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74e80839f0 con 0x7f75000b4570 2023-06-09T04:38:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.543+0000 7f74fe59c640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74e0066280 0x7f74e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.543+0000 7f74fe59c640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74e0066280 0x7f74e0068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74f80af000 tx=0x7f74f8004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.547+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74e8050c30 con 0x7f75000b4570 2023-06-09T04:38:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.699+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75000b5850 con 0x7f75000b4570 2023-06-09T04:38:34.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f74f6ffd640 1 -- 172.21.15.18:0/3069022242 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f74e8054250 con 0x7f75000b4570 2023-06-09T04:38:34.705 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:34.706 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74e0066280 msgr2=0x7f74e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74e0066280 0x7f74e0068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74f80af000 tx=0x7f74f8004ac0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 msgr2=0x7f75000ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 0x7f75000ad390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74e800d910 tx=0x7f74e800ddd0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 shutdown_connections 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75000cdbb0 0x7f75000ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75000b4570 0x7f75000ad390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f74e0066280 0x7f74e0068730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 --2- 172.21.15.18:0/3069022242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74ec003980 0x7f75000ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.703+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 >> 172.21.15.18:0/3069022242 conn(0x7f750006f850 msgr2=0x7f750006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.707+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 shutdown_connections 2023-06-09T04:38:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.707+0000 7f7504e92640 1 -- 172.21.15.18:0/3069022242 wait complete. 2023-06-09T04:38:34.724 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:38:34.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:34.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.839+0000 7ff81bc5b640 1 Processor -- start 2023-06-09T04:38:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.839+0000 7ff81bc5b640 1 -- start start 2023-06-09T04:38:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81bc5b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff814159320 0x7ff81415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81bc5b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff81406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81bc5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81415cf10 con 0x7ff81415d680 2023-06-09T04:38:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81bc5b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81415a920 con 0x7ff814159320 2023-06-09T04:38:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81bc5b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140c81b0 con 0x7ff814070270 2023-06-09T04:38:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff81406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff81406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:36518/0 (socket says 172.21.15.18:36518) 2023-06-09T04:38:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff8199f7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff814159320 0x7ff81415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 -- 172.21.15.18:0/1162628153 learned_addr learned my addr 172.21.15.18:0/1162628153 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 -- 172.21.15.18:0/1162628153 >> v2:172.21.15.81:3300/0 conn(0x7ff814159320 msgr2=0x7ff81415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 --2- 172.21.15.18:0/1162628153 >> v2:172.21.15.81:3300/0 conn(0x7ff814159320 0x7ff81415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 -- 172.21.15.18:0/1162628153 >> v1:172.21.15.81:6789/0 conn(0x7ff81415d680 legacy=0x7ff81406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 -- 172.21.15.18:0/1162628153 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140c8490 con 0x7ff814070270 2023-06-09T04:38:34.847 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.843+0000 7ff81a1f8640 1 --2- 172.21.15.18:0/1162628153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff81406bcb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e50 tx=0x7ff80c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6e7db54247a990 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.847 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8189f5640 1 -- 172.21.15.18:0/1162628153 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0a5720 con 0x7ff814070270 2023-06-09T04:38:34.847 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8189f5640 1 -- 172.21.15.18:0/1162628153 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0a5880 con 0x7ff814070270 2023-06-09T04:38:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8189f5640 1 -- 172.21.15.18:0/1162628153 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0a5c10 con 0x7ff814070270 2023-06-09T04:38:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- 172.21.15.18:0/1162628153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 msgr2=0x7ff81406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/1162628153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff81406bcb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009e50 tx=0x7ff80c01c950 comp rx=0 tx=0).stop 2023-06-09T04:38:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- 172.21.15.18:0/1162628153 shutdown_connections 2023-06-09T04:38:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/1162628153 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff81406bcb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/1162628153 >> v2:172.21.15.81:3300/0 conn(0x7ff814159320 0x7ff81415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- 172.21.15.18:0/1162628153 >> 172.21.15.18:0/1162628153 conn(0x7ff8140b0240 msgr2=0x7ff8140cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- 172.21.15.18:0/1162628153 shutdown_connections 2023-06-09T04:38:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- 172.21.15.18:0/1162628153 wait complete. 2023-06-09T04:38:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 Processor -- start 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- start start 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff8141f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 0x7ff8141f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81415d680 0x7ff8140cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141f6df0 con 0x7ff814159320 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141f7f30 con 0x7ff81415d680 2023-06-09T04:38:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141f3e30 con 0x7ff814070270 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 0x7ff8141f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 0x7ff8141f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58212/0 (socket says 172.21.15.18:58212) 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 -- 172.21.15.18:0/2926064106 learned_addr learned my addr 172.21.15.18:0/2926064106 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8199f7640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff8141f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81a1f8640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81415d680 0x7ff8140cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 -- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 msgr2=0x7ff8141f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff8141f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 -- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81415d680 msgr2=0x7ff8140cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81415d680 0x7ff8140cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 -- 172.21.15.18:0/2926064106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009b30 con 0x7ff814159320 2023-06-09T04:38:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8199f7640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff8141f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81a1f8640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81415d680 0x7ff8140cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:34.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8191f6640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 0x7ff8141f79f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c370 tx=0x7ff81000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100052d0 con 0x7ff814159320 2023-06-09T04:38:34.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810005430 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8141f4110 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.847+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810007260 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8141f46d0 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8141f4c70 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8100073c0 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff8067fc640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff7f8066280 0x7ff7f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff810083720 con 0x7ff814159320 2023-06-09T04:38:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff8199f7640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff7f8066280 0x7ff7f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.851+0000 7ff8199f7640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff7f8066280 0x7ff7f8068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff808009bb0 tx=0x7ff808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.855+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff810050920 con 0x7ff814159320 2023-06-09T04:38:35.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:34.999+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8141596f0 con 0x7ff7f8066280 2023-06-09T04:38:35.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.031+0000 7ff8067fc640 1 -- 172.21.15.18:0/2926064106 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367317 (secure 0 0 0) 0x7ff808011a70 con 0x7ff7f8066280 2023-06-09T04:38:35.033 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:35.037 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:38:35.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff7f8066280 msgr2=0x7ff7f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff7f8066280 0x7ff7f8068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff808009bb0 tx=0x7ff808008040 comp rx=0 tx=0).stop 2023-06-09T04:38:35.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 msgr2=0x7ff8141f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 0x7ff8141f79f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c370 tx=0x7ff81000c830 comp rx=0 tx=0).stop 2023-06-09T04:38:35.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 shutdown_connections 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81415d680 0x7ff8140cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff814159320 0x7ff8141f79f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff7f8066280 0x7ff7f8068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 --2- 172.21.15.18:0/2926064106 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff814070270 0x7ff8141f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 >> 172.21.15.18:0/2926064106 conn(0x7ff8140b0240 msgr2=0x7ff814159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 shutdown_connections 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.035+0000 7ff81bc5b640 1 -- 172.21.15.18:0/2926064106 wait complete. 2023-06-09T04:38:35.055 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-06-09T04:38:33.702418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235528,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739192,"statfs":{"total":773094113280,"available":772852932608,"internally_reserved":0,"allocated":3612672,"data_stored":2164046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005108"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985748+0000","last_change":"2023-06-09T04:38:15.615901+0000","last_active":"2023-06-09T04:38:15.985748+0000","last_peered":"2023-06-09T04:38:15.985748+0000","last_clean":"2023-06-09T04:38:15.985748+0000","last_became_active":"2023-06-09T04:38:15.614830+0000","last_became_peered":"2023-06-09T04:38:15.614830+0000","last_unstale":"2023-06-09T04:38:15.985748+0000","last_undegraded":"2023-06-09T04:38:15.985748+0000","last_fullsized":"2023-06-09T04:38:15.985748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:27:43.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561949+0000","last_change":"2023-06-09T04:38:11.203692+0000","last_active":"2023-06-09T04:38:16.561949+0000","last_peered":"2023-06-09T04:38:16.561949+0000","last_clean":"2023-06-09T04:38:16.561949+0000","last_became_active":"2023-06-09T04:38:11.202964+0000","last_became_peered":"2023-06-09T04:38:11.202964+0000","last_unstale":"2023-06-09T04:38:16.561949+0000","last_undegraded":"2023-06-09T04:38:16.561949+0000","last_fullsized":"2023-06-09T04:38:16.561949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:13.783096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981243+0000","last_change":"2023-06-09T04:38:11.594761+0000","last_active":"2023-06-09T04:38:15.981243+0000","last_peered":"2023-06-09T04:38:15.981243+0000","last_clean":"2023-06-09T04:38:15.981243+0000","last_became_active":"2023-06-09T04:38:11.594211+0000","last_became_peered":"2023-06-09T04:38:11.594211+0000","last_unstale":"2023-06-09T04:38:15.981243+0000","last_undegraded":"2023-06-09T04:38:15.981243+0000","last_fullsized":"2023-06-09T04:38:15.981243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065852+0000","last_change":"2023-06-09T04:38:15.632499+0000","last_active":"2023-06-09T04:38:16.065852+0000","last_peered":"2023-06-09T04:38:16.065852+0000","last_clean":"2023-06-09T04:38:16.065852+0000","last_became_active":"2023-06-09T04:38:15.632008+0000","last_became_peered":"2023-06-09T04:38:15.632008+0000","last_unstale":"2023-06-09T04:38:16.065852+0000","last_undegraded":"2023-06-09T04:38:16.065852+0000","last_fullsized":"2023-06-09T04:38:16.065852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561498+0000","last_change":"2023-06-09T04:38:11.200945+0000","last_active":"2023-06-09T04:38:16.561498+0000","last_peered":"2023-06-09T04:38:16.561498+0000","last_clean":"2023-06-09T04:38:16.561498+0000","last_became_active":"2023-06-09T04:38:11.200288+0000","last_became_peered":"2023-06-09T04:38:11.200288+0000","last_unstale":"2023-06-09T04:38:16.561498+0000","last_undegraded":"2023-06-09T04:38:16.561498+0000","last_fullsized":"2023-06-09T04:38:16.561498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:50.406974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560072+0000","last_change":"2023-06-09T04:38:11.585715+0000","last_active":"2023-06-09T04:38:16.560072+0000","last_peered":"2023-06-09T04:38:16.560072+0000","last_clean":"2023-06-09T04:38:16.560072+0000","last_became_active":"2023-06-09T04:38:11.584957+0000","last_became_peered":"2023-06-09T04:38:11.584957+0000","last_unstale":"2023-06-09T04:38:16.560072+0000","last_undegraded":"2023-06-09T04:38:16.560072+0000","last_fullsized":"2023-06-09T04:38:16.560072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:37:29.621473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981971+0000","last_change":"2023-06-09T04:38:15.637942+0000","last_active":"2023-06-09T04:38:15.981971+0000","last_peered":"2023-06-09T04:38:15.981971+0000","last_clean":"2023-06-09T04:38:15.981971+0000","last_became_active":"2023-06-09T04:38:15.637496+0000","last_became_peered":"2023-06-09T04:38:15.637496+0000","last_unstale":"2023-06-09T04:38:15.981971+0000","last_undegraded":"2023-06-09T04:38:15.981971+0000","last_fullsized":"2023-06-09T04:38:15.981971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:34.351945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559952+0000","last_change":"2023-06-09T04:38:11.185664+0000","last_active":"2023-06-09T04:38:16.559952+0000","last_peered":"2023-06-09T04:38:16.559952+0000","last_clean":"2023-06-09T04:38:16.559952+0000","last_became_active":"2023-06-09T04:38:11.185158+0000","last_became_peered":"2023-06-09T04:38:11.185158+0000","last_unstale":"2023-06-09T04:38:16.559952+0000","last_undegraded":"2023-06-09T04:38:16.559952+0000","last_fullsized":"2023-06-09T04:38:16.559952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.509050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981434+0000","last_change":"2023-06-09T04:38:11.585306+0000","last_active":"2023-06-09T04:38:15.981434+0000","last_peered":"2023-06-09T04:38:15.981434+0000","last_clean":"2023-06-09T04:38:15.981434+0000","last_became_active":"2023-06-09T04:38:11.584847+0000","last_became_peered":"2023-06-09T04:38:11.584847+0000","last_unstale":"2023-06-09T04:38:15.981434+0000","last_undegraded":"2023-06-09T04:38:15.981434+0000","last_fullsized":"2023-06-09T04:38:15.981434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066287+0000","last_change":"2023-06-09T04:38:15.622777+0000","last_active":"2023-06-09T04:38:16.066287+0000","last_peered":"2023-06-09T04:38:16.066287+0000","last_clean":"2023-06-09T04:38:16.066287+0000","last_became_active":"2023-06-09T04:38:15.622311+0000","last_became_peered":"2023-06-09T04:38:15.622311+0000","last_unstale":"2023-06-09T04:38:16.066287+0000","last_undegraded":"2023-06-09T04:38:16.066287+0000","last_fullsized":"2023-06-09T04:38:16.066287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:54.359850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066456+0000","last_change":"2023-06-09T04:38:11.189358+0000","last_active":"2023-06-09T04:38:16.066456+0000","last_peered":"2023-06-09T04:38:16.066456+0000","last_clean":"2023-06-09T04:38:16.066456+0000","last_became_active":"2023-06-09T04:38:11.188357+0000","last_became_peered":"2023-06-09T04:38:11.188357+0000","last_unstale":"2023-06-09T04:38:16.066456+0000","last_undegraded":"2023-06-09T04:38:16.066456+0000","last_fullsized":"2023-06-09T04:38:16.066456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:16.955337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982469+0000","last_change":"2023-06-09T04:38:11.579687+0000","last_active":"2023-06-09T04:38:15.982469+0000","last_peered":"2023-06-09T04:38:15.982469+0000","last_clean":"2023-06-09T04:38:15.982469+0000","last_became_active":"2023-06-09T04:38:11.579135+0000","last_became_peered":"2023-06-09T04:38:11.579135+0000","last_unstale":"2023-06-09T04:38:15.982469+0000","last_undegraded":"2023-06-09T04:38:15.982469+0000","last_fullsized":"2023-06-09T04:38:15.982469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:37.416450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986093+0000","last_change":"2023-06-09T04:38:15.652067+0000","last_active":"2023-06-09T04:38:15.986093+0000","last_peered":"2023-06-09T04:38:15.986093+0000","last_clean":"2023-06-09T04:38:15.986093+0000","last_became_active":"2023-06-09T04:38:15.651161+0000","last_became_peered":"2023-06-09T04:38:15.651161+0000","last_unstale":"2023-06-09T04:38:15.986093+0000","last_undegraded":"2023-06-09T04:38:15.986093+0000","last_fullsized":"2023-06-09T04:38:15.986093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:21.927575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985609+0000","last_change":"2023-06-09T04:38:11.180066+0000","last_active":"2023-06-09T04:38:15.985609+0000","last_peered":"2023-06-09T04:38:15.985609+0000","last_clean":"2023-06-09T04:38:15.985609+0000","last_became_active":"2023-06-09T04:38:11.179266+0000","last_became_peered":"2023-06-09T04:38:11.179266+0000","last_unstale":"2023-06-09T04:38:15.985609+0000","last_undegraded":"2023-06-09T04:38:15.985609+0000","last_fullsized":"2023-06-09T04:38:15.985609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:07.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986230+0000","last_change":"2023-06-09T04:38:11.594680+0000","last_active":"2023-06-09T04:38:15.986230+0000","last_peered":"2023-06-09T04:38:15.986230+0000","last_clean":"2023-06-09T04:38:15.986230+0000","last_became_active":"2023-06-09T04:38:11.594276+0000","last_became_peered":"2023-06-09T04:38:11.594276+0000","last_unstale":"2023-06-09T04:38:15.986230+0000","last_undegraded":"2023-06-09T04:38:15.986230+0000","last_fullsized":"2023-06-09T04:38:15.986230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:52.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981838+0000","last_change":"2023-06-09T04:38:15.648101+0000","last_active":"2023-06-09T04:38:15.981838+0000","last_peered":"2023-06-09T04:38:15.981838+0000","last_clean":"2023-06-09T04:38:15.981838+0000","last_became_active":"2023-06-09T04:38:15.647608+0000","last_became_peered":"2023-06-09T04:38:15.647608+0000","last_unstale":"2023-06-09T04:38:15.981838+0000","last_undegraded":"2023-06-09T04:38:15.981838+0000","last_fullsized":"2023-06-09T04:38:15.981838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066410+0000","last_change":"2023-06-09T04:38:11.201960+0000","last_active":"2023-06-09T04:38:16.066410+0000","last_peered":"2023-06-09T04:38:16.066410+0000","last_clean":"2023-06-09T04:38:16.066410+0000","last_became_active":"2023-06-09T04:38:11.201646+0000","last_became_peered":"2023-06-09T04:38:11.201646+0000","last_unstale":"2023-06-09T04:38:16.066410+0000","last_undegraded":"2023-06-09T04:38:16.066410+0000","last_fullsized":"2023-06-09T04:38:16.066410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:36.403064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559845+0000","last_change":"2023-06-09T04:38:11.594028+0000","last_active":"2023-06-09T04:38:16.559845+0000","last_peered":"2023-06-09T04:38:16.559845+0000","last_clean":"2023-06-09T04:38:16.559845+0000","last_became_active":"2023-06-09T04:38:11.593476+0000","last_became_peered":"2023-06-09T04:38:11.593476+0000","last_unstale":"2023-06-09T04:38:16.559845+0000","last_undegraded":"2023-06-09T04:38:16.559845+0000","last_fullsized":"2023-06-09T04:38:16.559845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:03:31.188379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982272+0000","last_change":"2023-06-09T04:38:15.639036+0000","last_active":"2023-06-09T04:38:15.982272+0000","last_peered":"2023-06-09T04:38:15.982272+0000","last_clean":"2023-06-09T04:38:15.982272+0000","last_became_active":"2023-06-09T04:38:15.638526+0000","last_became_peered":"2023-06-09T04:38:15.638526+0000","last_unstale":"2023-06-09T04:38:15.982272+0000","last_undegraded":"2023-06-09T04:38:15.982272+0000","last_fullsized":"2023-06-09T04:38:15.982272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:01.380927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986379+0000","last_change":"2023-06-09T04:38:11.206571+0000","last_active":"2023-06-09T04:38:15.986379+0000","last_peered":"2023-06-09T04:38:15.986379+0000","last_clean":"2023-06-09T04:38:15.986379+0000","last_became_active":"2023-06-09T04:38:11.205967+0000","last_became_peered":"2023-06-09T04:38:11.205967+0000","last_unstale":"2023-06-09T04:38:15.986379+0000","last_undegraded":"2023-06-09T04:38:15.986379+0000","last_fullsized":"2023-06-09T04:38:15.986379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.580093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984552+0000","last_change":"2023-06-09T04:38:11.591665+0000","last_active":"2023-06-09T04:38:15.984552+0000","last_peered":"2023-06-09T04:38:15.984552+0000","last_clean":"2023-06-09T04:38:15.984552+0000","last_became_active":"2023-06-09T04:38:11.591215+0000","last_became_peered":"2023-06-09T04:38:11.591215+0000","last_unstale":"2023-06-09T04:38:15.984552+0000","last_undegraded":"2023-06-09T04:38:15.984552+0000","last_fullsized":"2023-06-09T04:38:15.984552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:05.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985492+0000","last_change":"2023-06-09T04:38:15.645060+0000","last_active":"2023-06-09T04:38:15.985492+0000","last_peered":"2023-06-09T04:38:15.985492+0000","last_clean":"2023-06-09T04:38:15.985492+0000","last_became_active":"2023-06-09T04:38:15.644019+0000","last_became_peered":"2023-06-09T04:38:15.644019+0000","last_unstale":"2023-06-09T04:38:15.985492+0000","last_undegraded":"2023-06-09T04:38:15.985492+0000","last_fullsized":"2023-06-09T04:38:15.985492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559446+0000","last_change":"2023-06-09T04:38:11.195096+0000","last_active":"2023-06-09T04:38:16.559446+0000","last_peered":"2023-06-09T04:38:16.559446+0000","last_clean":"2023-06-09T04:38:16.559446+0000","last_became_active":"2023-06-09T04:38:11.193967+0000","last_became_peered":"2023-06-09T04:38:11.193967+0000","last_unstale":"2023-06-09T04:38:16.559446+0000","last_undegraded":"2023-06-09T04:38:16.559446+0000","last_fullsized":"2023-06-09T04:38:16.559446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:31:01.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560496+0000","last_change":"2023-06-09T04:38:11.598907+0000","last_active":"2023-06-09T04:38:16.560496+0000","last_peered":"2023-06-09T04:38:16.560496+0000","last_clean":"2023-06-09T04:38:16.560496+0000","last_became_active":"2023-06-09T04:38:11.598448+0000","last_became_peered":"2023-06-09T04:38:11.598448+0000","last_unstale":"2023-06-09T04:38:16.560496+0000","last_undegraded":"2023-06-09T04:38:16.560496+0000","last_fullsized":"2023-06-09T04:38:16.560496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:15:01.066687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559038+0000","last_change":"2023-06-09T04:38:11.584299+0000","last_active":"2023-06-09T04:38:16.559038+0000","last_peered":"2023-06-09T04:38:16.559038+0000","last_clean":"2023-06-09T04:38:16.559038+0000","last_became_active":"2023-06-09T04:38:11.584067+0000","last_became_peered":"2023-06-09T04:38:11.584067+0000","last_unstale":"2023-06-09T04:38:16.559038+0000","last_undegraded":"2023-06-09T04:38:16.559038+0000","last_fullsized":"2023-06-09T04:38:16.559038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:49:59.751085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.562107+0000","last_change":"2023-06-09T04:38:11.202669+0000","last_active":"2023-06-09T04:38:16.562107+0000","last_peered":"2023-06-09T04:38:16.562107+0000","last_clean":"2023-06-09T04:38:16.562107+0000","last_became_active":"2023-06-09T04:38:11.201665+0000","last_became_peered":"2023-06-09T04:38:11.201665+0000","last_unstale":"2023-06-09T04:38:16.562107+0000","last_undegraded":"2023-06-09T04:38:16.562107+0000","last_fullsized":"2023-06-09T04:38:16.562107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:40.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559172+0000","last_change":"2023-06-09T04:38:15.638570+0000","last_active":"2023-06-09T04:38:16.559172+0000","last_peered":"2023-06-09T04:38:16.559172+0000","last_clean":"2023-06-09T04:38:16.559172+0000","last_became_active":"2023-06-09T04:38:15.638066+0000","last_became_peered":"2023-06-09T04:38:15.638066+0000","last_unstale":"2023-06-09T04:38:16.559172+0000","last_undegraded":"2023-06-09T04:38:16.559172+0000","last_fullsized":"2023-06-09T04:38:16.559172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:55.971330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986040+0000","last_change":"2023-06-09T04:38:11.591894+0000","last_active":"2023-06-09T04:38:15.986040+0000","last_peered":"2023-06-09T04:38:15.986040+0000","last_clean":"2023-06-09T04:38:15.986040+0000","last_became_active":"2023-06-09T04:38:11.590872+0000","last_became_peered":"2023-06-09T04:38:11.590872+0000","last_unstale":"2023-06-09T04:38:15.986040+0000","last_undegraded":"2023-06-09T04:38:15.986040+0000","last_fullsized":"2023-06-09T04:38:15.986040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:13.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982353+0000","last_change":"2023-06-09T04:38:11.173622+0000","last_active":"2023-06-09T04:38:15.982353+0000","last_peered":"2023-06-09T04:38:15.982353+0000","last_clean":"2023-06-09T04:38:15.982353+0000","last_became_active":"2023-06-09T04:38:11.173296+0000","last_became_peered":"2023-06-09T04:38:11.173296+0000","last_unstale":"2023-06-09T04:38:15.982353+0000","last_undegraded":"2023-06-09T04:38:15.982353+0000","last_fullsized":"2023-06-09T04:38:15.982353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:14.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981275+0000","last_change":"2023-06-09T04:38:15.624872+0000","last_active":"2023-06-09T04:38:15.981275+0000","last_peered":"2023-06-09T04:38:15.981275+0000","last_clean":"2023-06-09T04:38:15.981275+0000","last_became_active":"2023-06-09T04:38:15.623576+0000","last_became_peered":"2023-06-09T04:38:15.623576+0000","last_unstale":"2023-06-09T04:38:15.981275+0000","last_undegraded":"2023-06-09T04:38:15.981275+0000","last_fullsized":"2023-06-09T04:38:15.981275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:29.450913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116345+0000","last_change":"2023-06-09T04:38:11.191574+0000","last_active":"2023-06-09T04:38:16.116345+0000","last_peered":"2023-06-09T04:38:16.116345+0000","last_clean":"2023-06-09T04:38:16.116345+0000","last_became_active":"2023-06-09T04:38:11.191265+0000","last_became_peered":"2023-06-09T04:38:11.191265+0000","last_unstale":"2023-06-09T04:38:16.116345+0000","last_undegraded":"2023-06-09T04:38:16.116345+0000","last_fullsized":"2023-06-09T04:38:16.116345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:36.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983839+0000","last_change":"2023-06-09T04:38:11.602110+0000","last_active":"2023-06-09T04:38:15.983839+0000","last_peered":"2023-06-09T04:38:15.983839+0000","last_clean":"2023-06-09T04:38:15.983839+0000","last_became_active":"2023-06-09T04:38:11.601863+0000","last_became_peered":"2023-06-09T04:38:11.601863+0000","last_unstale":"2023-06-09T04:38:15.983839+0000","last_undegraded":"2023-06-09T04:38:15.983839+0000","last_fullsized":"2023-06-09T04:38:15.983839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:33.650536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983706+0000","last_change":"2023-06-09T04:38:15.652599+0000","last_active":"2023-06-09T04:38:15.983706+0000","last_peered":"2023-06-09T04:38:15.983706+0000","last_clean":"2023-06-09T04:38:15.983706+0000","last_became_active":"2023-06-09T04:38:15.651894+0000","last_became_peered":"2023-06-09T04:38:15.651894+0000","last_unstale":"2023-06-09T04:38:15.983706+0000","last_undegraded":"2023-06-09T04:38:15.983706+0000","last_fullsized":"2023-06-09T04:38:15.983706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:39:05.473086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:21.329783+0000","last_change":"2023-06-09T04:38:11.178844+0000","last_active":"2023-06-09T04:38:21.329783+0000","last_peered":"2023-06-09T04:38:21.329783+0000","last_clean":"2023-06-09T04:38:21.329783+0000","last_became_active":"2023-06-09T04:38:11.178527+0000","last_became_peered":"2023-06-09T04:38:11.178527+0000","last_unstale":"2023-06-09T04:38:21.329783+0000","last_undegraded":"2023-06-09T04:38:21.329783+0000","last_fullsized":"2023-06-09T04:38:21.329783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:38.682351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982266+0000","last_change":"2023-06-09T04:38:11.590873+0000","last_active":"2023-06-09T04:38:15.982266+0000","last_peered":"2023-06-09T04:38:15.982266+0000","last_clean":"2023-06-09T04:38:15.982266+0000","last_became_active":"2023-06-09T04:38:11.590341+0000","last_became_peered":"2023-06-09T04:38:11.590341+0000","last_unstale":"2023-06-09T04:38:15.982266+0000","last_undegraded":"2023-06-09T04:38:15.982266+0000","last_fullsized":"2023-06-09T04:38:15.982266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982961+0000","last_change":"2023-06-09T04:38:15.641224+0000","last_active":"2023-06-09T04:38:15.982961+0000","last_peered":"2023-06-09T04:38:15.982961+0000","last_clean":"2023-06-09T04:38:15.982961+0000","last_became_active":"2023-06-09T04:38:15.630567+0000","last_became_peered":"2023-06-09T04:38:15.630567+0000","last_unstale":"2023-06-09T04:38:15.982961+0000","last_undegraded":"2023-06-09T04:38:15.982961+0000","last_fullsized":"2023-06-09T04:38:15.982961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:33.133686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981808+0000","last_change":"2023-06-09T04:38:11.591047+0000","last_active":"2023-06-09T04:38:15.981808+0000","last_peered":"2023-06-09T04:38:15.981808+0000","last_clean":"2023-06-09T04:38:15.981808+0000","last_became_active":"2023-06-09T04:38:11.590710+0000","last_became_peered":"2023-06-09T04:38:11.590710+0000","last_unstale":"2023-06-09T04:38:15.981808+0000","last_undegraded":"2023-06-09T04:38:15.981808+0000","last_fullsized":"2023-06-09T04:38:15.981808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561003+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:38:16.561003+0000","last_peered":"2023-06-09T04:38:16.561003+0000","last_clean":"2023-06-09T04:38:16.561003+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:38:16.561003+0000","last_undegraded":"2023-06-09T04:38:16.561003+0000","last_fullsized":"2023-06-09T04:38:16.561003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:56:41.217550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984485+0000","last_change":"2023-06-09T04:38:11.206839+0000","last_active":"2023-06-09T04:38:15.984485+0000","last_peered":"2023-06-09T04:38:15.984485+0000","last_clean":"2023-06-09T04:38:15.984485+0000","last_became_active":"2023-06-09T04:38:11.206136+0000","last_became_peered":"2023-06-09T04:38:11.206136+0000","last_unstale":"2023-06-09T04:38:15.984485+0000","last_undegraded":"2023-06-09T04:38:15.984485+0000","last_fullsized":"2023-06-09T04:38:15.984485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:00:59.250719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983799+0000","last_change":"2023-06-09T04:38:15.654768+0000","last_active":"2023-06-09T04:38:15.983799+0000","last_peered":"2023-06-09T04:38:15.983799+0000","last_clean":"2023-06-09T04:38:15.983799+0000","last_became_active":"2023-06-09T04:38:15.653848+0000","last_became_peered":"2023-06-09T04:38:15.653848+0000","last_unstale":"2023-06-09T04:38:15.983799+0000","last_undegraded":"2023-06-09T04:38:15.983799+0000","last_fullsized":"2023-06-09T04:38:15.983799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:35:20.247138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984327+0000","last_change":"2023-06-09T04:38:11.576946+0000","last_active":"2023-06-09T04:38:15.984327+0000","last_peered":"2023-06-09T04:38:15.984327+0000","last_clean":"2023-06-09T04:38:15.984327+0000","last_became_active":"2023-06-09T04:38:11.576234+0000","last_became_peered":"2023-06-09T04:38:11.576234+0000","last_unstale":"2023-06-09T04:38:15.984327+0000","last_undegraded":"2023-06-09T04:38:15.984327+0000","last_fullsized":"2023-06-09T04:38:15.984327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:09:39.247053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986402+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:38:15.986402+0000","last_peered":"2023-06-09T04:38:15.986402+0000","last_clean":"2023-06-09T04:38:15.986402+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:38:15.986402+0000","last_undegraded":"2023-06-09T04:38:15.986402+0000","last_fullsized":"2023-06-09T04:38:15.986402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:17.380871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985503+0000","last_change":"2023-06-09T04:38:11.207993+0000","last_active":"2023-06-09T04:38:15.985503+0000","last_peered":"2023-06-09T04:38:15.985503+0000","last_clean":"2023-06-09T04:38:15.985503+0000","last_became_active":"2023-06-09T04:38:11.207375+0000","last_became_peered":"2023-06-09T04:38:11.207375+0000","last_unstale":"2023-06-09T04:38:15.985503+0000","last_undegraded":"2023-06-09T04:38:15.985503+0000","last_fullsized":"2023-06-09T04:38:15.985503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:58.163202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559365+0000","last_change":"2023-06-09T04:38:15.629330+0000","last_active":"2023-06-09T04:38:16.559365+0000","last_peered":"2023-06-09T04:38:16.559365+0000","last_clean":"2023-06-09T04:38:16.559365+0000","last_became_active":"2023-06-09T04:38:15.628803+0000","last_became_peered":"2023-06-09T04:38:15.628803+0000","last_unstale":"2023-06-09T04:38:16.559365+0000","last_undegraded":"2023-06-09T04:38:16.559365+0000","last_fullsized":"2023-06-09T04:38:16.559365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:25.965238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985856+0000","last_change":"2023-06-09T04:38:11.582531+0000","last_active":"2023-06-09T04:38:15.985856+0000","last_peered":"2023-06-09T04:38:15.985856+0000","last_clean":"2023-06-09T04:38:15.985856+0000","last_became_active":"2023-06-09T04:38:11.581963+0000","last_became_peered":"2023-06-09T04:38:11.581963+0000","last_unstale":"2023-06-09T04:38:15.985856+0000","last_undegraded":"2023-06-09T04:38:15.985856+0000","last_fullsized":"2023-06-09T04:38:15.985856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560988+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:38:16.560988+0000","last_peered":"2023-06-09T04:38:16.560988+0000","last_clean":"2023-06-09T04:38:16.560988+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:38:16.560988+0000","last_undegraded":"2023-06-09T04:38:16.560988+0000","last_fullsized":"2023-06-09T04:38:16.560988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:08.570686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984867+0000","last_change":"2023-06-09T04:38:11.203569+0000","last_active":"2023-06-09T04:38:15.984867+0000","last_peered":"2023-06-09T04:38:15.984867+0000","last_clean":"2023-06-09T04:38:15.984867+0000","last_became_active":"2023-06-09T04:38:11.202787+0000","last_became_peered":"2023-06-09T04:38:11.202787+0000","last_unstale":"2023-06-09T04:38:15.984867+0000","last_undegraded":"2023-06-09T04:38:15.984867+0000","last_fullsized":"2023-06-09T04:38:15.984867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:57.391865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115733+0000","last_change":"2023-06-09T04:38:15.638680+0000","last_active":"2023-06-09T04:38:16.115733+0000","last_peered":"2023-06-09T04:38:16.115733+0000","last_clean":"2023-06-09T04:38:16.115733+0000","last_became_active":"2023-06-09T04:38:15.638219+0000","last_became_peered":"2023-06-09T04:38:15.638219+0000","last_unstale":"2023-06-09T04:38:16.115733+0000","last_undegraded":"2023-06-09T04:38:16.115733+0000","last_fullsized":"2023-06-09T04:38:16.115733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:36.541614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983149+0000","last_change":"2023-06-09T04:38:11.589753+0000","last_active":"2023-06-09T04:38:15.983149+0000","last_peered":"2023-06-09T04:38:15.983149+0000","last_clean":"2023-06-09T04:38:15.983149+0000","last_became_active":"2023-06-09T04:38:11.589289+0000","last_became_peered":"2023-06-09T04:38:11.589289+0000","last_unstale":"2023-06-09T04:38:15.983149+0000","last_undegraded":"2023-06-09T04:38:15.983149+0000","last_fullsized":"2023-06-09T04:38:15.983149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.797205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560927+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:38:16.560927+0000","last_peered":"2023-06-09T04:38:16.560927+0000","last_clean":"2023-06-09T04:38:16.560927+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:38:16.560927+0000","last_undegraded":"2023-06-09T04:38:16.560927+0000","last_fullsized":"2023-06-09T04:38:16.560927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:48.345845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981929+0000","last_change":"2023-06-09T04:38:11.191786+0000","last_active":"2023-06-09T04:38:15.981929+0000","last_peered":"2023-06-09T04:38:15.981929+0000","last_clean":"2023-06-09T04:38:15.981929+0000","last_became_active":"2023-06-09T04:38:11.191379+0000","last_became_peered":"2023-06-09T04:38:11.191379+0000","last_unstale":"2023-06-09T04:38:15.981929+0000","last_undegraded":"2023-06-09T04:38:15.981929+0000","last_fullsized":"2023-06-09T04:38:15.981929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984276+0000","last_change":"2023-06-09T04:38:15.652331+0000","last_active":"2023-06-09T04:38:15.984276+0000","last_peered":"2023-06-09T04:38:15.984276+0000","last_clean":"2023-06-09T04:38:15.984276+0000","last_became_active":"2023-06-09T04:38:15.651379+0000","last_became_peered":"2023-06-09T04:38:15.651379+0000","last_unstale":"2023-06-09T04:38:15.984276+0000","last_undegraded":"2023-06-09T04:38:15.984276+0000","last_fullsized":"2023-06-09T04:38:15.984276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:23.892869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984378+0000","last_change":"2023-06-09T04:38:11.581677+0000","last_active":"2023-06-09T04:38:15.984378+0000","last_peered":"2023-06-09T04:38:15.984378+0000","last_clean":"2023-06-09T04:38:15.984378+0000","last_became_active":"2023-06-09T04:38:11.580936+0000","last_became_peered":"2023-06-09T04:38:11.580936+0000","last_unstale":"2023-06-09T04:38:15.984378+0000","last_undegraded":"2023-06-09T04:38:15.984378+0000","last_fullsized":"2023-06-09T04:38:15.984378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115946+0000","last_change":"2023-06-09T04:38:11.182996+0000","last_active":"2023-06-09T04:38:16.115946+0000","last_peered":"2023-06-09T04:38:16.115946+0000","last_clean":"2023-06-09T04:38:16.115946+0000","last_became_active":"2023-06-09T04:38:11.182625+0000","last_became_peered":"2023-06-09T04:38:11.182625+0000","last_unstale":"2023-06-09T04:38:16.115946+0000","last_undegraded":"2023-06-09T04:38:16.115946+0000","last_fullsized":"2023-06-09T04:38:16.115946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:18.783819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560422+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:38:16.560422+0000","last_peered":"2023-06-09T04:38:16.560422+0000","last_clean":"2023-06-09T04:38:16.560422+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:38:16.560422+0000","last_undegraded":"2023-06-09T04:38:16.560422+0000","last_fullsized":"2023-06-09T04:38:16.560422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:23:30.684840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559603+0000","last_change":"2023-06-09T04:38:15.645663+0000","last_active":"2023-06-09T04:38:16.559603+0000","last_peered":"2023-06-09T04:38:16.559603+0000","last_clean":"2023-06-09T04:38:16.559603+0000","last_became_active":"2023-06-09T04:38:15.644922+0000","last_became_peered":"2023-06-09T04:38:15.644922+0000","last_unstale":"2023-06-09T04:38:16.559603+0000","last_undegraded":"2023-06-09T04:38:16.559603+0000","last_fullsized":"2023-06-09T04:38:16.559603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:58:02.310074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985956+0000","last_change":"2023-06-09T04:38:11.581442+0000","last_active":"2023-06-09T04:38:15.985956+0000","last_peered":"2023-06-09T04:38:15.985956+0000","last_clean":"2023-06-09T04:38:15.985956+0000","last_became_active":"2023-06-09T04:38:11.580940+0000","last_became_peered":"2023-06-09T04:38:11.580940+0000","last_unstale":"2023-06-09T04:38:15.985956+0000","last_undegraded":"2023-06-09T04:38:15.985956+0000","last_fullsized":"2023-06-09T04:38:15.985956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.557750+0000","last_change":"2023-06-09T04:38:11.201284+0000","last_active":"2023-06-09T04:38:16.557750+0000","last_peered":"2023-06-09T04:38:16.557750+0000","last_clean":"2023-06-09T04:38:16.557750+0000","last_became_active":"2023-06-09T04:38:11.200454+0000","last_became_peered":"2023-06-09T04:38:11.200454+0000","last_unstale":"2023-06-09T04:38:16.557750+0000","last_undegraded":"2023-06-09T04:38:16.557750+0000","last_fullsized":"2023-06-09T04:38:16.557750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:53.244123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559796+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:38:16.559796+0000","last_peered":"2023-06-09T04:38:16.559796+0000","last_clean":"2023-06-09T04:38:16.559796+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:38:16.559796+0000","last_undegraded":"2023-06-09T04:38:16.559796+0000","last_fullsized":"2023-06-09T04:38:16.559796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:35:18.640660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559491+0000","last_change":"2023-06-09T04:38:15.644559+0000","last_active":"2023-06-09T04:38:16.559491+0000","last_peered":"2023-06-09T04:38:16.559491+0000","last_clean":"2023-06-09T04:38:16.559491+0000","last_became_active":"2023-06-09T04:38:15.643793+0000","last_became_peered":"2023-06-09T04:38:15.643793+0000","last_unstale":"2023-06-09T04:38:16.559491+0000","last_undegraded":"2023-06-09T04:38:16.559491+0000","last_fullsized":"2023-06-09T04:38:16.559491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:27.198186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561351+0000","last_change":"2023-06-09T04:38:11.582052+0000","last_active":"2023-06-09T04:38:16.561351+0000","last_peered":"2023-06-09T04:38:16.561351+0000","last_clean":"2023-06-09T04:38:16.561351+0000","last_became_active":"2023-06-09T04:38:11.581569+0000","last_became_peered":"2023-06-09T04:38:11.581569+0000","last_unstale":"2023-06-09T04:38:16.561351+0000","last_undegraded":"2023-06-09T04:38:16.561351+0000","last_fullsized":"2023-06-09T04:38:16.561351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:27:07.420266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983212+0000","last_change":"2023-06-09T04:38:11.193727+0000","last_active":"2023-06-09T04:38:15.983212+0000","last_peered":"2023-06-09T04:38:15.983212+0000","last_clean":"2023-06-09T04:38:15.983212+0000","last_became_active":"2023-06-09T04:38:11.191671+0000","last_became_peered":"2023-06-09T04:38:11.191671+0000","last_unstale":"2023-06-09T04:38:15.983212+0000","last_undegraded":"2023-06-09T04:38:15.983212+0000","last_fullsized":"2023-06-09T04:38:15.983212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:18.631690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560388+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:38:16.560388+0000","last_peered":"2023-06-09T04:38:16.560388+0000","last_clean":"2023-06-09T04:38:16.560388+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:38:16.560388+0000","last_undegraded":"2023-06-09T04:38:16.560388+0000","last_fullsized":"2023-06-09T04:38:16.560388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:46.578064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560338+0000","last_change":"2023-06-09T04:38:15.631104+0000","last_active":"2023-06-09T04:38:16.560338+0000","last_peered":"2023-06-09T04:38:16.560338+0000","last_clean":"2023-06-09T04:38:16.560338+0000","last_became_active":"2023-06-09T04:38:15.630126+0000","last_became_peered":"2023-06-09T04:38:15.630126+0000","last_unstale":"2023-06-09T04:38:16.560338+0000","last_undegraded":"2023-06-09T04:38:16.560338+0000","last_fullsized":"2023-06-09T04:38:16.560338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:11:32.650489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560095+0000","last_change":"2023-06-09T04:38:11.609569+0000","last_active":"2023-06-09T04:38:16.560095+0000","last_peered":"2023-06-09T04:38:16.560095+0000","last_clean":"2023-06-09T04:38:16.560095+0000","last_became_active":"2023-06-09T04:38:11.608179+0000","last_became_peered":"2023-06-09T04:38:11.608179+0000","last_unstale":"2023-06-09T04:38:16.560095+0000","last_undegraded":"2023-06-09T04:38:16.560095+0000","last_fullsized":"2023-06-09T04:38:16.560095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:09:01.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984195+0000","last_change":"2023-06-09T04:38:11.180161+0000","last_active":"2023-06-09T04:38:15.984195+0000","last_peered":"2023-06-09T04:38:15.984195+0000","last_clean":"2023-06-09T04:38:15.984195+0000","last_became_active":"2023-06-09T04:38:11.179361+0000","last_became_peered":"2023-06-09T04:38:11.179361+0000","last_unstale":"2023-06-09T04:38:15.984195+0000","last_undegraded":"2023-06-09T04:38:15.984195+0000","last_fullsized":"2023-06-09T04:38:15.984195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:36:14.841594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560750+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:38:16.560750+0000","last_peered":"2023-06-09T04:38:16.560750+0000","last_clean":"2023-06-09T04:38:16.560750+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:38:16.560750+0000","last_undegraded":"2023-06-09T04:38:16.560750+0000","last_fullsized":"2023-06-09T04:38:16.560750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:05.863481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066863+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:38:16.066863+0000","last_peered":"2023-06-09T04:38:16.066863+0000","last_clean":"2023-06-09T04:38:16.066863+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:38:16.066863+0000","last_undegraded":"2023-06-09T04:38:16.066863+0000","last_fullsized":"2023-06-09T04:38:16.066863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:17.786150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116200+0000","last_change":"2023-06-09T04:38:15.648847+0000","last_active":"2023-06-09T04:38:16.116200+0000","last_peered":"2023-06-09T04:38:16.116200+0000","last_clean":"2023-06-09T04:38:16.116200+0000","last_became_active":"2023-06-09T04:38:15.648379+0000","last_became_peered":"2023-06-09T04:38:15.648379+0000","last_unstale":"2023-06-09T04:38:16.116200+0000","last_undegraded":"2023-06-09T04:38:16.116200+0000","last_fullsized":"2023-06-09T04:38:16.116200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:23.070086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559158+0000","last_change":"2023-06-09T04:38:11.599288+0000","last_active":"2023-06-09T04:38:16.559158+0000","last_peered":"2023-06-09T04:38:16.559158+0000","last_clean":"2023-06-09T04:38:16.559158+0000","last_became_active":"2023-06-09T04:38:11.598737+0000","last_became_peered":"2023-06-09T04:38:11.598737+0000","last_unstale":"2023-06-09T04:38:16.559158+0000","last_undegraded":"2023-06-09T04:38:16.559158+0000","last_fullsized":"2023-06-09T04:38:16.559158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:35.326089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986583+0000","last_change":"2023-06-09T04:38:11.191838+0000","last_active":"2023-06-09T04:38:15.986583+0000","last_peered":"2023-06-09T04:38:15.986583+0000","last_clean":"2023-06-09T04:38:15.986583+0000","last_became_active":"2023-06-09T04:38:11.191075+0000","last_became_peered":"2023-06-09T04:38:11.191075+0000","last_unstale":"2023-06-09T04:38:15.986583+0000","last_undegraded":"2023-06-09T04:38:15.986583+0000","last_fullsized":"2023-06-09T04:38:15.986583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:46.284052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560839+0000","last_change":"2023-06-09T04:38:15.613910+0000","last_active":"2023-06-09T04:38:16.560839+0000","last_peered":"2023-06-09T04:38:16.560839+0000","last_clean":"2023-06-09T04:38:16.560839+0000","last_became_active":"2023-06-09T04:38:15.613324+0000","last_became_peered":"2023-06-09T04:38:15.613324+0000","last_unstale":"2023-06-09T04:38:16.560839+0000","last_undegraded":"2023-06-09T04:38:16.560839+0000","last_fullsized":"2023-06-09T04:38:16.560839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:37:53.617189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982270+0000","last_change":"2023-06-09T04:38:11.565137+0000","last_active":"2023-06-09T04:38:15.982270+0000","last_peered":"2023-06-09T04:38:15.982270+0000","last_clean":"2023-06-09T04:38:15.982270+0000","last_became_active":"2023-06-09T04:38:11.564885+0000","last_became_peered":"2023-06-09T04:38:11.564885+0000","last_unstale":"2023-06-09T04:38:15.982270+0000","last_undegraded":"2023-06-09T04:38:15.982270+0000","last_fullsized":"2023-06-09T04:38:15.982270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:50.934840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560844+0000","last_change":"2023-06-09T04:38:11.210525+0000","last_active":"2023-06-09T04:38:16.560844+0000","last_peered":"2023-06-09T04:38:16.560844+0000","last_clean":"2023-06-09T04:38:16.560844+0000","last_became_active":"2023-06-09T04:38:11.210047+0000","last_became_peered":"2023-06-09T04:38:11.210047+0000","last_unstale":"2023-06-09T04:38:16.560844+0000","last_undegraded":"2023-06-09T04:38:16.560844+0000","last_fullsized":"2023-06-09T04:38:16.560844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:57.325527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066485+0000","last_change":"2023-06-09T04:38:15.616243+0000","last_active":"2023-06-09T04:38:16.066485+0000","last_peered":"2023-06-09T04:38:16.066485+0000","last_clean":"2023-06-09T04:38:16.066485+0000","last_became_active":"2023-06-09T04:38:15.615680+0000","last_became_peered":"2023-06-09T04:38:15.615680+0000","last_unstale":"2023-06-09T04:38:16.066485+0000","last_undegraded":"2023-06-09T04:38:16.066485+0000","last_fullsized":"2023-06-09T04:38:16.066485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:48.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559686+0000","last_change":"2023-06-09T04:38:11.609943+0000","last_active":"2023-06-09T04:38:16.559686+0000","last_peered":"2023-06-09T04:38:16.559686+0000","last_clean":"2023-06-09T04:38:16.559686+0000","last_became_active":"2023-06-09T04:38:11.608810+0000","last_became_peered":"2023-06-09T04:38:11.608810+0000","last_unstale":"2023-06-09T04:38:16.559686+0000","last_undegraded":"2023-06-09T04:38:16.559686+0000","last_fullsized":"2023-06-09T04:38:16.559686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:54:36.052953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560271+0000","last_change":"2023-06-09T04:38:11.173638+0000","last_active":"2023-06-09T04:38:16.560271+0000","last_peered":"2023-06-09T04:38:16.560271+0000","last_clean":"2023-06-09T04:38:16.560271+0000","last_became_active":"2023-06-09T04:38:11.173388+0000","last_became_peered":"2023-06-09T04:38:11.173388+0000","last_unstale":"2023-06-09T04:38:16.560271+0000","last_undegraded":"2023-06-09T04:38:16.560271+0000","last_fullsized":"2023-06-09T04:38:16.560271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:51:29.591833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560504+0000","last_change":"2023-06-09T04:38:15.614814+0000","last_active":"2023-06-09T04:38:16.560504+0000","last_peered":"2023-06-09T04:38:16.560504+0000","last_clean":"2023-06-09T04:38:16.560504+0000","last_became_active":"2023-06-09T04:38:15.613623+0000","last_became_peered":"2023-06-09T04:38:15.613623+0000","last_unstale":"2023-06-09T04:38:16.560504+0000","last_undegraded":"2023-06-09T04:38:16.560504+0000","last_fullsized":"2023-06-09T04:38:16.560504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:48:43.207948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116961+0000","last_change":"2023-06-09T04:38:11.596789+0000","last_active":"2023-06-09T04:38:16.116961+0000","last_peered":"2023-06-09T04:38:16.116961+0000","last_clean":"2023-06-09T04:38:16.116961+0000","last_became_active":"2023-06-09T04:38:11.596416+0000","last_became_peered":"2023-06-09T04:38:11.596416+0000","last_unstale":"2023-06-09T04:38:16.116961+0000","last_undegraded":"2023-06-09T04:38:16.116961+0000","last_fullsized":"2023-06-09T04:38:16.116961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558934+0000","last_change":"2023-06-09T04:38:11.199156+0000","last_active":"2023-06-09T04:38:16.558934+0000","last_peered":"2023-06-09T04:38:16.558934+0000","last_clean":"2023-06-09T04:38:16.558934+0000","last_became_active":"2023-06-09T04:38:11.198208+0000","last_became_peered":"2023-06-09T04:38:11.198208+0000","last_unstale":"2023-06-09T04:38:16.558934+0000","last_undegraded":"2023-06-09T04:38:16.558934+0000","last_fullsized":"2023-06-09T04:38:16.558934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:02.979372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559203+0000","last_change":"2023-06-09T04:38:15.644288+0000","last_active":"2023-06-09T04:38:16.559203+0000","last_peered":"2023-06-09T04:38:16.559203+0000","last_clean":"2023-06-09T04:38:16.559203+0000","last_became_active":"2023-06-09T04:38:15.643538+0000","last_became_peered":"2023-06-09T04:38:15.643538+0000","last_unstale":"2023-06-09T04:38:16.559203+0000","last_undegraded":"2023-06-09T04:38:16.559203+0000","last_fullsized":"2023-06-09T04:38:16.559203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:33:30.456054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560700+0000","last_change":"2023-06-09T04:38:11.596225+0000","last_active":"2023-06-09T04:38:16.560700+0000","last_peered":"2023-06-09T04:38:16.560700+0000","last_clean":"2023-06-09T04:38:16.560700+0000","last_became_active":"2023-06-09T04:38:11.595908+0000","last_became_peered":"2023-06-09T04:38:11.595908+0000","last_unstale":"2023-06-09T04:38:16.560700+0000","last_undegraded":"2023-06-09T04:38:16.560700+0000","last_fullsized":"2023-06-09T04:38:16.560700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:22:22.632206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.117460+0000","last_change":"2023-06-09T04:38:11.192489+0000","last_active":"2023-06-09T04:38:16.117460+0000","last_peered":"2023-06-09T04:38:16.117460+0000","last_clean":"2023-06-09T04:38:16.117460+0000","last_became_active":"2023-06-09T04:38:11.191911+0000","last_became_peered":"2023-06-09T04:38:11.191911+0000","last_unstale":"2023-06-09T04:38:16.117460+0000","last_undegraded":"2023-06-09T04:38:16.117460+0000","last_fullsized":"2023-06-09T04:38:16.117460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983119+0000","last_change":"2023-06-09T04:38:15.644054+0000","last_active":"2023-06-09T04:38:15.983119+0000","last_peered":"2023-06-09T04:38:15.983119+0000","last_clean":"2023-06-09T04:38:15.983119+0000","last_became_active":"2023-06-09T04:38:15.643226+0000","last_became_peered":"2023-06-09T04:38:15.643226+0000","last_unstale":"2023-06-09T04:38:15.983119+0000","last_undegraded":"2023-06-09T04:38:15.983119+0000","last_fullsized":"2023-06-09T04:38:15.983119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:08.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981525+0000","last_change":"2023-06-09T04:38:11.591783+0000","last_active":"2023-06-09T04:38:15.981525+0000","last_peered":"2023-06-09T04:38:15.981525+0000","last_clean":"2023-06-09T04:38:15.981525+0000","last_became_active":"2023-06-09T04:38:11.591359+0000","last_became_peered":"2023-06-09T04:38:11.591359+0000","last_unstale":"2023-06-09T04:38:15.981525+0000","last_undegraded":"2023-06-09T04:38:15.981525+0000","last_fullsized":"2023-06-09T04:38:15.981525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560729+0000","last_change":"2023-06-09T04:38:11.185014+0000","last_active":"2023-06-09T04:38:16.560729+0000","last_peered":"2023-06-09T04:38:16.560729+0000","last_clean":"2023-06-09T04:38:16.560729+0000","last_became_active":"2023-06-09T04:38:11.184569+0000","last_became_peered":"2023-06-09T04:38:11.184569+0000","last_unstale":"2023-06-09T04:38:16.560729+0000","last_undegraded":"2023-06-09T04:38:16.560729+0000","last_fullsized":"2023-06-09T04:38:16.560729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:02.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558082+0000","last_change":"2023-06-09T04:38:15.629791+0000","last_active":"2023-06-09T04:38:16.558082+0000","last_peered":"2023-06-09T04:38:16.558082+0000","last_clean":"2023-06-09T04:38:16.558082+0000","last_became_active":"2023-06-09T04:38:15.628267+0000","last_became_peered":"2023-06-09T04:38:15.628267+0000","last_unstale":"2023-06-09T04:38:16.558082+0000","last_undegraded":"2023-06-09T04:38:16.558082+0000","last_fullsized":"2023-06-09T04:38:16.558082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:56.733282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065867+0000","last_change":"2023-06-09T04:38:11.580119+0000","last_active":"2023-06-09T04:38:16.065867+0000","last_peered":"2023-06-09T04:38:16.065867+0000","last_clean":"2023-06-09T04:38:16.065867+0000","last_became_active":"2023-06-09T04:38:11.579683+0000","last_became_peered":"2023-06-09T04:38:11.579683+0000","last_unstale":"2023-06-09T04:38:16.065867+0000","last_undegraded":"2023-06-09T04:38:16.065867+0000","last_fullsized":"2023-06-09T04:38:16.065867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982464+0000","last_change":"2023-06-09T04:38:11.189768+0000","last_active":"2023-06-09T04:38:15.982464+0000","last_peered":"2023-06-09T04:38:15.982464+0000","last_clean":"2023-06-09T04:38:15.982464+0000","last_became_active":"2023-06-09T04:38:11.183589+0000","last_became_peered":"2023-06-09T04:38:11.183589+0000","last_unstale":"2023-06-09T04:38:15.982464+0000","last_undegraded":"2023-06-09T04:38:15.982464+0000","last_fullsized":"2023-06-09T04:38:15.982464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:44.537559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982754+0000","last_change":"2023-06-09T04:38:15.651304+0000","last_active":"2023-06-09T04:38:15.982754+0000","last_peered":"2023-06-09T04:38:15.982754+0000","last_clean":"2023-06-09T04:38:15.982754+0000","last_became_active":"2023-06-09T04:38:15.650429+0000","last_became_peered":"2023-06-09T04:38:15.650429+0000","last_unstale":"2023-06-09T04:38:15.982754+0000","last_undegraded":"2023-06-09T04:38:15.982754+0000","last_fullsized":"2023-06-09T04:38:15.982754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:35.270968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559138+0000","last_change":"2023-06-09T04:38:11.608450+0000","last_active":"2023-06-09T04:38:16.559138+0000","last_peered":"2023-06-09T04:38:16.559138+0000","last_clean":"2023-06-09T04:38:16.559138+0000","last_became_active":"2023-06-09T04:38:11.608016+0000","last_became_peered":"2023-06-09T04:38:11.608016+0000","last_unstale":"2023-06-09T04:38:16.559138+0000","last_undegraded":"2023-06-09T04:38:16.559138+0000","last_fullsized":"2023-06-09T04:38:16.559138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:47.297438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116600+0000","last_change":"2023-06-09T04:38:11.182774+0000","last_active":"2023-06-09T04:38:16.116600+0000","last_peered":"2023-06-09T04:38:16.116600+0000","last_clean":"2023-06-09T04:38:16.116600+0000","last_became_active":"2023-06-09T04:38:11.182454+0000","last_became_peered":"2023-06-09T04:38:11.182454+0000","last_unstale":"2023-06-09T04:38:16.116600+0000","last_undegraded":"2023-06-09T04:38:16.116600+0000","last_fullsized":"2023-06-09T04:38:16.116600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:20.644283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065961+0000","last_change":"2023-06-09T04:38:15.638696+0000","last_active":"2023-06-09T04:38:16.065961+0000","last_peered":"2023-06-09T04:38:16.065961+0000","last_clean":"2023-06-09T04:38:16.065961+0000","last_became_active":"2023-06-09T04:38:15.638021+0000","last_became_peered":"2023-06-09T04:38:15.638021+0000","last_unstale":"2023-06-09T04:38:16.065961+0000","last_undegraded":"2023-06-09T04:38:16.065961+0000","last_fullsized":"2023-06-09T04:38:16.065961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:56.518316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560437+0000","last_change":"2023-06-09T04:38:15.644394+0000","last_active":"2023-06-09T04:38:16.560437+0000","last_peered":"2023-06-09T04:38:16.560437+0000","last_clean":"2023-06-09T04:38:16.560437+0000","last_became_active":"2023-06-09T04:38:15.643951+0000","last_became_peered":"2023-06-09T04:38:15.643951+0000","last_unstale":"2023-06-09T04:38:16.560437+0000","last_undegraded":"2023-06-09T04:38:16.560437+0000","last_fullsized":"2023-06-09T04:38:16.560437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:51.630961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066744+0000","last_change":"2023-06-09T04:38:11.204035+0000","last_active":"2023-06-09T04:38:16.066744+0000","last_peered":"2023-06-09T04:38:16.066744+0000","last_clean":"2023-06-09T04:38:16.066744+0000","last_became_active":"2023-06-09T04:38:11.203724+0000","last_became_peered":"2023-06-09T04:38:11.203724+0000","last_unstale":"2023-06-09T04:38:16.066744+0000","last_undegraded":"2023-06-09T04:38:16.066744+0000","last_fullsized":"2023-06-09T04:38:16.066744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:23.339781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561757+0000","last_change":"2023-06-09T04:38:11.578687+0000","last_active":"2023-06-09T04:38:16.561757+0000","last_peered":"2023-06-09T04:38:16.561757+0000","last_clean":"2023-06-09T04:38:16.561757+0000","last_became_active":"2023-06-09T04:38:11.577901+0000","last_became_peered":"2023-06-09T04:38:11.577901+0000","last_unstale":"2023-06-09T04:38:16.561757+0000","last_undegraded":"2023-06-09T04:38:16.561757+0000","last_fullsized":"2023-06-09T04:38:16.561757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:44.239627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984075+0000","last_change":"2023-06-09T04:38:15.652937+0000","last_active":"2023-06-09T04:38:15.984075+0000","last_peered":"2023-06-09T04:38:15.984075+0000","last_clean":"2023-06-09T04:38:15.984075+0000","last_became_active":"2023-06-09T04:38:15.651857+0000","last_became_peered":"2023-06-09T04:38:15.651857+0000","last_unstale":"2023-06-09T04:38:15.984075+0000","last_undegraded":"2023-06-09T04:38:15.984075+0000","last_fullsized":"2023-06-09T04:38:15.984075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:57:40.466278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560952+0000","last_change":"2023-06-09T04:38:11.185987+0000","last_active":"2023-06-09T04:38:16.560952+0000","last_peered":"2023-06-09T04:38:16.560952+0000","last_clean":"2023-06-09T04:38:16.560952+0000","last_became_active":"2023-06-09T04:38:11.185132+0000","last_became_peered":"2023-06-09T04:38:11.185132+0000","last_unstale":"2023-06-09T04:38:16.560952+0000","last_undegraded":"2023-06-09T04:38:16.560952+0000","last_fullsized":"2023-06-09T04:38:16.560952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:29:24.685594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561261+0000","last_change":"2023-06-09T04:38:11.581671+0000","last_active":"2023-06-09T04:38:16.561261+0000","last_peered":"2023-06-09T04:38:16.561261+0000","last_clean":"2023-06-09T04:38:16.561261+0000","last_became_active":"2023-06-09T04:38:11.579485+0000","last_became_peered":"2023-06-09T04:38:11.579485+0000","last_unstale":"2023-06-09T04:38:16.561261+0000","last_undegraded":"2023-06-09T04:38:16.561261+0000","last_fullsized":"2023-06-09T04:38:16.561261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:26:56.275716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983528+0000","last_change":"2023-06-09T04:38:11.196724+0000","last_active":"2023-06-09T04:38:15.983528+0000","last_peered":"2023-06-09T04:38:15.983528+0000","last_clean":"2023-06-09T04:38:15.983528+0000","last_became_active":"2023-06-09T04:38:11.196068+0000","last_became_peered":"2023-06-09T04:38:11.196068+0000","last_unstale":"2023-06-09T04:38:15.983528+0000","last_undegraded":"2023-06-09T04:38:15.983528+0000","last_fullsized":"2023-06-09T04:38:15.983528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:25.012517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559819+0000","last_change":"2023-06-09T04:38:11.590465+0000","last_active":"2023-06-09T04:38:16.559819+0000","last_peered":"2023-06-09T04:38:16.559819+0000","last_clean":"2023-06-09T04:38:16.559819+0000","last_became_active":"2023-06-09T04:38:11.589834+0000","last_became_peered":"2023-06-09T04:38:11.589834+0000","last_unstale":"2023-06-09T04:38:16.559819+0000","last_undegraded":"2023-06-09T04:38:16.559819+0000","last_fullsized":"2023-06-09T04:38:16.559819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:26.501877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984273+0000","last_change":"2023-06-09T04:38:15.638948+0000","last_active":"2023-06-09T04:38:15.984273+0000","last_peered":"2023-06-09T04:38:15.984273+0000","last_clean":"2023-06-09T04:38:15.984273+0000","last_became_active":"2023-06-09T04:38:15.637442+0000","last_became_peered":"2023-06-09T04:38:15.637442+0000","last_unstale":"2023-06-09T04:38:15.984273+0000","last_undegraded":"2023-06-09T04:38:15.984273+0000","last_fullsized":"2023-06-09T04:38:15.984273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:03:02.201851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560419+0000","last_change":"2023-06-09T04:38:11.186756+0000","last_active":"2023-06-09T04:38:16.560419+0000","last_peered":"2023-06-09T04:38:16.560419+0000","last_clean":"2023-06-09T04:38:16.560419+0000","last_became_active":"2023-06-09T04:38:11.185821+0000","last_became_peered":"2023-06-09T04:38:11.185821+0000","last_unstale":"2023-06-09T04:38:16.560419+0000","last_undegraded":"2023-06-09T04:38:16.560419+0000","last_fullsized":"2023-06-09T04:38:16.560419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:55.494527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984073+0000","last_change":"2023-06-09T04:38:11.598710+0000","last_active":"2023-06-09T04:38:15.984073+0000","last_peered":"2023-06-09T04:38:15.984073+0000","last_clean":"2023-06-09T04:38:15.984073+0000","last_became_active":"2023-06-09T04:38:11.598397+0000","last_became_peered":"2023-06-09T04:38:11.598397+0000","last_unstale":"2023-06-09T04:38:15.984073+0000","last_undegraded":"2023-06-09T04:38:15.984073+0000","last_fullsized":"2023-06-09T04:38:15.984073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559520+0000","last_change":"2023-06-09T04:38:15.621608+0000","last_active":"2023-06-09T04:38:16.559520+0000","last_peered":"2023-06-09T04:38:16.559520+0000","last_clean":"2023-06-09T04:38:16.559520+0000","last_became_active":"2023-06-09T04:38:15.621042+0000","last_became_peered":"2023-06-09T04:38:15.621042+0000","last_unstale":"2023-06-09T04:38:16.559520+0000","last_undegraded":"2023-06-09T04:38:16.559520+0000","last_fullsized":"2023-06-09T04:38:16.559520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:05:03.071443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066570+0000","last_change":"2023-06-09T04:38:11.594280+0000","last_active":"2023-06-09T04:38:16.066570+0000","last_peered":"2023-06-09T04:38:16.066570+0000","last_clean":"2023-06-09T04:38:16.066570+0000","last_became_active":"2023-06-09T04:38:11.593913+0000","last_became_peered":"2023-06-09T04:38:11.593913+0000","last_unstale":"2023-06-09T04:38:16.066570+0000","last_undegraded":"2023-06-09T04:38:16.066570+0000","last_fullsized":"2023-06-09T04:38:16.066570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:04.790292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982855+0000","last_change":"2023-06-09T04:38:11.581417+0000","last_active":"2023-06-09T04:38:15.982855+0000","last_peered":"2023-06-09T04:38:15.982855+0000","last_clean":"2023-06-09T04:38:15.982855+0000","last_became_active":"2023-06-09T04:38:11.580835+0000","last_became_peered":"2023-06-09T04:38:11.580835+0000","last_unstale":"2023-06-09T04:38:15.982855+0000","last_undegraded":"2023-06-09T04:38:15.982855+0000","last_fullsized":"2023-06-09T04:38:15.982855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:33.116603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115907+0000","last_change":"2023-06-09T04:38:11.605024+0000","last_active":"2023-06-09T04:38:16.115907+0000","last_peered":"2023-06-09T04:38:16.115907+0000","last_clean":"2023-06-09T04:38:16.115907+0000","last_became_active":"2023-06-09T04:38:11.604711+0000","last_became_peered":"2023-06-09T04:38:11.604711+0000","last_unstale":"2023-06-09T04:38:16.115907+0000","last_undegraded":"2023-06-09T04:38:16.115907+0000","last_fullsized":"2023-06-09T04:38:16.115907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:05.142990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560506+0000","last_change":"2023-06-09T04:38:11.575886+0000","last_active":"2023-06-09T04:38:16.560506+0000","last_peered":"2023-06-09T04:38:16.560506+0000","last_clean":"2023-06-09T04:38:16.560506+0000","last_became_active":"2023-06-09T04:38:11.575594+0000","last_became_peered":"2023-06-09T04:38:11.575594+0000","last_unstale":"2023-06-09T04:38:16.560506+0000","last_undegraded":"2023-06-09T04:38:16.560506+0000","last_fullsized":"2023-06-09T04:38:16.560506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:51.547429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560644+0000","last_change":"2023-06-09T04:38:11.573026+0000","last_active":"2023-06-09T04:38:16.560644+0000","last_peered":"2023-06-09T04:38:16.560644+0000","last_clean":"2023-06-09T04:38:16.560644+0000","last_became_active":"2023-06-09T04:38:11.572744+0000","last_became_peered":"2023-06-09T04:38:11.572744+0000","last_unstale":"2023-06-09T04:38:16.560644+0000","last_undegraded":"2023-06-09T04:38:16.560644+0000","last_fullsized":"2023-06-09T04:38:16.560644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:04:38.824518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560873+0000","last_change":"2023-06-09T04:38:11.597829+0000","last_active":"2023-06-09T04:38:16.560873+0000","last_peered":"2023-06-09T04:38:16.560873+0000","last_clean":"2023-06-09T04:38:16.560873+0000","last_became_active":"2023-06-09T04:38:11.590175+0000","last_became_peered":"2023-06-09T04:38:11.590175+0000","last_unstale":"2023-06-09T04:38:16.560873+0000","last_undegraded":"2023-06-09T04:38:16.560873+0000","last_fullsized":"2023-06-09T04:38:16.560873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:10.046575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559401+0000","last_change":"2023-06-09T04:38:11.598947+0000","last_active":"2023-06-09T04:38:16.559401+0000","last_peered":"2023-06-09T04:38:16.559401+0000","last_clean":"2023-06-09T04:38:16.559401+0000","last_became_active":"2023-06-09T04:38:11.598503+0000","last_became_peered":"2023-06-09T04:38:11.598503+0000","last_unstale":"2023-06-09T04:38:16.559401+0000","last_undegraded":"2023-06-09T04:38:16.559401+0000","last_fullsized":"2023-06-09T04:38:16.559401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:44.845221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985260+0000","last_change":"2023-06-09T04:38:11.594511+0000","last_active":"2023-06-09T04:38:15.985260+0000","last_peered":"2023-06-09T04:38:15.985260+0000","last_clean":"2023-06-09T04:38:15.985260+0000","last_became_active":"2023-06-09T04:38:11.592278+0000","last_became_peered":"2023-06-09T04:38:11.592278+0000","last_unstale":"2023-06-09T04:38:15.985260+0000","last_undegraded":"2023-06-09T04:38:15.985260+0000","last_fullsized":"2023-06-09T04:38:15.985260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:36:26.790998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065900+0000","last_change":"2023-06-09T04:38:11.581970+0000","last_active":"2023-06-09T04:38:16.065900+0000","last_peered":"2023-06-09T04:38:16.065900+0000","last_clean":"2023-06-09T04:38:16.065900+0000","last_became_active":"2023-06-09T04:38:11.581665+0000","last_became_peered":"2023-06-09T04:38:11.581665+0000","last_unstale":"2023-06-09T04:38:16.065900+0000","last_undegraded":"2023-06-09T04:38:16.065900+0000","last_fullsized":"2023-06-09T04:38:16.065900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986039+0000","last_change":"2023-06-09T04:38:11.594155+0000","last_active":"2023-06-09T04:38:15.986039+0000","last_peered":"2023-06-09T04:38:15.986039+0000","last_clean":"2023-06-09T04:38:15.986039+0000","last_became_active":"2023-06-09T04:38:11.592402+0000","last_became_peered":"2023-06-09T04:38:11.592402+0000","last_unstale":"2023-06-09T04:38:15.986039+0000","last_undegraded":"2023-06-09T04:38:15.986039+0000","last_fullsized":"2023-06-09T04:38:15.986039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:03.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559449+0000","last_change":"2023-06-09T04:38:11.598820+0000","last_active":"2023-06-09T04:38:16.559449+0000","last_peered":"2023-06-09T04:38:16.559449+0000","last_clean":"2023-06-09T04:38:16.559449+0000","last_became_active":"2023-06-09T04:38:11.598538+0000","last_became_peered":"2023-06-09T04:38:11.598538+0000","last_unstale":"2023-06-09T04:38:16.559449+0000","last_undegraded":"2023-06-09T04:38:16.559449+0000","last_fullsized":"2023-06-09T04:38:16.559449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:32.642381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066228+0000","last_change":"2023-06-09T04:38:11.581487+0000","last_active":"2023-06-09T04:38:16.066228+0000","last_peered":"2023-06-09T04:38:16.066228+0000","last_clean":"2023-06-09T04:38:16.066228+0000","last_became_active":"2023-06-09T04:38:11.580791+0000","last_became_peered":"2023-06-09T04:38:11.580791+0000","last_unstale":"2023-06-09T04:38:16.066228+0000","last_undegraded":"2023-06-09T04:38:16.066228+0000","last_fullsized":"2023-06-09T04:38:16.066228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066270+0000","last_change":"2023-06-09T04:38:11.596924+0000","last_active":"2023-06-09T04:38:16.066270+0000","last_peered":"2023-06-09T04:38:16.066270+0000","last_clean":"2023-06-09T04:38:16.066270+0000","last_became_active":"2023-06-09T04:38:11.596514+0000","last_became_peered":"2023-06-09T04:38:11.596514+0000","last_unstale":"2023-06-09T04:38:16.066270+0000","last_undegraded":"2023-06-09T04:38:16.066270+0000","last_fullsized":"2023-06-09T04:38:16.066270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:15.244503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561345+0000","last_change":"2023-06-09T04:38:11.591842+0000","last_active":"2023-06-09T04:38:16.561345+0000","last_peered":"2023-06-09T04:38:16.561345+0000","last_clean":"2023-06-09T04:38:16.561345+0000","last_became_active":"2023-06-09T04:38:11.591348+0000","last_became_peered":"2023-06-09T04:38:11.591348+0000","last_unstale":"2023-06-09T04:38:16.561345+0000","last_undegraded":"2023-06-09T04:38:16.561345+0000","last_fullsized":"2023-06-09T04:38:16.561345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:11.837579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116228+0000","last_change":"2023-06-09T04:38:11.581598+0000","last_active":"2023-06-09T04:38:16.116228+0000","last_peered":"2023-06-09T04:38:16.116228+0000","last_clean":"2023-06-09T04:38:16.116228+0000","last_became_active":"2023-06-09T04:38:11.581079+0000","last_became_peered":"2023-06-09T04:38:11.581079+0000","last_unstale":"2023-06-09T04:38:16.116228+0000","last_undegraded":"2023-06-09T04:38:16.116228+0000","last_fullsized":"2023-06-09T04:38:16.116228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:26.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559059+0000","last_change":"2023-06-09T04:38:11.588434+0000","last_active":"2023-06-09T04:38:16.559059+0000","last_peered":"2023-06-09T04:38:16.559059+0000","last_clean":"2023-06-09T04:38:16.559059+0000","last_became_active":"2023-06-09T04:38:11.586783+0000","last_became_peered":"2023-06-09T04:38:11.586783+0000","last_unstale":"2023-06-09T04:38:16.559059+0000","last_undegraded":"2023-06-09T04:38:16.559059+0000","last_fullsized":"2023-06-09T04:38:16.559059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:30:39.956547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559051+0000","last_change":"2023-06-09T04:38:11.589256+0000","last_active":"2023-06-09T04:38:16.559051+0000","last_peered":"2023-06-09T04:38:16.559051+0000","last_clean":"2023-06-09T04:38:16.559051+0000","last_became_active":"2023-06-09T04:38:11.585253+0000","last_became_peered":"2023-06-09T04:38:11.585253+0000","last_unstale":"2023-06-09T04:38:16.559051+0000","last_undegraded":"2023-06-09T04:38:16.559051+0000","last_fullsized":"2023-06-09T04:38:16.559051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:20.593479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115686+0000","last_change":"2023-06-09T04:38:11.595137+0000","last_active":"2023-06-09T04:38:16.115686+0000","last_peered":"2023-06-09T04:38:16.115686+0000","last_clean":"2023-06-09T04:38:16.115686+0000","last_became_active":"2023-06-09T04:38:11.594879+0000","last_became_peered":"2023-06-09T04:38:11.594879+0000","last_unstale":"2023-06-09T04:38:16.115686+0000","last_undegraded":"2023-06-09T04:38:16.115686+0000","last_fullsized":"2023-06-09T04:38:16.115686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:29.708676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066144+0000","last_change":"2023-06-09T04:38:11.580088+0000","last_active":"2023-06-09T04:38:16.066144+0000","last_peered":"2023-06-09T04:38:16.066144+0000","last_clean":"2023-06-09T04:38:16.066144+0000","last_became_active":"2023-06-09T04:38:11.579839+0000","last_became_peered":"2023-06-09T04:38:11.579839+0000","last_unstale":"2023-06-09T04:38:16.066144+0000","last_undegraded":"2023-06-09T04:38:16.066144+0000","last_fullsized":"2023-06-09T04:38:16.066144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985563+0000","last_change":"2023-06-09T04:38:11.584533+0000","last_active":"2023-06-09T04:38:15.985563+0000","last_peered":"2023-06-09T04:38:15.985563+0000","last_clean":"2023-06-09T04:38:15.985563+0000","last_became_active":"2023-06-09T04:38:11.583229+0000","last_became_peered":"2023-06-09T04:38:11.583229+0000","last_unstale":"2023-06-09T04:38:15.985563+0000","last_undegraded":"2023-06-09T04:38:15.985563+0000","last_fullsized":"2023-06-09T04:38:15.985563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560605+0000","last_change":"2023-06-09T04:38:11.590402+0000","last_active":"2023-06-09T04:38:16.560605+0000","last_peered":"2023-06-09T04:38:16.560605+0000","last_clean":"2023-06-09T04:38:16.560605+0000","last_became_active":"2023-06-09T04:38:11.590128+0000","last_became_peered":"2023-06-09T04:38:11.590128+0000","last_unstale":"2023-06-09T04:38:16.560605+0000","last_undegraded":"2023-06-09T04:38:16.560605+0000","last_fullsized":"2023-06-09T04:38:16.560605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:31.691341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066715+0000","last_change":"2023-06-09T04:38:11.575532+0000","last_active":"2023-06-09T04:38:16.066715+0000","last_peered":"2023-06-09T04:38:16.066715+0000","last_clean":"2023-06-09T04:38:16.066715+0000","last_became_active":"2023-06-09T04:38:11.574743+0000","last_became_peered":"2023-06-09T04:38:11.574743+0000","last_unstale":"2023-06-09T04:38:16.066715+0000","last_undegraded":"2023-06-09T04:38:16.066715+0000","last_fullsized":"2023-06-09T04:38:16.066715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:27:44.893546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066132+0000","last_change":"2023-06-09T04:38:11.587445+0000","last_active":"2023-06-09T04:38:16.066132+0000","last_peered":"2023-06-09T04:38:16.066132+0000","last_clean":"2023-06-09T04:38:16.066132+0000","last_became_active":"2023-06-09T04:38:11.587078+0000","last_became_peered":"2023-06-09T04:38:11.587078+0000","last_unstale":"2023-06-09T04:38:16.066132+0000","last_undegraded":"2023-06-09T04:38:16.066132+0000","last_fullsized":"2023-06-09T04:38:16.066132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:57.955916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984537+0000","last_change":"2023-06-09T04:38:11.594397+0000","last_active":"2023-06-09T04:38:15.984537+0000","last_peered":"2023-06-09T04:38:15.984537+0000","last_clean":"2023-06-09T04:38:15.984537+0000","last_became_active":"2023-06-09T04:38:11.592636+0000","last_became_peered":"2023-06-09T04:38:11.592636+0000","last_unstale":"2023-06-09T04:38:15.984537+0000","last_undegraded":"2023-06-09T04:38:15.984537+0000","last_fullsized":"2023-06-09T04:38:15.984537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:00:19.960889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065734+0000","last_change":"2023-06-09T04:38:11.572712+0000","last_active":"2023-06-09T04:38:16.065734+0000","last_peered":"2023-06-09T04:38:16.065734+0000","last_clean":"2023-06-09T04:38:16.065734+0000","last_became_active":"2023-06-09T04:38:11.571728+0000","last_became_peered":"2023-06-09T04:38:11.571728+0000","last_unstale":"2023-06-09T04:38:16.065734+0000","last_undegraded":"2023-06-09T04:38:16.065734+0000","last_fullsized":"2023-06-09T04:38:16.065734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559434+0000","last_change":"2023-06-09T04:38:11.590174+0000","last_active":"2023-06-09T04:38:16.559434+0000","last_peered":"2023-06-09T04:38:16.559434+0000","last_clean":"2023-06-09T04:38:16.559434+0000","last_became_active":"2023-06-09T04:38:11.589797+0000","last_became_peered":"2023-06-09T04:38:11.589797+0000","last_unstale":"2023-06-09T04:38:16.559434+0000","last_undegraded":"2023-06-09T04:38:16.559434+0000","last_fullsized":"2023-06-09T04:38:16.559434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:50.267811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559697+0000","last_change":"2023-06-09T04:38:11.597890+0000","last_active":"2023-06-09T04:38:16.559697+0000","last_peered":"2023-06-09T04:38:16.559697+0000","last_clean":"2023-06-09T04:38:16.559697+0000","last_became_active":"2023-06-09T04:38:11.590403+0000","last_became_peered":"2023-06-09T04:38:11.590403+0000","last_unstale":"2023-06-09T04:38:16.559697+0000","last_undegraded":"2023-06-09T04:38:16.559697+0000","last_fullsized":"2023-06-09T04:38:16.559697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:31:47.357977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984691+0000","last_change":"2023-06-09T04:38:11.590981+0000","last_active":"2023-06-09T04:38:15.984691+0000","last_peered":"2023-06-09T04:38:15.984691+0000","last_clean":"2023-06-09T04:38:15.984691+0000","last_became_active":"2023-06-09T04:38:11.590680+0000","last_became_peered":"2023-06-09T04:38:11.590680+0000","last_unstale":"2023-06-09T04:38:15.984691+0000","last_undegraded":"2023-06-09T04:38:15.984691+0000","last_fullsized":"2023-06-09T04:38:15.984691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:34.676457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116447+0000","last_change":"2023-06-09T04:38:11.581610+0000","last_active":"2023-06-09T04:38:16.116447+0000","last_peered":"2023-06-09T04:38:16.116447+0000","last_clean":"2023-06-09T04:38:16.116447+0000","last_became_active":"2023-06-09T04:38:11.580238+0000","last_became_peered":"2023-06-09T04:38:11.580238+0000","last_unstale":"2023-06-09T04:38:16.116447+0000","last_undegraded":"2023-06-09T04:38:16.116447+0000","last_fullsized":"2023-06-09T04:38:16.116447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116281+0000","last_change":"2023-06-09T04:38:11.579502+0000","last_active":"2023-06-09T04:38:16.116281+0000","last_peered":"2023-06-09T04:38:16.116281+0000","last_clean":"2023-06-09T04:38:16.116281+0000","last_became_active":"2023-06-09T04:38:11.579076+0000","last_became_peered":"2023-06-09T04:38:11.579076+0000","last_unstale":"2023-06-09T04:38:16.116281+0000","last_undegraded":"2023-06-09T04:38:16.116281+0000","last_fullsized":"2023-06-09T04:38:16.116281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982195+0000","last_change":"2023-06-09T04:38:11.595714+0000","last_active":"2023-06-09T04:38:15.982195+0000","last_peered":"2023-06-09T04:38:15.982195+0000","last_clean":"2023-06-09T04:38:15.982195+0000","last_became_active":"2023-06-09T04:38:11.595346+0000","last_became_peered":"2023-06-09T04:38:11.595346+0000","last_unstale":"2023-06-09T04:38:15.982195+0000","last_undegraded":"2023-06-09T04:38:15.982195+0000","last_fullsized":"2023-06-09T04:38:15.982195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561947+0000","last_change":"2023-06-09T04:38:11.584489+0000","last_active":"2023-06-09T04:38:16.561947+0000","last_peered":"2023-06-09T04:38:16.561947+0000","last_clean":"2023-06-09T04:38:16.561947+0000","last_became_active":"2023-06-09T04:38:11.584214+0000","last_became_peered":"2023-06-09T04:38:11.584214+0000","last_unstale":"2023-06-09T04:38:16.561947+0000","last_undegraded":"2023-06-09T04:38:16.561947+0000","last_fullsized":"2023-06-09T04:38:16.561947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:06:31.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":315392,"data_stored":125663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":712808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":712716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":125559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:35.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:35.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.215+0000 7fcf96895640 1 Processor -- start 2023-06-09T04:38:35.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.215+0000 7fcf96895640 1 -- start start 2023-06-09T04:38:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf900b7480 0x7fcf900b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf9006a3e0 0x7fcf900b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9015c950 con 0x7fcf900cc9b0 2023-06-09T04:38:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900ce320 con 0x7fcf9006a3e0 2023-06-09T04:38:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900cc4b0 con 0x7fcf900b7480 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf94e32640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf9006a3e0 0x7fcf900b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf8f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcf900cc9b0 0x7fcf900692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59184/0 (socket says 172.21.15.18:59184) 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf8f7fe640 1 -- 172.21.15.18:0/1955828249 learned_addr learned my addr 172.21.15.18:0/1955828249 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf8ffff640 1 --2- 172.21.15.18:0/1955828249 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf900b7480 0x7fcf900b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf94e32640 1 -- 172.21.15.18:0/1955828249 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf900b7480 msgr2=0x7fcf900b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf94e32640 1 --2- 172.21.15.18:0/1955828249 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf900b7480 0x7fcf900b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf94e32640 1 -- 172.21.15.18:0/1955828249 >> v1:172.21.15.18:6789/0 conn(0x7fcf900cc9b0 legacy=0x7fcf900692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf94e32640 1 -- 172.21.15.18:0/1955828249 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900ce010 con 0x7fcf9006a3e0 2023-06-09T04:38:35.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf94e32640 1 --2- 172.21.15.18:0/1955828249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf9006a3e0 0x7fcf900b3e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009d90 tx=0x7fcf8801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec65e35678ccbf20 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf8effd640 1 -- 172.21.15.18:0/1955828249 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880a5a30 con 0x7fcf9006a3e0 2023-06-09T04:38:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf8effd640 1 -- 172.21.15.18:0/1955828249 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880a5b90 con 0x7fcf9006a3e0 2023-06-09T04:38:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf8effd640 1 -- 172.21.15.18:0/1955828249 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880ad440 con 0x7fcf9006a3e0 2023-06-09T04:38:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- 172.21.15.18:0/1955828249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf9006a3e0 msgr2=0x7fcf900b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 --2- 172.21.15.18:0/1955828249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf9006a3e0 0x7fcf900b3e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009d90 tx=0x7fcf8801c950 comp rx=0 tx=0).stop 2023-06-09T04:38:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- 172.21.15.18:0/1955828249 shutdown_connections 2023-06-09T04:38:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 --2- 172.21.15.18:0/1955828249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf9006a3e0 0x7fcf900b3e10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 --2- 172.21.15.18:0/1955828249 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf900b7480 0x7fcf900b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- 172.21.15.18:0/1955828249 >> 172.21.15.18:0/1955828249 conn(0x7fcf900d2ae0 msgr2=0x7fcf900ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- 172.21.15.18:0/1955828249 shutdown_connections 2023-06-09T04:38:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.219+0000 7fcf96895640 1 -- 172.21.15.18:0/1955828249 wait complete. 2023-06-09T04:38:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 Processor -- start 2023-06-09T04:38:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- start start 2023-06-09T04:38:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006a3e0 0x7fcf90157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 0x7fcf900c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf901582f0 0x7fcf900c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900ca140 con 0x7fcf900b7480 2023-06-09T04:38:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900ca420 con 0x7fcf9006a3e0 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900ca700 con 0x7fcf901582f0 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 0x7fcf900c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 0x7fcf900c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58236/0 (socket says 172.21.15.18:58236) 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 -- 172.21.15.18:0/3672542234 learned_addr learned my addr 172.21.15.18:0/3672542234 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf94e32640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf901582f0 0x7fcf900c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8ffff640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006a3e0 0x7fcf90157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 -- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf901582f0 msgr2=0x7fcf900c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf901582f0 0x7fcf900c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 -- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006a3e0 msgr2=0x7fcf90157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006a3e0 0x7fcf90157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 -- 172.21.15.18:0/3672542234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88009a70 con 0x7fcf900b7480 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8f7fe640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 0x7fcf900c95f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c400 tx=0x7fcf8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84005cf0 con 0x7fcf900b7480 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84005e50 con 0x7fcf900b7480 2023-06-09T04:38:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900ca9e0 con 0x7fcf900b7480 2023-06-09T04:38:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840072d0 con 0x7fcf900b7480 2023-06-09T04:38:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9015df60 con 0x7fcf900b7480 2023-06-09T04:38:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.223+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf90073380 con 0x7fcf900b7480 2023-06-09T04:38:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.227+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf84007430 con 0x7fcf900b7480 2023-06-09T04:38:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.227+0000 7fcf8cff9640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf7c066280 0x7fcf7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.227+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf840834e0 con 0x7fcf900b7480 2023-06-09T04:38:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.227+0000 7fcf8ffff640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf7c066280 0x7fcf7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.227+0000 7fcf8ffff640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf7c066280 0x7fcf7c068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b9d0 tx=0x7fcf80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.231+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf84050720 con 0x7fcf900b7480 2023-06-09T04:38:35.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.383+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf900b7850 con 0x7fcf7c066280 2023-06-09T04:38:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.411+0000 7fcf8cff9640 1 -- 172.21.15.18:0/3672542234 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367317 (secure 0 0 0) 0x7fcf8000b670 con 0x7fcf7c066280 2023-06-09T04:38:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:38:35.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf7c066280 msgr2=0x7fcf7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf7c066280 0x7fcf7c068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b9d0 tx=0x7fcf80008040 comp rx=0 tx=0).stop 2023-06-09T04:38:35.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 msgr2=0x7fcf900c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 0x7fcf900c95f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c400 tx=0x7fcf8400c8c0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 shutdown_connections 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf7c066280 0x7fcf7c068730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf901582f0 0x7fcf900c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf900b7480 0x7fcf900c95f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 --2- 172.21.15.18:0/3672542234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006a3e0 0x7fcf90157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 >> 172.21.15.18:0/3672542234 conn(0x7fcf900d2ae0 msgr2=0x7fcf900b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 shutdown_connections 2023-06-09T04:38:35.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.415+0000 7fcf96895640 1 -- 172.21.15.18:0/3672542234 wait complete. 2023-06-09T04:38:35.434 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-06-09T04:38:33.702418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235528,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739192,"statfs":{"total":773094113280,"available":772852932608,"internally_reserved":0,"allocated":3612672,"data_stored":2164046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005108"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985748+0000","last_change":"2023-06-09T04:38:15.615901+0000","last_active":"2023-06-09T04:38:15.985748+0000","last_peered":"2023-06-09T04:38:15.985748+0000","last_clean":"2023-06-09T04:38:15.985748+0000","last_became_active":"2023-06-09T04:38:15.614830+0000","last_became_peered":"2023-06-09T04:38:15.614830+0000","last_unstale":"2023-06-09T04:38:15.985748+0000","last_undegraded":"2023-06-09T04:38:15.985748+0000","last_fullsized":"2023-06-09T04:38:15.985748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:27:43.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561949+0000","last_change":"2023-06-09T04:38:11.203692+0000","last_active":"2023-06-09T04:38:16.561949+0000","last_peered":"2023-06-09T04:38:16.561949+0000","last_clean":"2023-06-09T04:38:16.561949+0000","last_became_active":"2023-06-09T04:38:11.202964+0000","last_became_peered":"2023-06-09T04:38:11.202964+0000","last_unstale":"2023-06-09T04:38:16.561949+0000","last_undegraded":"2023-06-09T04:38:16.561949+0000","last_fullsized":"2023-06-09T04:38:16.561949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:13.783096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981243+0000","last_change":"2023-06-09T04:38:11.594761+0000","last_active":"2023-06-09T04:38:15.981243+0000","last_peered":"2023-06-09T04:38:15.981243+0000","last_clean":"2023-06-09T04:38:15.981243+0000","last_became_active":"2023-06-09T04:38:11.594211+0000","last_became_peered":"2023-06-09T04:38:11.594211+0000","last_unstale":"2023-06-09T04:38:15.981243+0000","last_undegraded":"2023-06-09T04:38:15.981243+0000","last_fullsized":"2023-06-09T04:38:15.981243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065852+0000","last_change":"2023-06-09T04:38:15.632499+0000","last_active":"2023-06-09T04:38:16.065852+0000","last_peered":"2023-06-09T04:38:16.065852+0000","last_clean":"2023-06-09T04:38:16.065852+0000","last_became_active":"2023-06-09T04:38:15.632008+0000","last_became_peered":"2023-06-09T04:38:15.632008+0000","last_unstale":"2023-06-09T04:38:16.065852+0000","last_undegraded":"2023-06-09T04:38:16.065852+0000","last_fullsized":"2023-06-09T04:38:16.065852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561498+0000","last_change":"2023-06-09T04:38:11.200945+0000","last_active":"2023-06-09T04:38:16.561498+0000","last_peered":"2023-06-09T04:38:16.561498+0000","last_clean":"2023-06-09T04:38:16.561498+0000","last_became_active":"2023-06-09T04:38:11.200288+0000","last_became_peered":"2023-06-09T04:38:11.200288+0000","last_unstale":"2023-06-09T04:38:16.561498+0000","last_undegraded":"2023-06-09T04:38:16.561498+0000","last_fullsized":"2023-06-09T04:38:16.561498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:50.406974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560072+0000","last_change":"2023-06-09T04:38:11.585715+0000","last_active":"2023-06-09T04:38:16.560072+0000","last_peered":"2023-06-09T04:38:16.560072+0000","last_clean":"2023-06-09T04:38:16.560072+0000","last_became_active":"2023-06-09T04:38:11.584957+0000","last_became_peered":"2023-06-09T04:38:11.584957+0000","last_unstale":"2023-06-09T04:38:16.560072+0000","last_undegraded":"2023-06-09T04:38:16.560072+0000","last_fullsized":"2023-06-09T04:38:16.560072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:37:29.621473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981971+0000","last_change":"2023-06-09T04:38:15.637942+0000","last_active":"2023-06-09T04:38:15.981971+0000","last_peered":"2023-06-09T04:38:15.981971+0000","last_clean":"2023-06-09T04:38:15.981971+0000","last_became_active":"2023-06-09T04:38:15.637496+0000","last_became_peered":"2023-06-09T04:38:15.637496+0000","last_unstale":"2023-06-09T04:38:15.981971+0000","last_undegraded":"2023-06-09T04:38:15.981971+0000","last_fullsized":"2023-06-09T04:38:15.981971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:34.351945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559952+0000","last_change":"2023-06-09T04:38:11.185664+0000","last_active":"2023-06-09T04:38:16.559952+0000","last_peered":"2023-06-09T04:38:16.559952+0000","last_clean":"2023-06-09T04:38:16.559952+0000","last_became_active":"2023-06-09T04:38:11.185158+0000","last_became_peered":"2023-06-09T04:38:11.185158+0000","last_unstale":"2023-06-09T04:38:16.559952+0000","last_undegraded":"2023-06-09T04:38:16.559952+0000","last_fullsized":"2023-06-09T04:38:16.559952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.509050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981434+0000","last_change":"2023-06-09T04:38:11.585306+0000","last_active":"2023-06-09T04:38:15.981434+0000","last_peered":"2023-06-09T04:38:15.981434+0000","last_clean":"2023-06-09T04:38:15.981434+0000","last_became_active":"2023-06-09T04:38:11.584847+0000","last_became_peered":"2023-06-09T04:38:11.584847+0000","last_unstale":"2023-06-09T04:38:15.981434+0000","last_undegraded":"2023-06-09T04:38:15.981434+0000","last_fullsized":"2023-06-09T04:38:15.981434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066287+0000","last_change":"2023-06-09T04:38:15.622777+0000","last_active":"2023-06-09T04:38:16.066287+0000","last_peered":"2023-06-09T04:38:16.066287+0000","last_clean":"2023-06-09T04:38:16.066287+0000","last_became_active":"2023-06-09T04:38:15.622311+0000","last_became_peered":"2023-06-09T04:38:15.622311+0000","last_unstale":"2023-06-09T04:38:16.066287+0000","last_undegraded":"2023-06-09T04:38:16.066287+0000","last_fullsized":"2023-06-09T04:38:16.066287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:54.359850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066456+0000","last_change":"2023-06-09T04:38:11.189358+0000","last_active":"2023-06-09T04:38:16.066456+0000","last_peered":"2023-06-09T04:38:16.066456+0000","last_clean":"2023-06-09T04:38:16.066456+0000","last_became_active":"2023-06-09T04:38:11.188357+0000","last_became_peered":"2023-06-09T04:38:11.188357+0000","last_unstale":"2023-06-09T04:38:16.066456+0000","last_undegraded":"2023-06-09T04:38:16.066456+0000","last_fullsized":"2023-06-09T04:38:16.066456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:16.955337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982469+0000","last_change":"2023-06-09T04:38:11.579687+0000","last_active":"2023-06-09T04:38:15.982469+0000","last_peered":"2023-06-09T04:38:15.982469+0000","last_clean":"2023-06-09T04:38:15.982469+0000","last_became_active":"2023-06-09T04:38:11.579135+0000","last_became_peered":"2023-06-09T04:38:11.579135+0000","last_unstale":"2023-06-09T04:38:15.982469+0000","last_undegraded":"2023-06-09T04:38:15.982469+0000","last_fullsized":"2023-06-09T04:38:15.982469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:37.416450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986093+0000","last_change":"2023-06-09T04:38:15.652067+0000","last_active":"2023-06-09T04:38:15.986093+0000","last_peered":"2023-06-09T04:38:15.986093+0000","last_clean":"2023-06-09T04:38:15.986093+0000","last_became_active":"2023-06-09T04:38:15.651161+0000","last_became_peered":"2023-06-09T04:38:15.651161+0000","last_unstale":"2023-06-09T04:38:15.986093+0000","last_undegraded":"2023-06-09T04:38:15.986093+0000","last_fullsized":"2023-06-09T04:38:15.986093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:21.927575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985609+0000","last_change":"2023-06-09T04:38:11.180066+0000","last_active":"2023-06-09T04:38:15.985609+0000","last_peered":"2023-06-09T04:38:15.985609+0000","last_clean":"2023-06-09T04:38:15.985609+0000","last_became_active":"2023-06-09T04:38:11.179266+0000","last_became_peered":"2023-06-09T04:38:11.179266+0000","last_unstale":"2023-06-09T04:38:15.985609+0000","last_undegraded":"2023-06-09T04:38:15.985609+0000","last_fullsized":"2023-06-09T04:38:15.985609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:07.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986230+0000","last_change":"2023-06-09T04:38:11.594680+0000","last_active":"2023-06-09T04:38:15.986230+0000","last_peered":"2023-06-09T04:38:15.986230+0000","last_clean":"2023-06-09T04:38:15.986230+0000","last_became_active":"2023-06-09T04:38:11.594276+0000","last_became_peered":"2023-06-09T04:38:11.594276+0000","last_unstale":"2023-06-09T04:38:15.986230+0000","last_undegraded":"2023-06-09T04:38:15.986230+0000","last_fullsized":"2023-06-09T04:38:15.986230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:52.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981838+0000","last_change":"2023-06-09T04:38:15.648101+0000","last_active":"2023-06-09T04:38:15.981838+0000","last_peered":"2023-06-09T04:38:15.981838+0000","last_clean":"2023-06-09T04:38:15.981838+0000","last_became_active":"2023-06-09T04:38:15.647608+0000","last_became_peered":"2023-06-09T04:38:15.647608+0000","last_unstale":"2023-06-09T04:38:15.981838+0000","last_undegraded":"2023-06-09T04:38:15.981838+0000","last_fullsized":"2023-06-09T04:38:15.981838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066410+0000","last_change":"2023-06-09T04:38:11.201960+0000","last_active":"2023-06-09T04:38:16.066410+0000","last_peered":"2023-06-09T04:38:16.066410+0000","last_clean":"2023-06-09T04:38:16.066410+0000","last_became_active":"2023-06-09T04:38:11.201646+0000","last_became_peered":"2023-06-09T04:38:11.201646+0000","last_unstale":"2023-06-09T04:38:16.066410+0000","last_undegraded":"2023-06-09T04:38:16.066410+0000","last_fullsized":"2023-06-09T04:38:16.066410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:36.403064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559845+0000","last_change":"2023-06-09T04:38:11.594028+0000","last_active":"2023-06-09T04:38:16.559845+0000","last_peered":"2023-06-09T04:38:16.559845+0000","last_clean":"2023-06-09T04:38:16.559845+0000","last_became_active":"2023-06-09T04:38:11.593476+0000","last_became_peered":"2023-06-09T04:38:11.593476+0000","last_unstale":"2023-06-09T04:38:16.559845+0000","last_undegraded":"2023-06-09T04:38:16.559845+0000","last_fullsized":"2023-06-09T04:38:16.559845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:03:31.188379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982272+0000","last_change":"2023-06-09T04:38:15.639036+0000","last_active":"2023-06-09T04:38:15.982272+0000","last_peered":"2023-06-09T04:38:15.982272+0000","last_clean":"2023-06-09T04:38:15.982272+0000","last_became_active":"2023-06-09T04:38:15.638526+0000","last_became_peered":"2023-06-09T04:38:15.638526+0000","last_unstale":"2023-06-09T04:38:15.982272+0000","last_undegraded":"2023-06-09T04:38:15.982272+0000","last_fullsized":"2023-06-09T04:38:15.982272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:01.380927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986379+0000","last_change":"2023-06-09T04:38:11.206571+0000","last_active":"2023-06-09T04:38:15.986379+0000","last_peered":"2023-06-09T04:38:15.986379+0000","last_clean":"2023-06-09T04:38:15.986379+0000","last_became_active":"2023-06-09T04:38:11.205967+0000","last_became_peered":"2023-06-09T04:38:11.205967+0000","last_unstale":"2023-06-09T04:38:15.986379+0000","last_undegraded":"2023-06-09T04:38:15.986379+0000","last_fullsized":"2023-06-09T04:38:15.986379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.580093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984552+0000","last_change":"2023-06-09T04:38:11.591665+0000","last_active":"2023-06-09T04:38:15.984552+0000","last_peered":"2023-06-09T04:38:15.984552+0000","last_clean":"2023-06-09T04:38:15.984552+0000","last_became_active":"2023-06-09T04:38:11.591215+0000","last_became_peered":"2023-06-09T04:38:11.591215+0000","last_unstale":"2023-06-09T04:38:15.984552+0000","last_undegraded":"2023-06-09T04:38:15.984552+0000","last_fullsized":"2023-06-09T04:38:15.984552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:05.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985492+0000","last_change":"2023-06-09T04:38:15.645060+0000","last_active":"2023-06-09T04:38:15.985492+0000","last_peered":"2023-06-09T04:38:15.985492+0000","last_clean":"2023-06-09T04:38:15.985492+0000","last_became_active":"2023-06-09T04:38:15.644019+0000","last_became_peered":"2023-06-09T04:38:15.644019+0000","last_unstale":"2023-06-09T04:38:15.985492+0000","last_undegraded":"2023-06-09T04:38:15.985492+0000","last_fullsized":"2023-06-09T04:38:15.985492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559446+0000","last_change":"2023-06-09T04:38:11.195096+0000","last_active":"2023-06-09T04:38:16.559446+0000","last_peered":"2023-06-09T04:38:16.559446+0000","last_clean":"2023-06-09T04:38:16.559446+0000","last_became_active":"2023-06-09T04:38:11.193967+0000","last_became_peered":"2023-06-09T04:38:11.193967+0000","last_unstale":"2023-06-09T04:38:16.559446+0000","last_undegraded":"2023-06-09T04:38:16.559446+0000","last_fullsized":"2023-06-09T04:38:16.559446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:31:01.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560496+0000","last_change":"2023-06-09T04:38:11.598907+0000","last_active":"2023-06-09T04:38:16.560496+0000","last_peered":"2023-06-09T04:38:16.560496+0000","last_clean":"2023-06-09T04:38:16.560496+0000","last_became_active":"2023-06-09T04:38:11.598448+0000","last_became_peered":"2023-06-09T04:38:11.598448+0000","last_unstale":"2023-06-09T04:38:16.560496+0000","last_undegraded":"2023-06-09T04:38:16.560496+0000","last_fullsized":"2023-06-09T04:38:16.560496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:15:01.066687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559038+0000","last_change":"2023-06-09T04:38:11.584299+0000","last_active":"2023-06-09T04:38:16.559038+0000","last_peered":"2023-06-09T04:38:16.559038+0000","last_clean":"2023-06-09T04:38:16.559038+0000","last_became_active":"2023-06-09T04:38:11.584067+0000","last_became_peered":"2023-06-09T04:38:11.584067+0000","last_unstale":"2023-06-09T04:38:16.559038+0000","last_undegraded":"2023-06-09T04:38:16.559038+0000","last_fullsized":"2023-06-09T04:38:16.559038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:49:59.751085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.562107+0000","last_change":"2023-06-09T04:38:11.202669+0000","last_active":"2023-06-09T04:38:16.562107+0000","last_peered":"2023-06-09T04:38:16.562107+0000","last_clean":"2023-06-09T04:38:16.562107+0000","last_became_active":"2023-06-09T04:38:11.201665+0000","last_became_peered":"2023-06-09T04:38:11.201665+0000","last_unstale":"2023-06-09T04:38:16.562107+0000","last_undegraded":"2023-06-09T04:38:16.562107+0000","last_fullsized":"2023-06-09T04:38:16.562107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:40.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559172+0000","last_change":"2023-06-09T04:38:15.638570+0000","last_active":"2023-06-09T04:38:16.559172+0000","last_peered":"2023-06-09T04:38:16.559172+0000","last_clean":"2023-06-09T04:38:16.559172+0000","last_became_active":"2023-06-09T04:38:15.638066+0000","last_became_peered":"2023-06-09T04:38:15.638066+0000","last_unstale":"2023-06-09T04:38:16.559172+0000","last_undegraded":"2023-06-09T04:38:16.559172+0000","last_fullsized":"2023-06-09T04:38:16.559172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:55.971330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986040+0000","last_change":"2023-06-09T04:38:11.591894+0000","last_active":"2023-06-09T04:38:15.986040+0000","last_peered":"2023-06-09T04:38:15.986040+0000","last_clean":"2023-06-09T04:38:15.986040+0000","last_became_active":"2023-06-09T04:38:11.590872+0000","last_became_peered":"2023-06-09T04:38:11.590872+0000","last_unstale":"2023-06-09T04:38:15.986040+0000","last_undegraded":"2023-06-09T04:38:15.986040+0000","last_fullsized":"2023-06-09T04:38:15.986040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:13.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982353+0000","last_change":"2023-06-09T04:38:11.173622+0000","last_active":"2023-06-09T04:38:15.982353+0000","last_peered":"2023-06-09T04:38:15.982353+0000","last_clean":"2023-06-09T04:38:15.982353+0000","last_became_active":"2023-06-09T04:38:11.173296+0000","last_became_peered":"2023-06-09T04:38:11.173296+0000","last_unstale":"2023-06-09T04:38:15.982353+0000","last_undegraded":"2023-06-09T04:38:15.982353+0000","last_fullsized":"2023-06-09T04:38:15.982353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:14.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981275+0000","last_change":"2023-06-09T04:38:15.624872+0000","last_active":"2023-06-09T04:38:15.981275+0000","last_peered":"2023-06-09T04:38:15.981275+0000","last_clean":"2023-06-09T04:38:15.981275+0000","last_became_active":"2023-06-09T04:38:15.623576+0000","last_became_peered":"2023-06-09T04:38:15.623576+0000","last_unstale":"2023-06-09T04:38:15.981275+0000","last_undegraded":"2023-06-09T04:38:15.981275+0000","last_fullsized":"2023-06-09T04:38:15.981275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:29.450913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116345+0000","last_change":"2023-06-09T04:38:11.191574+0000","last_active":"2023-06-09T04:38:16.116345+0000","last_peered":"2023-06-09T04:38:16.116345+0000","last_clean":"2023-06-09T04:38:16.116345+0000","last_became_active":"2023-06-09T04:38:11.191265+0000","last_became_peered":"2023-06-09T04:38:11.191265+0000","last_unstale":"2023-06-09T04:38:16.116345+0000","last_undegraded":"2023-06-09T04:38:16.116345+0000","last_fullsized":"2023-06-09T04:38:16.116345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:36.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983839+0000","last_change":"2023-06-09T04:38:11.602110+0000","last_active":"2023-06-09T04:38:15.983839+0000","last_peered":"2023-06-09T04:38:15.983839+0000","last_clean":"2023-06-09T04:38:15.983839+0000","last_became_active":"2023-06-09T04:38:11.601863+0000","last_became_peered":"2023-06-09T04:38:11.601863+0000","last_unstale":"2023-06-09T04:38:15.983839+0000","last_undegraded":"2023-06-09T04:38:15.983839+0000","last_fullsized":"2023-06-09T04:38:15.983839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:33.650536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983706+0000","last_change":"2023-06-09T04:38:15.652599+0000","last_active":"2023-06-09T04:38:15.983706+0000","last_peered":"2023-06-09T04:38:15.983706+0000","last_clean":"2023-06-09T04:38:15.983706+0000","last_became_active":"2023-06-09T04:38:15.651894+0000","last_became_peered":"2023-06-09T04:38:15.651894+0000","last_unstale":"2023-06-09T04:38:15.983706+0000","last_undegraded":"2023-06-09T04:38:15.983706+0000","last_fullsized":"2023-06-09T04:38:15.983706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:39:05.473086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:21.329783+0000","last_change":"2023-06-09T04:38:11.178844+0000","last_active":"2023-06-09T04:38:21.329783+0000","last_peered":"2023-06-09T04:38:21.329783+0000","last_clean":"2023-06-09T04:38:21.329783+0000","last_became_active":"2023-06-09T04:38:11.178527+0000","last_became_peered":"2023-06-09T04:38:11.178527+0000","last_unstale":"2023-06-09T04:38:21.329783+0000","last_undegraded":"2023-06-09T04:38:21.329783+0000","last_fullsized":"2023-06-09T04:38:21.329783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:38.682351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982266+0000","last_change":"2023-06-09T04:38:11.590873+0000","last_active":"2023-06-09T04:38:15.982266+0000","last_peered":"2023-06-09T04:38:15.982266+0000","last_clean":"2023-06-09T04:38:15.982266+0000","last_became_active":"2023-06-09T04:38:11.590341+0000","last_became_peered":"2023-06-09T04:38:11.590341+0000","last_unstale":"2023-06-09T04:38:15.982266+0000","last_undegraded":"2023-06-09T04:38:15.982266+0000","last_fullsized":"2023-06-09T04:38:15.982266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982961+0000","last_change":"2023-06-09T04:38:15.641224+0000","last_active":"2023-06-09T04:38:15.982961+0000","last_peered":"2023-06-09T04:38:15.982961+0000","last_clean":"2023-06-09T04:38:15.982961+0000","last_became_active":"2023-06-09T04:38:15.630567+0000","last_became_peered":"2023-06-09T04:38:15.630567+0000","last_unstale":"2023-06-09T04:38:15.982961+0000","last_undegraded":"2023-06-09T04:38:15.982961+0000","last_fullsized":"2023-06-09T04:38:15.982961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:33.133686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981808+0000","last_change":"2023-06-09T04:38:11.591047+0000","last_active":"2023-06-09T04:38:15.981808+0000","last_peered":"2023-06-09T04:38:15.981808+0000","last_clean":"2023-06-09T04:38:15.981808+0000","last_became_active":"2023-06-09T04:38:11.590710+0000","last_became_peered":"2023-06-09T04:38:11.590710+0000","last_unstale":"2023-06-09T04:38:15.981808+0000","last_undegraded":"2023-06-09T04:38:15.981808+0000","last_fullsized":"2023-06-09T04:38:15.981808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561003+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:38:16.561003+0000","last_peered":"2023-06-09T04:38:16.561003+0000","last_clean":"2023-06-09T04:38:16.561003+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:38:16.561003+0000","last_undegraded":"2023-06-09T04:38:16.561003+0000","last_fullsized":"2023-06-09T04:38:16.561003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:56:41.217550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984485+0000","last_change":"2023-06-09T04:38:11.206839+0000","last_active":"2023-06-09T04:38:15.984485+0000","last_peered":"2023-06-09T04:38:15.984485+0000","last_clean":"2023-06-09T04:38:15.984485+0000","last_became_active":"2023-06-09T04:38:11.206136+0000","last_became_peered":"2023-06-09T04:38:11.206136+0000","last_unstale":"2023-06-09T04:38:15.984485+0000","last_undegraded":"2023-06-09T04:38:15.984485+0000","last_fullsized":"2023-06-09T04:38:15.984485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:00:59.250719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983799+0000","last_change":"2023-06-09T04:38:15.654768+0000","last_active":"2023-06-09T04:38:15.983799+0000","last_peered":"2023-06-09T04:38:15.983799+0000","last_clean":"2023-06-09T04:38:15.983799+0000","last_became_active":"2023-06-09T04:38:15.653848+0000","last_became_peered":"2023-06-09T04:38:15.653848+0000","last_unstale":"2023-06-09T04:38:15.983799+0000","last_undegraded":"2023-06-09T04:38:15.983799+0000","last_fullsized":"2023-06-09T04:38:15.983799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:35:20.247138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984327+0000","last_change":"2023-06-09T04:38:11.576946+0000","last_active":"2023-06-09T04:38:15.984327+0000","last_peered":"2023-06-09T04:38:15.984327+0000","last_clean":"2023-06-09T04:38:15.984327+0000","last_became_active":"2023-06-09T04:38:11.576234+0000","last_became_peered":"2023-06-09T04:38:11.576234+0000","last_unstale":"2023-06-09T04:38:15.984327+0000","last_undegraded":"2023-06-09T04:38:15.984327+0000","last_fullsized":"2023-06-09T04:38:15.984327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:09:39.247053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986402+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:38:15.986402+0000","last_peered":"2023-06-09T04:38:15.986402+0000","last_clean":"2023-06-09T04:38:15.986402+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:38:15.986402+0000","last_undegraded":"2023-06-09T04:38:15.986402+0000","last_fullsized":"2023-06-09T04:38:15.986402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:17.380871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985503+0000","last_change":"2023-06-09T04:38:11.207993+0000","last_active":"2023-06-09T04:38:15.985503+0000","last_peered":"2023-06-09T04:38:15.985503+0000","last_clean":"2023-06-09T04:38:15.985503+0000","last_became_active":"2023-06-09T04:38:11.207375+0000","last_became_peered":"2023-06-09T04:38:11.207375+0000","last_unstale":"2023-06-09T04:38:15.985503+0000","last_undegraded":"2023-06-09T04:38:15.985503+0000","last_fullsized":"2023-06-09T04:38:15.985503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:58.163202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559365+0000","last_change":"2023-06-09T04:38:15.629330+0000","last_active":"2023-06-09T04:38:16.559365+0000","last_peered":"2023-06-09T04:38:16.559365+0000","last_clean":"2023-06-09T04:38:16.559365+0000","last_became_active":"2023-06-09T04:38:15.628803+0000","last_became_peered":"2023-06-09T04:38:15.628803+0000","last_unstale":"2023-06-09T04:38:16.559365+0000","last_undegraded":"2023-06-09T04:38:16.559365+0000","last_fullsized":"2023-06-09T04:38:16.559365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:25.965238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985856+0000","last_change":"2023-06-09T04:38:11.582531+0000","last_active":"2023-06-09T04:38:15.985856+0000","last_peered":"2023-06-09T04:38:15.985856+0000","last_clean":"2023-06-09T04:38:15.985856+0000","last_became_active":"2023-06-09T04:38:11.581963+0000","last_became_peered":"2023-06-09T04:38:11.581963+0000","last_unstale":"2023-06-09T04:38:15.985856+0000","last_undegraded":"2023-06-09T04:38:15.985856+0000","last_fullsized":"2023-06-09T04:38:15.985856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560988+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:38:16.560988+0000","last_peered":"2023-06-09T04:38:16.560988+0000","last_clean":"2023-06-09T04:38:16.560988+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:38:16.560988+0000","last_undegraded":"2023-06-09T04:38:16.560988+0000","last_fullsized":"2023-06-09T04:38:16.560988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:08.570686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984867+0000","last_change":"2023-06-09T04:38:11.203569+0000","last_active":"2023-06-09T04:38:15.984867+0000","last_peered":"2023-06-09T04:38:15.984867+0000","last_clean":"2023-06-09T04:38:15.984867+0000","last_became_active":"2023-06-09T04:38:11.202787+0000","last_became_peered":"2023-06-09T04:38:11.202787+0000","last_unstale":"2023-06-09T04:38:15.984867+0000","last_undegraded":"2023-06-09T04:38:15.984867+0000","last_fullsized":"2023-06-09T04:38:15.984867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:57.391865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115733+0000","last_change":"2023-06-09T04:38:15.638680+0000","last_active":"2023-06-09T04:38:16.115733+0000","last_peered":"2023-06-09T04:38:16.115733+0000","last_clean":"2023-06-09T04:38:16.115733+0000","last_became_active":"2023-06-09T04:38:15.638219+0000","last_became_peered":"2023-06-09T04:38:15.638219+0000","last_unstale":"2023-06-09T04:38:16.115733+0000","last_undegraded":"2023-06-09T04:38:16.115733+0000","last_fullsized":"2023-06-09T04:38:16.115733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:36.541614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983149+0000","last_change":"2023-06-09T04:38:11.589753+0000","last_active":"2023-06-09T04:38:15.983149+0000","last_peered":"2023-06-09T04:38:15.983149+0000","last_clean":"2023-06-09T04:38:15.983149+0000","last_became_active":"2023-06-09T04:38:11.589289+0000","last_became_peered":"2023-06-09T04:38:11.589289+0000","last_unstale":"2023-06-09T04:38:15.983149+0000","last_undegraded":"2023-06-09T04:38:15.983149+0000","last_fullsized":"2023-06-09T04:38:15.983149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.797205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560927+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:38:16.560927+0000","last_peered":"2023-06-09T04:38:16.560927+0000","last_clean":"2023-06-09T04:38:16.560927+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:38:16.560927+0000","last_undegraded":"2023-06-09T04:38:16.560927+0000","last_fullsized":"2023-06-09T04:38:16.560927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:48.345845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981929+0000","last_change":"2023-06-09T04:38:11.191786+0000","last_active":"2023-06-09T04:38:15.981929+0000","last_peered":"2023-06-09T04:38:15.981929+0000","last_clean":"2023-06-09T04:38:15.981929+0000","last_became_active":"2023-06-09T04:38:11.191379+0000","last_became_peered":"2023-06-09T04:38:11.191379+0000","last_unstale":"2023-06-09T04:38:15.981929+0000","last_undegraded":"2023-06-09T04:38:15.981929+0000","last_fullsized":"2023-06-09T04:38:15.981929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984276+0000","last_change":"2023-06-09T04:38:15.652331+0000","last_active":"2023-06-09T04:38:15.984276+0000","last_peered":"2023-06-09T04:38:15.984276+0000","last_clean":"2023-06-09T04:38:15.984276+0000","last_became_active":"2023-06-09T04:38:15.651379+0000","last_became_peered":"2023-06-09T04:38:15.651379+0000","last_unstale":"2023-06-09T04:38:15.984276+0000","last_undegraded":"2023-06-09T04:38:15.984276+0000","last_fullsized":"2023-06-09T04:38:15.984276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:23.892869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984378+0000","last_change":"2023-06-09T04:38:11.581677+0000","last_active":"2023-06-09T04:38:15.984378+0000","last_peered":"2023-06-09T04:38:15.984378+0000","last_clean":"2023-06-09T04:38:15.984378+0000","last_became_active":"2023-06-09T04:38:11.580936+0000","last_became_peered":"2023-06-09T04:38:11.580936+0000","last_unstale":"2023-06-09T04:38:15.984378+0000","last_undegraded":"2023-06-09T04:38:15.984378+0000","last_fullsized":"2023-06-09T04:38:15.984378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115946+0000","last_change":"2023-06-09T04:38:11.182996+0000","last_active":"2023-06-09T04:38:16.115946+0000","last_peered":"2023-06-09T04:38:16.115946+0000","last_clean":"2023-06-09T04:38:16.115946+0000","last_became_active":"2023-06-09T04:38:11.182625+0000","last_became_peered":"2023-06-09T04:38:11.182625+0000","last_unstale":"2023-06-09T04:38:16.115946+0000","last_undegraded":"2023-06-09T04:38:16.115946+0000","last_fullsized":"2023-06-09T04:38:16.115946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:18.783819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560422+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:38:16.560422+0000","last_peered":"2023-06-09T04:38:16.560422+0000","last_clean":"2023-06-09T04:38:16.560422+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:38:16.560422+0000","last_undegraded":"2023-06-09T04:38:16.560422+0000","last_fullsized":"2023-06-09T04:38:16.560422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:23:30.684840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559603+0000","last_change":"2023-06-09T04:38:15.645663+0000","last_active":"2023-06-09T04:38:16.559603+0000","last_peered":"2023-06-09T04:38:16.559603+0000","last_clean":"2023-06-09T04:38:16.559603+0000","last_became_active":"2023-06-09T04:38:15.644922+0000","last_became_peered":"2023-06-09T04:38:15.644922+0000","last_unstale":"2023-06-09T04:38:16.559603+0000","last_undegraded":"2023-06-09T04:38:16.559603+0000","last_fullsized":"2023-06-09T04:38:16.559603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:58:02.310074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985956+0000","last_change":"2023-06-09T04:38:11.581442+0000","last_active":"2023-06-09T04:38:15.985956+0000","last_peered":"2023-06-09T04:38:15.985956+0000","last_clean":"2023-06-09T04:38:15.985956+0000","last_became_active":"2023-06-09T04:38:11.580940+0000","last_became_peered":"2023-06-09T04:38:11.580940+0000","last_unstale":"2023-06-09T04:38:15.985956+0000","last_undegraded":"2023-06-09T04:38:15.985956+0000","last_fullsized":"2023-06-09T04:38:15.985956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.557750+0000","last_change":"2023-06-09T04:38:11.201284+0000","last_active":"2023-06-09T04:38:16.557750+0000","last_peered":"2023-06-09T04:38:16.557750+0000","last_clean":"2023-06-09T04:38:16.557750+0000","last_became_active":"2023-06-09T04:38:11.200454+0000","last_became_peered":"2023-06-09T04:38:11.200454+0000","last_unstale":"2023-06-09T04:38:16.557750+0000","last_undegraded":"2023-06-09T04:38:16.557750+0000","last_fullsized":"2023-06-09T04:38:16.557750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:53.244123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559796+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:38:16.559796+0000","last_peered":"2023-06-09T04:38:16.559796+0000","last_clean":"2023-06-09T04:38:16.559796+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:38:16.559796+0000","last_undegraded":"2023-06-09T04:38:16.559796+0000","last_fullsized":"2023-06-09T04:38:16.559796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:35:18.640660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559491+0000","last_change":"2023-06-09T04:38:15.644559+0000","last_active":"2023-06-09T04:38:16.559491+0000","last_peered":"2023-06-09T04:38:16.559491+0000","last_clean":"2023-06-09T04:38:16.559491+0000","last_became_active":"2023-06-09T04:38:15.643793+0000","last_became_peered":"2023-06-09T04:38:15.643793+0000","last_unstale":"2023-06-09T04:38:16.559491+0000","last_undegraded":"2023-06-09T04:38:16.559491+0000","last_fullsized":"2023-06-09T04:38:16.559491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:27.198186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561351+0000","last_change":"2023-06-09T04:38:11.582052+0000","last_active":"2023-06-09T04:38:16.561351+0000","last_peered":"2023-06-09T04:38:16.561351+0000","last_clean":"2023-06-09T04:38:16.561351+0000","last_became_active":"2023-06-09T04:38:11.581569+0000","last_became_peered":"2023-06-09T04:38:11.581569+0000","last_unstale":"2023-06-09T04:38:16.561351+0000","last_undegraded":"2023-06-09T04:38:16.561351+0000","last_fullsized":"2023-06-09T04:38:16.561351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:27:07.420266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983212+0000","last_change":"2023-06-09T04:38:11.193727+0000","last_active":"2023-06-09T04:38:15.983212+0000","last_peered":"2023-06-09T04:38:15.983212+0000","last_clean":"2023-06-09T04:38:15.983212+0000","last_became_active":"2023-06-09T04:38:11.191671+0000","last_became_peered":"2023-06-09T04:38:11.191671+0000","last_unstale":"2023-06-09T04:38:15.983212+0000","last_undegraded":"2023-06-09T04:38:15.983212+0000","last_fullsized":"2023-06-09T04:38:15.983212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:18.631690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560388+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:38:16.560388+0000","last_peered":"2023-06-09T04:38:16.560388+0000","last_clean":"2023-06-09T04:38:16.560388+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:38:16.560388+0000","last_undegraded":"2023-06-09T04:38:16.560388+0000","last_fullsized":"2023-06-09T04:38:16.560388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:46.578064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560338+0000","last_change":"2023-06-09T04:38:15.631104+0000","last_active":"2023-06-09T04:38:16.560338+0000","last_peered":"2023-06-09T04:38:16.560338+0000","last_clean":"2023-06-09T04:38:16.560338+0000","last_became_active":"2023-06-09T04:38:15.630126+0000","last_became_peered":"2023-06-09T04:38:15.630126+0000","last_unstale":"2023-06-09T04:38:16.560338+0000","last_undegraded":"2023-06-09T04:38:16.560338+0000","last_fullsized":"2023-06-09T04:38:16.560338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:11:32.650489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560095+0000","last_change":"2023-06-09T04:38:11.609569+0000","last_active":"2023-06-09T04:38:16.560095+0000","last_peered":"2023-06-09T04:38:16.560095+0000","last_clean":"2023-06-09T04:38:16.560095+0000","last_became_active":"2023-06-09T04:38:11.608179+0000","last_became_peered":"2023-06-09T04:38:11.608179+0000","last_unstale":"2023-06-09T04:38:16.560095+0000","last_undegraded":"2023-06-09T04:38:16.560095+0000","last_fullsized":"2023-06-09T04:38:16.560095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:09:01.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984195+0000","last_change":"2023-06-09T04:38:11.180161+0000","last_active":"2023-06-09T04:38:15.984195+0000","last_peered":"2023-06-09T04:38:15.984195+0000","last_clean":"2023-06-09T04:38:15.984195+0000","last_became_active":"2023-06-09T04:38:11.179361+0000","last_became_peered":"2023-06-09T04:38:11.179361+0000","last_unstale":"2023-06-09T04:38:15.984195+0000","last_undegraded":"2023-06-09T04:38:15.984195+0000","last_fullsized":"2023-06-09T04:38:15.984195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:36:14.841594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560750+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:38:16.560750+0000","last_peered":"2023-06-09T04:38:16.560750+0000","last_clean":"2023-06-09T04:38:16.560750+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:38:16.560750+0000","last_undegraded":"2023-06-09T04:38:16.560750+0000","last_fullsized":"2023-06-09T04:38:16.560750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:05.863481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066863+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:38:16.066863+0000","last_peered":"2023-06-09T04:38:16.066863+0000","last_clean":"2023-06-09T04:38:16.066863+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:38:16.066863+0000","last_undegraded":"2023-06-09T04:38:16.066863+0000","last_fullsized":"2023-06-09T04:38:16.066863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:17.786150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116200+0000","last_change":"2023-06-09T04:38:15.648847+0000","last_active":"2023-06-09T04:38:16.116200+0000","last_peered":"2023-06-09T04:38:16.116200+0000","last_clean":"2023-06-09T04:38:16.116200+0000","last_became_active":"2023-06-09T04:38:15.648379+0000","last_became_peered":"2023-06-09T04:38:15.648379+0000","last_unstale":"2023-06-09T04:38:16.116200+0000","last_undegraded":"2023-06-09T04:38:16.116200+0000","last_fullsized":"2023-06-09T04:38:16.116200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:23.070086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559158+0000","last_change":"2023-06-09T04:38:11.599288+0000","last_active":"2023-06-09T04:38:16.559158+0000","last_peered":"2023-06-09T04:38:16.559158+0000","last_clean":"2023-06-09T04:38:16.559158+0000","last_became_active":"2023-06-09T04:38:11.598737+0000","last_became_peered":"2023-06-09T04:38:11.598737+0000","last_unstale":"2023-06-09T04:38:16.559158+0000","last_undegraded":"2023-06-09T04:38:16.559158+0000","last_fullsized":"2023-06-09T04:38:16.559158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:35.326089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986583+0000","last_change":"2023-06-09T04:38:11.191838+0000","last_active":"2023-06-09T04:38:15.986583+0000","last_peered":"2023-06-09T04:38:15.986583+0000","last_clean":"2023-06-09T04:38:15.986583+0000","last_became_active":"2023-06-09T04:38:11.191075+0000","last_became_peered":"2023-06-09T04:38:11.191075+0000","last_unstale":"2023-06-09T04:38:15.986583+0000","last_undegraded":"2023-06-09T04:38:15.986583+0000","last_fullsized":"2023-06-09T04:38:15.986583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:46.284052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560839+0000","last_change":"2023-06-09T04:38:15.613910+0000","last_active":"2023-06-09T04:38:16.560839+0000","last_peered":"2023-06-09T04:38:16.560839+0000","last_clean":"2023-06-09T04:38:16.560839+0000","last_became_active":"2023-06-09T04:38:15.613324+0000","last_became_peered":"2023-06-09T04:38:15.613324+0000","last_unstale":"2023-06-09T04:38:16.560839+0000","last_undegraded":"2023-06-09T04:38:16.560839+0000","last_fullsized":"2023-06-09T04:38:16.560839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:37:53.617189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982270+0000","last_change":"2023-06-09T04:38:11.565137+0000","last_active":"2023-06-09T04:38:15.982270+0000","last_peered":"2023-06-09T04:38:15.982270+0000","last_clean":"2023-06-09T04:38:15.982270+0000","last_became_active":"2023-06-09T04:38:11.564885+0000","last_became_peered":"2023-06-09T04:38:11.564885+0000","last_unstale":"2023-06-09T04:38:15.982270+0000","last_undegraded":"2023-06-09T04:38:15.982270+0000","last_fullsized":"2023-06-09T04:38:15.982270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:50.934840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560844+0000","last_change":"2023-06-09T04:38:11.210525+0000","last_active":"2023-06-09T04:38:16.560844+0000","last_peered":"2023-06-09T04:38:16.560844+0000","last_clean":"2023-06-09T04:38:16.560844+0000","last_became_active":"2023-06-09T04:38:11.210047+0000","last_became_peered":"2023-06-09T04:38:11.210047+0000","last_unstale":"2023-06-09T04:38:16.560844+0000","last_undegraded":"2023-06-09T04:38:16.560844+0000","last_fullsized":"2023-06-09T04:38:16.560844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:57.325527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066485+0000","last_change":"2023-06-09T04:38:15.616243+0000","last_active":"2023-06-09T04:38:16.066485+0000","last_peered":"2023-06-09T04:38:16.066485+0000","last_clean":"2023-06-09T04:38:16.066485+0000","last_became_active":"2023-06-09T04:38:15.615680+0000","last_became_peered":"2023-06-09T04:38:15.615680+0000","last_unstale":"2023-06-09T04:38:16.066485+0000","last_undegraded":"2023-06-09T04:38:16.066485+0000","last_fullsized":"2023-06-09T04:38:16.066485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:48.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559686+0000","last_change":"2023-06-09T04:38:11.609943+0000","last_active":"2023-06-09T04:38:16.559686+0000","last_peered":"2023-06-09T04:38:16.559686+0000","last_clean":"2023-06-09T04:38:16.559686+0000","last_became_active":"2023-06-09T04:38:11.608810+0000","last_became_peered":"2023-06-09T04:38:11.608810+0000","last_unstale":"2023-06-09T04:38:16.559686+0000","last_undegraded":"2023-06-09T04:38:16.559686+0000","last_fullsized":"2023-06-09T04:38:16.559686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:54:36.052953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560271+0000","last_change":"2023-06-09T04:38:11.173638+0000","last_active":"2023-06-09T04:38:16.560271+0000","last_peered":"2023-06-09T04:38:16.560271+0000","last_clean":"2023-06-09T04:38:16.560271+0000","last_became_active":"2023-06-09T04:38:11.173388+0000","last_became_peered":"2023-06-09T04:38:11.173388+0000","last_unstale":"2023-06-09T04:38:16.560271+0000","last_undegraded":"2023-06-09T04:38:16.560271+0000","last_fullsized":"2023-06-09T04:38:16.560271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:51:29.591833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560504+0000","last_change":"2023-06-09T04:38:15.614814+0000","last_active":"2023-06-09T04:38:16.560504+0000","last_peered":"2023-06-09T04:38:16.560504+0000","last_clean":"2023-06-09T04:38:16.560504+0000","last_became_active":"2023-06-09T04:38:15.613623+0000","last_became_peered":"2023-06-09T04:38:15.613623+0000","last_unstale":"2023-06-09T04:38:16.560504+0000","last_undegraded":"2023-06-09T04:38:16.560504+0000","last_fullsized":"2023-06-09T04:38:16.560504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:48:43.207948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116961+0000","last_change":"2023-06-09T04:38:11.596789+0000","last_active":"2023-06-09T04:38:16.116961+0000","last_peered":"2023-06-09T04:38:16.116961+0000","last_clean":"2023-06-09T04:38:16.116961+0000","last_became_active":"2023-06-09T04:38:11.596416+0000","last_became_peered":"2023-06-09T04:38:11.596416+0000","last_unstale":"2023-06-09T04:38:16.116961+0000","last_undegraded":"2023-06-09T04:38:16.116961+0000","last_fullsized":"2023-06-09T04:38:16.116961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558934+0000","last_change":"2023-06-09T04:38:11.199156+0000","last_active":"2023-06-09T04:38:16.558934+0000","last_peered":"2023-06-09T04:38:16.558934+0000","last_clean":"2023-06-09T04:38:16.558934+0000","last_became_active":"2023-06-09T04:38:11.198208+0000","last_became_peered":"2023-06-09T04:38:11.198208+0000","last_unstale":"2023-06-09T04:38:16.558934+0000","last_undegraded":"2023-06-09T04:38:16.558934+0000","last_fullsized":"2023-06-09T04:38:16.558934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:02.979372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559203+0000","last_change":"2023-06-09T04:38:15.644288+0000","last_active":"2023-06-09T04:38:16.559203+0000","last_peered":"2023-06-09T04:38:16.559203+0000","last_clean":"2023-06-09T04:38:16.559203+0000","last_became_active":"2023-06-09T04:38:15.643538+0000","last_became_peered":"2023-06-09T04:38:15.643538+0000","last_unstale":"2023-06-09T04:38:16.559203+0000","last_undegraded":"2023-06-09T04:38:16.559203+0000","last_fullsized":"2023-06-09T04:38:16.559203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:33:30.456054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560700+0000","last_change":"2023-06-09T04:38:11.596225+0000","last_active":"2023-06-09T04:38:16.560700+0000","last_peered":"2023-06-09T04:38:16.560700+0000","last_clean":"2023-06-09T04:38:16.560700+0000","last_became_active":"2023-06-09T04:38:11.595908+0000","last_became_peered":"2023-06-09T04:38:11.595908+0000","last_unstale":"2023-06-09T04:38:16.560700+0000","last_undegraded":"2023-06-09T04:38:16.560700+0000","last_fullsized":"2023-06-09T04:38:16.560700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:22:22.632206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.117460+0000","last_change":"2023-06-09T04:38:11.192489+0000","last_active":"2023-06-09T04:38:16.117460+0000","last_peered":"2023-06-09T04:38:16.117460+0000","last_clean":"2023-06-09T04:38:16.117460+0000","last_became_active":"2023-06-09T04:38:11.191911+0000","last_became_peered":"2023-06-09T04:38:11.191911+0000","last_unstale":"2023-06-09T04:38:16.117460+0000","last_undegraded":"2023-06-09T04:38:16.117460+0000","last_fullsized":"2023-06-09T04:38:16.117460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983119+0000","last_change":"2023-06-09T04:38:15.644054+0000","last_active":"2023-06-09T04:38:15.983119+0000","last_peered":"2023-06-09T04:38:15.983119+0000","last_clean":"2023-06-09T04:38:15.983119+0000","last_became_active":"2023-06-09T04:38:15.643226+0000","last_became_peered":"2023-06-09T04:38:15.643226+0000","last_unstale":"2023-06-09T04:38:15.983119+0000","last_undegraded":"2023-06-09T04:38:15.983119+0000","last_fullsized":"2023-06-09T04:38:15.983119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:08.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981525+0000","last_change":"2023-06-09T04:38:11.591783+0000","last_active":"2023-06-09T04:38:15.981525+0000","last_peered":"2023-06-09T04:38:15.981525+0000","last_clean":"2023-06-09T04:38:15.981525+0000","last_became_active":"2023-06-09T04:38:11.591359+0000","last_became_peered":"2023-06-09T04:38:11.591359+0000","last_unstale":"2023-06-09T04:38:15.981525+0000","last_undegraded":"2023-06-09T04:38:15.981525+0000","last_fullsized":"2023-06-09T04:38:15.981525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560729+0000","last_change":"2023-06-09T04:38:11.185014+0000","last_active":"2023-06-09T04:38:16.560729+0000","last_peered":"2023-06-09T04:38:16.560729+0000","last_clean":"2023-06-09T04:38:16.560729+0000","last_became_active":"2023-06-09T04:38:11.184569+0000","last_became_peered":"2023-06-09T04:38:11.184569+0000","last_unstale":"2023-06-09T04:38:16.560729+0000","last_undegraded":"2023-06-09T04:38:16.560729+0000","last_fullsized":"2023-06-09T04:38:16.560729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:02.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558082+0000","last_change":"2023-06-09T04:38:15.629791+0000","last_active":"2023-06-09T04:38:16.558082+0000","last_peered":"2023-06-09T04:38:16.558082+0000","last_clean":"2023-06-09T04:38:16.558082+0000","last_became_active":"2023-06-09T04:38:15.628267+0000","last_became_peered":"2023-06-09T04:38:15.628267+0000","last_unstale":"2023-06-09T04:38:16.558082+0000","last_undegraded":"2023-06-09T04:38:16.558082+0000","last_fullsized":"2023-06-09T04:38:16.558082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:56.733282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065867+0000","last_change":"2023-06-09T04:38:11.580119+0000","last_active":"2023-06-09T04:38:16.065867+0000","last_peered":"2023-06-09T04:38:16.065867+0000","last_clean":"2023-06-09T04:38:16.065867+0000","last_became_active":"2023-06-09T04:38:11.579683+0000","last_became_peered":"2023-06-09T04:38:11.579683+0000","last_unstale":"2023-06-09T04:38:16.065867+0000","last_undegraded":"2023-06-09T04:38:16.065867+0000","last_fullsized":"2023-06-09T04:38:16.065867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982464+0000","last_change":"2023-06-09T04:38:11.189768+0000","last_active":"2023-06-09T04:38:15.982464+0000","last_peered":"2023-06-09T04:38:15.982464+0000","last_clean":"2023-06-09T04:38:15.982464+0000","last_became_active":"2023-06-09T04:38:11.183589+0000","last_became_peered":"2023-06-09T04:38:11.183589+0000","last_unstale":"2023-06-09T04:38:15.982464+0000","last_undegraded":"2023-06-09T04:38:15.982464+0000","last_fullsized":"2023-06-09T04:38:15.982464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:44.537559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982754+0000","last_change":"2023-06-09T04:38:15.651304+0000","last_active":"2023-06-09T04:38:15.982754+0000","last_peered":"2023-06-09T04:38:15.982754+0000","last_clean":"2023-06-09T04:38:15.982754+0000","last_became_active":"2023-06-09T04:38:15.650429+0000","last_became_peered":"2023-06-09T04:38:15.650429+0000","last_unstale":"2023-06-09T04:38:15.982754+0000","last_undegraded":"2023-06-09T04:38:15.982754+0000","last_fullsized":"2023-06-09T04:38:15.982754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:35.270968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559138+0000","last_change":"2023-06-09T04:38:11.608450+0000","last_active":"2023-06-09T04:38:16.559138+0000","last_peered":"2023-06-09T04:38:16.559138+0000","last_clean":"2023-06-09T04:38:16.559138+0000","last_became_active":"2023-06-09T04:38:11.608016+0000","last_became_peered":"2023-06-09T04:38:11.608016+0000","last_unstale":"2023-06-09T04:38:16.559138+0000","last_undegraded":"2023-06-09T04:38:16.559138+0000","last_fullsized":"2023-06-09T04:38:16.559138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:47.297438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116600+0000","last_change":"2023-06-09T04:38:11.182774+0000","last_active":"2023-06-09T04:38:16.116600+0000","last_peered":"2023-06-09T04:38:16.116600+0000","last_clean":"2023-06-09T04:38:16.116600+0000","last_became_active":"2023-06-09T04:38:11.182454+0000","last_became_peered":"2023-06-09T04:38:11.182454+0000","last_unstale":"2023-06-09T04:38:16.116600+0000","last_undegraded":"2023-06-09T04:38:16.116600+0000","last_fullsized":"2023-06-09T04:38:16.116600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:20.644283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065961+0000","last_change":"2023-06-09T04:38:15.638696+0000","last_active":"2023-06-09T04:38:16.065961+0000","last_peered":"2023-06-09T04:38:16.065961+0000","last_clean":"2023-06-09T04:38:16.065961+0000","last_became_active":"2023-06-09T04:38:15.638021+0000","last_became_peered":"2023-06-09T04:38:15.638021+0000","last_unstale":"2023-06-09T04:38:16.065961+0000","last_undegraded":"2023-06-09T04:38:16.065961+0000","last_fullsized":"2023-06-09T04:38:16.065961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:56.518316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560437+0000","last_change":"2023-06-09T04:38:15.644394+0000","last_active":"2023-06-09T04:38:16.560437+0000","last_peered":"2023-06-09T04:38:16.560437+0000","last_clean":"2023-06-09T04:38:16.560437+0000","last_became_active":"2023-06-09T04:38:15.643951+0000","last_became_peered":"2023-06-09T04:38:15.643951+0000","last_unstale":"2023-06-09T04:38:16.560437+0000","last_undegraded":"2023-06-09T04:38:16.560437+0000","last_fullsized":"2023-06-09T04:38:16.560437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:51.630961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066744+0000","last_change":"2023-06-09T04:38:11.204035+0000","last_active":"2023-06-09T04:38:16.066744+0000","last_peered":"2023-06-09T04:38:16.066744+0000","last_clean":"2023-06-09T04:38:16.066744+0000","last_became_active":"2023-06-09T04:38:11.203724+0000","last_became_peered":"2023-06-09T04:38:11.203724+0000","last_unstale":"2023-06-09T04:38:16.066744+0000","last_undegraded":"2023-06-09T04:38:16.066744+0000","last_fullsized":"2023-06-09T04:38:16.066744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:23.339781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561757+0000","last_change":"2023-06-09T04:38:11.578687+0000","last_active":"2023-06-09T04:38:16.561757+0000","last_peered":"2023-06-09T04:38:16.561757+0000","last_clean":"2023-06-09T04:38:16.561757+0000","last_became_active":"2023-06-09T04:38:11.577901+0000","last_became_peered":"2023-06-09T04:38:11.577901+0000","last_unstale":"2023-06-09T04:38:16.561757+0000","last_undegraded":"2023-06-09T04:38:16.561757+0000","last_fullsized":"2023-06-09T04:38:16.561757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:44.239627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984075+0000","last_change":"2023-06-09T04:38:15.652937+0000","last_active":"2023-06-09T04:38:15.984075+0000","last_peered":"2023-06-09T04:38:15.984075+0000","last_clean":"2023-06-09T04:38:15.984075+0000","last_became_active":"2023-06-09T04:38:15.651857+0000","last_became_peered":"2023-06-09T04:38:15.651857+0000","last_unstale":"2023-06-09T04:38:15.984075+0000","last_undegraded":"2023-06-09T04:38:15.984075+0000","last_fullsized":"2023-06-09T04:38:15.984075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:57:40.466278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560952+0000","last_change":"2023-06-09T04:38:11.185987+0000","last_active":"2023-06-09T04:38:16.560952+0000","last_peered":"2023-06-09T04:38:16.560952+0000","last_clean":"2023-06-09T04:38:16.560952+0000","last_became_active":"2023-06-09T04:38:11.185132+0000","last_became_peered":"2023-06-09T04:38:11.185132+0000","last_unstale":"2023-06-09T04:38:16.560952+0000","last_undegraded":"2023-06-09T04:38:16.560952+0000","last_fullsized":"2023-06-09T04:38:16.560952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:29:24.685594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561261+0000","last_change":"2023-06-09T04:38:11.581671+0000","last_active":"2023-06-09T04:38:16.561261+0000","last_peered":"2023-06-09T04:38:16.561261+0000","last_clean":"2023-06-09T04:38:16.561261+0000","last_became_active":"2023-06-09T04:38:11.579485+0000","last_became_peered":"2023-06-09T04:38:11.579485+0000","last_unstale":"2023-06-09T04:38:16.561261+0000","last_undegraded":"2023-06-09T04:38:16.561261+0000","last_fullsized":"2023-06-09T04:38:16.561261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:26:56.275716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983528+0000","last_change":"2023-06-09T04:38:11.196724+0000","last_active":"2023-06-09T04:38:15.983528+0000","last_peered":"2023-06-09T04:38:15.983528+0000","last_clean":"2023-06-09T04:38:15.983528+0000","last_became_active":"2023-06-09T04:38:11.196068+0000","last_became_peered":"2023-06-09T04:38:11.196068+0000","last_unstale":"2023-06-09T04:38:15.983528+0000","last_undegraded":"2023-06-09T04:38:15.983528+0000","last_fullsized":"2023-06-09T04:38:15.983528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:25.012517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559819+0000","last_change":"2023-06-09T04:38:11.590465+0000","last_active":"2023-06-09T04:38:16.559819+0000","last_peered":"2023-06-09T04:38:16.559819+0000","last_clean":"2023-06-09T04:38:16.559819+0000","last_became_active":"2023-06-09T04:38:11.589834+0000","last_became_peered":"2023-06-09T04:38:11.589834+0000","last_unstale":"2023-06-09T04:38:16.559819+0000","last_undegraded":"2023-06-09T04:38:16.559819+0000","last_fullsized":"2023-06-09T04:38:16.559819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:26.501877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984273+0000","last_change":"2023-06-09T04:38:15.638948+0000","last_active":"2023-06-09T04:38:15.984273+0000","last_peered":"2023-06-09T04:38:15.984273+0000","last_clean":"2023-06-09T04:38:15.984273+0000","last_became_active":"2023-06-09T04:38:15.637442+0000","last_became_peered":"2023-06-09T04:38:15.637442+0000","last_unstale":"2023-06-09T04:38:15.984273+0000","last_undegraded":"2023-06-09T04:38:15.984273+0000","last_fullsized":"2023-06-09T04:38:15.984273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:03:02.201851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560419+0000","last_change":"2023-06-09T04:38:11.186756+0000","last_active":"2023-06-09T04:38:16.560419+0000","last_peered":"2023-06-09T04:38:16.560419+0000","last_clean":"2023-06-09T04:38:16.560419+0000","last_became_active":"2023-06-09T04:38:11.185821+0000","last_became_peered":"2023-06-09T04:38:11.185821+0000","last_unstale":"2023-06-09T04:38:16.560419+0000","last_undegraded":"2023-06-09T04:38:16.560419+0000","last_fullsized":"2023-06-09T04:38:16.560419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:55.494527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984073+0000","last_change":"2023-06-09T04:38:11.598710+0000","last_active":"2023-06-09T04:38:15.984073+0000","last_peered":"2023-06-09T04:38:15.984073+0000","last_clean":"2023-06-09T04:38:15.984073+0000","last_became_active":"2023-06-09T04:38:11.598397+0000","last_became_peered":"2023-06-09T04:38:11.598397+0000","last_unstale":"2023-06-09T04:38:15.984073+0000","last_undegraded":"2023-06-09T04:38:15.984073+0000","last_fullsized":"2023-06-09T04:38:15.984073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559520+0000","last_change":"2023-06-09T04:38:15.621608+0000","last_active":"2023-06-09T04:38:16.559520+0000","last_peered":"2023-06-09T04:38:16.559520+0000","last_clean":"2023-06-09T04:38:16.559520+0000","last_became_active":"2023-06-09T04:38:15.621042+0000","last_became_peered":"2023-06-09T04:38:15.621042+0000","last_unstale":"2023-06-09T04:38:16.559520+0000","last_undegraded":"2023-06-09T04:38:16.559520+0000","last_fullsized":"2023-06-09T04:38:16.559520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:05:03.071443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066570+0000","last_change":"2023-06-09T04:38:11.594280+0000","last_active":"2023-06-09T04:38:16.066570+0000","last_peered":"2023-06-09T04:38:16.066570+0000","last_clean":"2023-06-09T04:38:16.066570+0000","last_became_active":"2023-06-09T04:38:11.593913+0000","last_became_peered":"2023-06-09T04:38:11.593913+0000","last_unstale":"2023-06-09T04:38:16.066570+0000","last_undegraded":"2023-06-09T04:38:16.066570+0000","last_fullsized":"2023-06-09T04:38:16.066570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:04.790292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982855+0000","last_change":"2023-06-09T04:38:11.581417+0000","last_active":"2023-06-09T04:38:15.982855+0000","last_peered":"2023-06-09T04:38:15.982855+0000","last_clean":"2023-06-09T04:38:15.982855+0000","last_became_active":"2023-06-09T04:38:11.580835+0000","last_became_peered":"2023-06-09T04:38:11.580835+0000","last_unstale":"2023-06-09T04:38:15.982855+0000","last_undegraded":"2023-06-09T04:38:15.982855+0000","last_fullsized":"2023-06-09T04:38:15.982855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:33.116603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115907+0000","last_change":"2023-06-09T04:38:11.605024+0000","last_active":"2023-06-09T04:38:16.115907+0000","last_peered":"2023-06-09T04:38:16.115907+0000","last_clean":"2023-06-09T04:38:16.115907+0000","last_became_active":"2023-06-09T04:38:11.604711+0000","last_became_peered":"2023-06-09T04:38:11.604711+0000","last_unstale":"2023-06-09T04:38:16.115907+0000","last_undegraded":"2023-06-09T04:38:16.115907+0000","last_fullsized":"2023-06-09T04:38:16.115907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:05.142990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560506+0000","last_change":"2023-06-09T04:38:11.575886+0000","last_active":"2023-06-09T04:38:16.560506+0000","last_peered":"2023-06-09T04:38:16.560506+0000","last_clean":"2023-06-09T04:38:16.560506+0000","last_became_active":"2023-06-09T04:38:11.575594+0000","last_became_peered":"2023-06-09T04:38:11.575594+0000","last_unstale":"2023-06-09T04:38:16.560506+0000","last_undegraded":"2023-06-09T04:38:16.560506+0000","last_fullsized":"2023-06-09T04:38:16.560506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:51.547429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560644+0000","last_change":"2023-06-09T04:38:11.573026+0000","last_active":"2023-06-09T04:38:16.560644+0000","last_peered":"2023-06-09T04:38:16.560644+0000","last_clean":"2023-06-09T04:38:16.560644+0000","last_became_active":"2023-06-09T04:38:11.572744+0000","last_became_peered":"2023-06-09T04:38:11.572744+0000","last_unstale":"2023-06-09T04:38:16.560644+0000","last_undegraded":"2023-06-09T04:38:16.560644+0000","last_fullsized":"2023-06-09T04:38:16.560644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:04:38.824518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560873+0000","last_change":"2023-06-09T04:38:11.597829+0000","last_active":"2023-06-09T04:38:16.560873+0000","last_peered":"2023-06-09T04:38:16.560873+0000","last_clean":"2023-06-09T04:38:16.560873+0000","last_became_active":"2023-06-09T04:38:11.590175+0000","last_became_peered":"2023-06-09T04:38:11.590175+0000","last_unstale":"2023-06-09T04:38:16.560873+0000","last_undegraded":"2023-06-09T04:38:16.560873+0000","last_fullsized":"2023-06-09T04:38:16.560873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:10.046575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559401+0000","last_change":"2023-06-09T04:38:11.598947+0000","last_active":"2023-06-09T04:38:16.559401+0000","last_peered":"2023-06-09T04:38:16.559401+0000","last_clean":"2023-06-09T04:38:16.559401+0000","last_became_active":"2023-06-09T04:38:11.598503+0000","last_became_peered":"2023-06-09T04:38:11.598503+0000","last_unstale":"2023-06-09T04:38:16.559401+0000","last_undegraded":"2023-06-09T04:38:16.559401+0000","last_fullsized":"2023-06-09T04:38:16.559401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:44.845221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985260+0000","last_change":"2023-06-09T04:38:11.594511+0000","last_active":"2023-06-09T04:38:15.985260+0000","last_peered":"2023-06-09T04:38:15.985260+0000","last_clean":"2023-06-09T04:38:15.985260+0000","last_became_active":"2023-06-09T04:38:11.592278+0000","last_became_peered":"2023-06-09T04:38:11.592278+0000","last_unstale":"2023-06-09T04:38:15.985260+0000","last_undegraded":"2023-06-09T04:38:15.985260+0000","last_fullsized":"2023-06-09T04:38:15.985260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:36:26.790998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065900+0000","last_change":"2023-06-09T04:38:11.581970+0000","last_active":"2023-06-09T04:38:16.065900+0000","last_peered":"2023-06-09T04:38:16.065900+0000","last_clean":"2023-06-09T04:38:16.065900+0000","last_became_active":"2023-06-09T04:38:11.581665+0000","last_became_peered":"2023-06-09T04:38:11.581665+0000","last_unstale":"2023-06-09T04:38:16.065900+0000","last_undegraded":"2023-06-09T04:38:16.065900+0000","last_fullsized":"2023-06-09T04:38:16.065900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986039+0000","last_change":"2023-06-09T04:38:11.594155+0000","last_active":"2023-06-09T04:38:15.986039+0000","last_peered":"2023-06-09T04:38:15.986039+0000","last_clean":"2023-06-09T04:38:15.986039+0000","last_became_active":"2023-06-09T04:38:11.592402+0000","last_became_peered":"2023-06-09T04:38:11.592402+0000","last_unstale":"2023-06-09T04:38:15.986039+0000","last_undegraded":"2023-06-09T04:38:15.986039+0000","last_fullsized":"2023-06-09T04:38:15.986039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:03.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559449+0000","last_change":"2023-06-09T04:38:11.598820+0000","last_active":"2023-06-09T04:38:16.559449+0000","last_peered":"2023-06-09T04:38:16.559449+0000","last_clean":"2023-06-09T04:38:16.559449+0000","last_became_active":"2023-06-09T04:38:11.598538+0000","last_became_peered":"2023-06-09T04:38:11.598538+0000","last_unstale":"2023-06-09T04:38:16.559449+0000","last_undegraded":"2023-06-09T04:38:16.559449+0000","last_fullsized":"2023-06-09T04:38:16.559449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:32.642381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066228+0000","last_change":"2023-06-09T04:38:11.581487+0000","last_active":"2023-06-09T04:38:16.066228+0000","last_peered":"2023-06-09T04:38:16.066228+0000","last_clean":"2023-06-09T04:38:16.066228+0000","last_became_active":"2023-06-09T04:38:11.580791+0000","last_became_peered":"2023-06-09T04:38:11.580791+0000","last_unstale":"2023-06-09T04:38:16.066228+0000","last_undegraded":"2023-06-09T04:38:16.066228+0000","last_fullsized":"2023-06-09T04:38:16.066228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066270+0000","last_change":"2023-06-09T04:38:11.596924+0000","last_active":"2023-06-09T04:38:16.066270+0000","last_peered":"2023-06-09T04:38:16.066270+0000","last_clean":"2023-06-09T04:38:16.066270+0000","last_became_active":"2023-06-09T04:38:11.596514+0000","last_became_peered":"2023-06-09T04:38:11.596514+0000","last_unstale":"2023-06-09T04:38:16.066270+0000","last_undegraded":"2023-06-09T04:38:16.066270+0000","last_fullsized":"2023-06-09T04:38:16.066270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:15.244503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561345+0000","last_change":"2023-06-09T04:38:11.591842+0000","last_active":"2023-06-09T04:38:16.561345+0000","last_peered":"2023-06-09T04:38:16.561345+0000","last_clean":"2023-06-09T04:38:16.561345+0000","last_became_active":"2023-06-09T04:38:11.591348+0000","last_became_peered":"2023-06-09T04:38:11.591348+0000","last_unstale":"2023-06-09T04:38:16.561345+0000","last_undegraded":"2023-06-09T04:38:16.561345+0000","last_fullsized":"2023-06-09T04:38:16.561345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:11.837579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116228+0000","last_change":"2023-06-09T04:38:11.581598+0000","last_active":"2023-06-09T04:38:16.116228+0000","last_peered":"2023-06-09T04:38:16.116228+0000","last_clean":"2023-06-09T04:38:16.116228+0000","last_became_active":"2023-06-09T04:38:11.581079+0000","last_became_peered":"2023-06-09T04:38:11.581079+0000","last_unstale":"2023-06-09T04:38:16.116228+0000","last_undegraded":"2023-06-09T04:38:16.116228+0000","last_fullsized":"2023-06-09T04:38:16.116228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:26.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559059+0000","last_change":"2023-06-09T04:38:11.588434+0000","last_active":"2023-06-09T04:38:16.559059+0000","last_peered":"2023-06-09T04:38:16.559059+0000","last_clean":"2023-06-09T04:38:16.559059+0000","last_became_active":"2023-06-09T04:38:11.586783+0000","last_became_peered":"2023-06-09T04:38:11.586783+0000","last_unstale":"2023-06-09T04:38:16.559059+0000","last_undegraded":"2023-06-09T04:38:16.559059+0000","last_fullsized":"2023-06-09T04:38:16.559059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:30:39.956547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559051+0000","last_change":"2023-06-09T04:38:11.589256+0000","last_active":"2023-06-09T04:38:16.559051+0000","last_peered":"2023-06-09T04:38:16.559051+0000","last_clean":"2023-06-09T04:38:16.559051+0000","last_became_active":"2023-06-09T04:38:11.585253+0000","last_became_peered":"2023-06-09T04:38:11.585253+0000","last_unstale":"2023-06-09T04:38:16.559051+0000","last_undegraded":"2023-06-09T04:38:16.559051+0000","last_fullsized":"2023-06-09T04:38:16.559051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:20.593479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115686+0000","last_change":"2023-06-09T04:38:11.595137+0000","last_active":"2023-06-09T04:38:16.115686+0000","last_peered":"2023-06-09T04:38:16.115686+0000","last_clean":"2023-06-09T04:38:16.115686+0000","last_became_active":"2023-06-09T04:38:11.594879+0000","last_became_peered":"2023-06-09T04:38:11.594879+0000","last_unstale":"2023-06-09T04:38:16.115686+0000","last_undegraded":"2023-06-09T04:38:16.115686+0000","last_fullsized":"2023-06-09T04:38:16.115686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:29.708676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066144+0000","last_change":"2023-06-09T04:38:11.580088+0000","last_active":"2023-06-09T04:38:16.066144+0000","last_peered":"2023-06-09T04:38:16.066144+0000","last_clean":"2023-06-09T04:38:16.066144+0000","last_became_active":"2023-06-09T04:38:11.579839+0000","last_became_peered":"2023-06-09T04:38:11.579839+0000","last_unstale":"2023-06-09T04:38:16.066144+0000","last_undegraded":"2023-06-09T04:38:16.066144+0000","last_fullsized":"2023-06-09T04:38:16.066144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985563+0000","last_change":"2023-06-09T04:38:11.584533+0000","last_active":"2023-06-09T04:38:15.985563+0000","last_peered":"2023-06-09T04:38:15.985563+0000","last_clean":"2023-06-09T04:38:15.985563+0000","last_became_active":"2023-06-09T04:38:11.583229+0000","last_became_peered":"2023-06-09T04:38:11.583229+0000","last_unstale":"2023-06-09T04:38:15.985563+0000","last_undegraded":"2023-06-09T04:38:15.985563+0000","last_fullsized":"2023-06-09T04:38:15.985563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560605+0000","last_change":"2023-06-09T04:38:11.590402+0000","last_active":"2023-06-09T04:38:16.560605+0000","last_peered":"2023-06-09T04:38:16.560605+0000","last_clean":"2023-06-09T04:38:16.560605+0000","last_became_active":"2023-06-09T04:38:11.590128+0000","last_became_peered":"2023-06-09T04:38:11.590128+0000","last_unstale":"2023-06-09T04:38:16.560605+0000","last_undegraded":"2023-06-09T04:38:16.560605+0000","last_fullsized":"2023-06-09T04:38:16.560605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:31.691341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066715+0000","last_change":"2023-06-09T04:38:11.575532+0000","last_active":"2023-06-09T04:38:16.066715+0000","last_peered":"2023-06-09T04:38:16.066715+0000","last_clean":"2023-06-09T04:38:16.066715+0000","last_became_active":"2023-06-09T04:38:11.574743+0000","last_became_peered":"2023-06-09T04:38:11.574743+0000","last_unstale":"2023-06-09T04:38:16.066715+0000","last_undegraded":"2023-06-09T04:38:16.066715+0000","last_fullsized":"2023-06-09T04:38:16.066715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:27:44.893546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066132+0000","last_change":"2023-06-09T04:38:11.587445+0000","last_active":"2023-06-09T04:38:16.066132+0000","last_peered":"2023-06-09T04:38:16.066132+0000","last_clean":"2023-06-09T04:38:16.066132+0000","last_became_active":"2023-06-09T04:38:11.587078+0000","last_became_peered":"2023-06-09T04:38:11.587078+0000","last_unstale":"2023-06-09T04:38:16.066132+0000","last_undegraded":"2023-06-09T04:38:16.066132+0000","last_fullsized":"2023-06-09T04:38:16.066132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:57.955916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984537+0000","last_change":"2023-06-09T04:38:11.594397+0000","last_active":"2023-06-09T04:38:15.984537+0000","last_peered":"2023-06-09T04:38:15.984537+0000","last_clean":"2023-06-09T04:38:15.984537+0000","last_became_active":"2023-06-09T04:38:11.592636+0000","last_became_peered":"2023-06-09T04:38:11.592636+0000","last_unstale":"2023-06-09T04:38:15.984537+0000","last_undegraded":"2023-06-09T04:38:15.984537+0000","last_fullsized":"2023-06-09T04:38:15.984537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:00:19.960889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065734+0000","last_change":"2023-06-09T04:38:11.572712+0000","last_active":"2023-06-09T04:38:16.065734+0000","last_peered":"2023-06-09T04:38:16.065734+0000","last_clean":"2023-06-09T04:38:16.065734+0000","last_became_active":"2023-06-09T04:38:11.571728+0000","last_became_peered":"2023-06-09T04:38:11.571728+0000","last_unstale":"2023-06-09T04:38:16.065734+0000","last_undegraded":"2023-06-09T04:38:16.065734+0000","last_fullsized":"2023-06-09T04:38:16.065734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559434+0000","last_change":"2023-06-09T04:38:11.590174+0000","last_active":"2023-06-09T04:38:16.559434+0000","last_peered":"2023-06-09T04:38:16.559434+0000","last_clean":"2023-06-09T04:38:16.559434+0000","last_became_active":"2023-06-09T04:38:11.589797+0000","last_became_peered":"2023-06-09T04:38:11.589797+0000","last_unstale":"2023-06-09T04:38:16.559434+0000","last_undegraded":"2023-06-09T04:38:16.559434+0000","last_fullsized":"2023-06-09T04:38:16.559434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:50.267811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559697+0000","last_change":"2023-06-09T04:38:11.597890+0000","last_active":"2023-06-09T04:38:16.559697+0000","last_peered":"2023-06-09T04:38:16.559697+0000","last_clean":"2023-06-09T04:38:16.559697+0000","last_became_active":"2023-06-09T04:38:11.590403+0000","last_became_peered":"2023-06-09T04:38:11.590403+0000","last_unstale":"2023-06-09T04:38:16.559697+0000","last_undegraded":"2023-06-09T04:38:16.559697+0000","last_fullsized":"2023-06-09T04:38:16.559697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:31:47.357977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984691+0000","last_change":"2023-06-09T04:38:11.590981+0000","last_active":"2023-06-09T04:38:15.984691+0000","last_peered":"2023-06-09T04:38:15.984691+0000","last_clean":"2023-06-09T04:38:15.984691+0000","last_became_active":"2023-06-09T04:38:11.590680+0000","last_became_peered":"2023-06-09T04:38:11.590680+0000","last_unstale":"2023-06-09T04:38:15.984691+0000","last_undegraded":"2023-06-09T04:38:15.984691+0000","last_fullsized":"2023-06-09T04:38:15.984691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:34.676457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116447+0000","last_change":"2023-06-09T04:38:11.581610+0000","last_active":"2023-06-09T04:38:16.116447+0000","last_peered":"2023-06-09T04:38:16.116447+0000","last_clean":"2023-06-09T04:38:16.116447+0000","last_became_active":"2023-06-09T04:38:11.580238+0000","last_became_peered":"2023-06-09T04:38:11.580238+0000","last_unstale":"2023-06-09T04:38:16.116447+0000","last_undegraded":"2023-06-09T04:38:16.116447+0000","last_fullsized":"2023-06-09T04:38:16.116447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116281+0000","last_change":"2023-06-09T04:38:11.579502+0000","last_active":"2023-06-09T04:38:16.116281+0000","last_peered":"2023-06-09T04:38:16.116281+0000","last_clean":"2023-06-09T04:38:16.116281+0000","last_became_active":"2023-06-09T04:38:11.579076+0000","last_became_peered":"2023-06-09T04:38:11.579076+0000","last_unstale":"2023-06-09T04:38:16.116281+0000","last_undegraded":"2023-06-09T04:38:16.116281+0000","last_fullsized":"2023-06-09T04:38:16.116281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982195+0000","last_change":"2023-06-09T04:38:11.595714+0000","last_active":"2023-06-09T04:38:15.982195+0000","last_peered":"2023-06-09T04:38:15.982195+0000","last_clean":"2023-06-09T04:38:15.982195+0000","last_became_active":"2023-06-09T04:38:11.595346+0000","last_became_peered":"2023-06-09T04:38:11.595346+0000","last_unstale":"2023-06-09T04:38:15.982195+0000","last_undegraded":"2023-06-09T04:38:15.982195+0000","last_fullsized":"2023-06-09T04:38:15.982195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561947+0000","last_change":"2023-06-09T04:38:11.584489+0000","last_active":"2023-06-09T04:38:16.561947+0000","last_peered":"2023-06-09T04:38:16.561947+0000","last_clean":"2023-06-09T04:38:16.561947+0000","last_became_active":"2023-06-09T04:38:11.584214+0000","last_became_peered":"2023-06-09T04:38:11.584214+0000","last_unstale":"2023-06-09T04:38:16.561947+0000","last_undegraded":"2023-06-09T04:38:16.561947+0000","last_fullsized":"2023-06-09T04:38:16.561947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:06:31.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":315392,"data_stored":125663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":712808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":712716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":125559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:35.442 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:38:35.443 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-09T04:38:35.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-09T04:38:35.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-09T04:38:35.444 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-09T04:38:35.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.591+0000 7fbe7cc5b640 1 Processor -- start 2023-06-09T04:38:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.591+0000 7fbe7cc5b640 1 -- start start 2023-06-09T04:38:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe781586e0 0x7fbe780ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe7806c3c0 0x7fbe7815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7806a900 con 0x7fbe78158310 2023-06-09T04:38:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780cd0f0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7815ceb0 con 0x7fbe781586e0 2023-06-09T04:38:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe7806c3c0 0x7fbe7815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe7806c3c0 0x7fbe7815bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58238/0 (socket says 172.21.15.18:58238) 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 -- 172.21.15.18:0/1566977217 learned_addr learned my addr 172.21.15.18:0/1566977217 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe75d9b640 1 --2- 172.21.15.18:0/1566977217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe781586e0 0x7fbe780ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 -- 172.21.15.18:0/1566977217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe781586e0 msgr2=0x7fbe780ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 --2- 172.21.15.18:0/1566977217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe781586e0 0x7fbe780ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 -- 172.21.15.18:0/1566977217 >> v1:172.21.15.18:6789/0 conn(0x7fbe78158310 legacy=0x7fbe7806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 -- 172.21.15.18:0/1566977217 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7815cbd0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe76d9d640 1 --2- 172.21.15.18:0/1566977217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815bff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009e50 tx=0x7fbe7001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3f91fc28152890 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7559a640 1 -- 172.21.15.18:0/1566977217 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe700a57c0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7559a640 1 -- 172.21.15.18:0/1566977217 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe700a5920 con 0x7fbe7806c3c0 2023-06-09T04:38:35.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7559a640 1 -- 172.21.15.18:0/1566977217 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe700a5cb0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/1566977217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 msgr2=0x7fbe7815bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/1566977217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815bff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009e50 tx=0x7fbe7001c9e0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/1566977217 shutdown_connections 2023-06-09T04:38:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/1566977217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815bff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/1566977217 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe781586e0 0x7fbe780ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/1566977217 >> 172.21.15.18:0/1566977217 conn(0x7fbe780b0240 msgr2=0x7fbe780cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/1566977217 shutdown_connections 2023-06-09T04:38:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.595+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/1566977217 wait complete. 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 Processor -- start 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 -- start start 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe78158310 0x7fbe7814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe781586e0 0x7fbe7814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78159e70 con 0x7fbe7806c3c0 2023-06-09T04:38:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78159230 con 0x7fbe781586e0 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781594d0 con 0x7fbe78158310 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58248/0 (socket says 172.21.15.18:58248) 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 -- 172.21.15.18:0/3509684592 learned_addr learned my addr 172.21.15.18:0/3509684592 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe75d9b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe78158310 0x7fbe7814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 -- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe78158310 msgr2=0x7fbe7814d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe78158310 0x7fbe7814d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 -- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe781586e0 msgr2=0x7fbe7814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe781586e0 0x7fbe7814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 -- 172.21.15.18:0/3509684592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70009b30 con 0x7fbe7806c3c0 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7659c640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815ba70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c420 tx=0x7fbe6c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0052d0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c005430 con 0x7fbe7806c3c0 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe781597b0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c007260 con 0x7fbe7806c3c0 2023-06-09T04:38:35.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7814e240 con 0x7fbe7806c3c0 2023-06-09T04:38:35.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.599+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe6c0073c0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.603+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe78159fb0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.603+0000 7fbe66ffd640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbe58066280 0x7fbe58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.603+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe6c083350 con 0x7fbe7806c3c0 2023-06-09T04:38:35.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.603+0000 7fbe75d9b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbe58066280 0x7fbe58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.603+0000 7fbe75d9b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbe58066280 0x7fbe58068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe78155510 tx=0x7fbe68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.607+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe78159fb0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.795+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbe78159fb0 con 0x7fbe7806c3c0 2023-06-09T04:38:35.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.803+0000 7fbe66ffd640 1 -- 172.21.15.18:0/3509684592 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164237 (secure 0 0 0) 0x7fbe6c050570 con 0x7fbe7806c3c0 2023-06-09T04:38:35.805 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:35.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbe58066280 msgr2=0x7fbe58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbe58066280 0x7fbe58068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe78155510 tx=0x7fbe68008040 comp rx=0 tx=0).stop 2023-06-09T04:38:35.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 msgr2=0x7fbe7815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815ba70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c420 tx=0x7fbe6c00c8e0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 shutdown_connections 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe781586e0 0x7fbe7814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbe58066280 0x7fbe58068730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe78158310 0x7fbe7814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 --2- 172.21.15.18:0/3509684592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe7806c3c0 0x7fbe7815ba70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 >> 172.21.15.18:0/3509684592 conn(0x7fbe780b0240 msgr2=0x7fbe78070570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:35.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 shutdown_connections 2023-06-09T04:38:35.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.807+0000 7fbe7cc5b640 1 -- 172.21.15.18:0/3509684592 wait complete. 2023-06-09T04:38:35.824 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":468192741},{"type":"v1","addr":"172.21.15.81:6833","nonce":468192741}]},"active_addr":"172.21.15.81:6833/468192741","active_change":"2023-06-09T04:37:51.679522+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":62310583}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3059061428}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1641982679}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3715073323}]}]} 2023-06-09T04:38:35.829 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-09T04:38:35.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-09T04:38:35.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:35.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.951+0000 7f2f89646640 1 Processor -- start 2023-06-09T04:38:35.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.951+0000 7f2f89646640 1 -- start start 2023-06-09T04:38:35.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f84158310 0x7f2f840ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2f841586e0 0x7f2f8406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840cd0f0 con 0x7f2f841586e0 2023-06-09T04:38:35.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8406a900 con 0x7f2f84158310 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8406c5f0 con 0x7f2f8406c1f0 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2f841586e0 0x7f2f8406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2f841586e0 0x7f2f8406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58256/0 (socket says 172.21.15.18:58256) 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 -- 172.21.15.18:0/821983081 learned_addr learned my addr 172.21.15.18:0/821983081 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f837fe640 1 --2- 172.21.15.18:0/821983081 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f82ffd640 1 --2- 172.21.15.18:0/821983081 >> v2:172.21.15.81:3300/0 conn(0x7f2f84158310 0x7f2f840ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 -- 172.21.15.18:0/821983081 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 msgr2=0x7f2f8415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 --2- 172.21.15.18:0/821983081 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 -- 172.21.15.18:0/821983081 >> v2:172.21.15.81:3300/0 conn(0x7f2f84158310 msgr2=0x7f2f840ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 --2- 172.21.15.18:0/821983081 >> v2:172.21.15.81:3300/0 conn(0x7f2f84158310 0x7f2f840ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 -- 172.21.15.18:0/821983081 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8415ceb0 con 0x7f2f841586e0 2023-06-09T04:38:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f827fc640 1 --2- 172.21.15.18:0/821983081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f841586e0 0x7f2f8406bcb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f8406b680 tx=0x7f2f7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6242f826aea041 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f81ffb640 1 -- 172.21.15.18:0/821983081 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780ac600 con 0x7f2f841586e0 2023-06-09T04:38:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f81ffb640 1 -- 172.21.15.18:0/821983081 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780a8050 con 0x7f2f841586e0 2023-06-09T04:38:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f81ffb640 1 -- 172.21.15.18:0/821983081 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780ac980 con 0x7f2f841586e0 2023-06-09T04:38:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- 172.21.15.18:0/821983081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f841586e0 msgr2=0x7f2f8406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- 172.21.15.18:0/821983081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f841586e0 0x7f2f8406bcb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f8406b680 tx=0x7f2f7801c4d0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- 172.21.15.18:0/821983081 shutdown_connections 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- 172.21.15.18:0/821983081 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- 172.21.15.18:0/821983081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f841586e0 0x7f2f8406bcb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 --2- 172.21.15.18:0/821983081 >> v2:172.21.15.81:3300/0 conn(0x7f2f84158310 0x7f2f840ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- 172.21.15.18:0/821983081 >> 172.21.15.18:0/821983081 conn(0x7f2f840b0240 msgr2=0x7f2f840cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- 172.21.15.18:0/821983081 shutdown_connections 2023-06-09T04:38:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.955+0000 7f2f89646640 1 -- 172.21.15.18:0/821983081 wait complete. 2023-06-09T04:38:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 Processor -- start 2023-06-09T04:38:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- start start 2023-06-09T04:38:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 0x7f2f84159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f841586e0 0x7f2f84159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8414f730 con 0x7f2f84158310 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415bce0 con 0x7f2f841586e0 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84154c50 con 0x7f2f8406c1f0 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 0x7f2f84159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 0x7f2f84159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58272/0 (socket says 172.21.15.18:58272) 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 -- 172.21.15.18:0/3436139491 learned_addr learned my addr 172.21.15.18:0/3436139491 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:35.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 -- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 msgr2=0x7f2f8414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 -- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f841586e0 msgr2=0x7f2f84159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f841586e0 0x7f2f84159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 -- 172.21.15.18:0/3436139491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780094d0 con 0x7f2f84158310 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f827fc640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 0x7f2f84159610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f7801cd70 tx=0x7f2f7801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780bc070 con 0x7f2f84158310 2023-06-09T04:38:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780acd20 con 0x7f2f84158310 2023-06-09T04:38:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8415ba00 con 0x7f2f84158310 2023-06-09T04:38:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b7670 con 0x7f2f84158310 2023-06-09T04:38:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f840b08b0 con 0x7f2f84158310 2023-06-09T04:38:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.959+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f840c6790 con 0x7f2f84158310 2023-06-09T04:38:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.963+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f780b3070 con 0x7f2f84158310 2023-06-09T04:38:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.963+0000 7f2f6b7fe640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2f700662b0 0x7f2f70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.963+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f7811d960 con 0x7f2f84158310 2023-06-09T04:38:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.963+0000 7f2f82ffd640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2f700662b0 0x7f2f70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.963+0000 7f2f82ffd640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2f700662b0 0x7f2f70068760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2f84150670 tx=0x7f2f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:35.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:35.967+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f780eaae0 con 0x7f2f84158310 2023-06-09T04:38:36.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.123+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f84073380 con 0x7f2f84158310 2023-06-09T04:38:36.128 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f6b7fe640 1 -- 172.21.15.18:0/3436139491 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f2f7810bee0 con 0x7f2f84158310 2023-06-09T04:38:36.129 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:36.129 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2f700662b0 msgr2=0x7f2f70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2f700662b0 0x7f2f70068760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2f84150670 tx=0x7f2f74008040 comp rx=0 tx=0).stop 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 msgr2=0x7f2f84159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 0x7f2f84159610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f7801cd70 tx=0x7f2f7801ad10 comp rx=0 tx=0).stop 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 shutdown_connections 2023-06-09T04:38:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f841586e0 0x7f2f84159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84158310 0x7f2f84159610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2f700662b0 0x7f2f70068760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 --2- 172.21.15.18:0/3436139491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f8406c1f0 0x7f2f8414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 >> 172.21.15.18:0/3436139491 conn(0x7f2f840b0240 msgr2=0x7f2f84162a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 shutdown_connections 2023-06-09T04:38:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.127+0000 7f2f89646640 1 -- 172.21.15.18:0/3436139491 wait complete. 2023-06-09T04:38:36.148 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-09T04:38:36.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:36.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.271+0000 7f96dbb60640 1 Processor -- start 2023-06-09T04:38:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.271+0000 7f96dbb60640 1 -- start start 2023-06-09T04:38:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96dbb60640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96d415b770 0x7f96d40cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96dbb60640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96d40ca2a0 0x7f96d406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96dbb60640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d40ca6f0 con 0x7f96d40cc260 2023-06-09T04:38:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96dbb60640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d415fb70 con 0x7f96d415b770 2023-06-09T04:38:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96dbb60640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d40cdf60 con 0x7f96d40ca2a0 2023-06-09T04:38:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96da0fd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f96d40cc260 0x7f96d415be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59200/0 (socket says 172.21.15.18:59200) 2023-06-09T04:38:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96da0fd640 1 -- 172.21.15.18:0/1060670844 learned_addr learned my addr 172.21.15.18:0/1060670844 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d98fc640 1 --2- 172.21.15.18:0/1060670844 >> v2:172.21.15.18:3300/0 conn(0x7f96d415b770 0x7f96d40cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d90fb640 1 --2- 172.21.15.18:0/1060670844 >> v2:172.21.15.81:3300/0 conn(0x7f96d40ca2a0 0x7f96d406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d98fc640 1 -- 172.21.15.18:0/1060670844 >> v2:172.21.15.81:3300/0 conn(0x7f96d40ca2a0 msgr2=0x7f96d406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d98fc640 1 --2- 172.21.15.18:0/1060670844 >> v2:172.21.15.81:3300/0 conn(0x7f96d40ca2a0 0x7f96d406ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d98fc640 1 -- 172.21.15.18:0/1060670844 >> v1:172.21.15.18:6789/0 conn(0x7f96d40cc260 legacy=0x7f96d415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d88fa640 1 -- 172.21.15.18:0/1060670844 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624080521 0 0) 0x7f96cc001120 con 0x7f96d40cc260 2023-06-09T04:38:36.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.275+0000 7f96d98fc640 1 -- 172.21.15.18:0/1060670844 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d41600a0 con 0x7f96d415b770 2023-06-09T04:38:36.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d98fc640 1 --2- 172.21.15.18:0/1060670844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d415b770 0x7f96d40cf4e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96d40b2810 tx=0x7f96d001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9c29961a6e7324 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d88fa640 1 -- 172.21.15.18:0/1060670844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00ab600 con 0x7f96d415b770 2023-06-09T04:38:36.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d88fa640 1 -- 172.21.15.18:0/1060670844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00a7050 con 0x7f96d415b770 2023-06-09T04:38:36.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d88fa640 1 -- 172.21.15.18:0/1060670844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00ab980 con 0x7f96d415b770 2023-06-09T04:38:36.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- 172.21.15.18:0/1060670844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d415b770 msgr2=0x7f96d40cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 --2- 172.21.15.18:0/1060670844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d415b770 0x7f96d40cf4e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96d40b2810 tx=0x7f96d001c3d0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- 172.21.15.18:0/1060670844 shutdown_connections 2023-06-09T04:38:36.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 --2- 172.21.15.18:0/1060670844 >> v2:172.21.15.81:3300/0 conn(0x7f96d40ca2a0 0x7f96d406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 --2- 172.21.15.18:0/1060670844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d415b770 0x7f96d40cf4e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- 172.21.15.18:0/1060670844 >> 172.21.15.18:0/1060670844 conn(0x7f96d406f850 msgr2=0x7f96d406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- 172.21.15.18:0/1060670844 shutdown_connections 2023-06-09T04:38:36.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- 172.21.15.18:0/1060670844 wait complete. 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 Processor -- start 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- start start 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 0x7f96d414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96d40cc260 0x7f96d40b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96d415b770 0x7f96d414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d414f770 con 0x7f96d40ca2a0 2023-06-09T04:38:36.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d414fa50 con 0x7f96d415b770 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96dbb60640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d414fd30 con 0x7f96d40cc260 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d98fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 0x7f96d414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d98fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 0x7f96d414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58286/0 (socket says 172.21.15.18:58286) 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.279+0000 7f96d98fc640 1 -- 172.21.15.18:0/49499344 learned_addr learned my addr 172.21.15.18:0/49499344 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d98fc640 1 -- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96d40cc260 msgr2=0x7f96d40b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d98fc640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96d40cc260 0x7f96d40b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d98fc640 1 -- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96d415b770 msgr2=0x7f96d414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d98fc640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96d415b770 0x7f96d414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d98fc640 1 -- 172.21.15.18:0/49499344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0009420 con 0x7f96d40ca2a0 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d98fc640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 0x7f96d414f190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96d0018fe0 tx=0x7f96d001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0006e20 con 0x7f96d40ca2a0 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0004030 con 0x7f96d40ca2a0 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d4150010 con 0x7f96d40ca2a0 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00043a0 con 0x7f96d40ca2a0 2023-06-09T04:38:36.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d40c7fc0 con 0x7f96d40ca2a0 2023-06-09T04:38:36.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d4150530 con 0x7f96d40ca2a0 2023-06-09T04:38:36.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96d0003620 con 0x7f96d40ca2a0 2023-06-09T04:38:36.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96c67fc640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f96b8066280 0x7f96b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96d011ec80 con 0x7f96d40ca2a0 2023-06-09T04:38:36.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d90fb640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f96b8066280 0x7f96b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.283+0000 7f96d90fb640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f96b8066280 0x7f96b8068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96d40b3bc0 tx=0x7f96c8009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.287+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96d4150530 con 0x7f96d40ca2a0 2023-06-09T04:38:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.443+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96d4150530 con 0x7f96d40ca2a0 2023-06-09T04:38:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96c67fc640 1 -- 172.21.15.18:0/49499344 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f96d4150530 con 0x7f96d40ca2a0 2023-06-09T04:38:36.448 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:36.448 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f96b8066280 msgr2=0x7f96b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f96b8066280 0x7f96b8068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96d40b3bc0 tx=0x7f96c8009830 comp rx=0 tx=0).stop 2023-06-09T04:38:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 msgr2=0x7f96d414f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 0x7f96d414f190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f96d0018fe0 tx=0x7f96d001ac10 comp rx=0 tx=0).stop 2023-06-09T04:38:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 shutdown_connections 2023-06-09T04:38:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96d415b770 0x7f96d414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f96b8066280 0x7f96b8068730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96d40cc260 0x7f96d40b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 --2- 172.21.15.18:0/49499344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40ca2a0 0x7f96d414f190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 >> 172.21.15.18:0/49499344 conn(0x7f96d406f850 msgr2=0x7f96d415cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 shutdown_connections 2023-06-09T04:38:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.447+0000 7f96dbb60640 1 -- 172.21.15.18:0/49499344 wait complete. 2023-06-09T04:38:36.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-09T04:38:36.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-09T04:38:36.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-09T04:38:36.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-09T04:38:36.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-09T04:38:36.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-09T04:38:36.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-09T04:38:36.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-09T04:38:36.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.639+0000 7fabcdd3b640 1 Processor -- start 2023-06-09T04:38:36.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.639+0000 7fabcdd3b640 1 -- start start 2023-06-09T04:38:36.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabcdd3b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80708d0 0x7fabc8157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabcdd3b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabc80699c0 0x7fabc80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabcdd3b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80b19d0 con 0x7fabc80b2e10 2023-06-09T04:38:36.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabcdd3b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc806a730 con 0x7fabc80699c0 2023-06-09T04:38:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabcdd3b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b37c0 con 0x7fabc80708d0 2023-06-09T04:38:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fabc80b2e10 0x7fabc80692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59206/0 (socket says 172.21.15.18:59206) 2023-06-09T04:38:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc6ffd640 1 -- 172.21.15.18:0/705333063 learned_addr learned my addr 172.21.15.18:0/705333063 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc77fe640 1 --2- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80708d0 0x7fabc8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc7fff640 1 --2- 172.21.15.18:0/705333063 >> v2:172.21.15.81:3300/0 conn(0x7fabc80699c0 0x7fabc80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc7fff640 1 -- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80708d0 msgr2=0x7fabc8157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc7fff640 1 --2- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80708d0 0x7fabc8157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc7fff640 1 -- 172.21.15.18:0/705333063 >> v1:172.21.15.18:6789/0 conn(0x7fabc80b2e10 legacy=0x7fabc80692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.643+0000 7fabc7fff640 1 -- 172.21.15.18:0/705333063 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8069e90 con 0x7fabc80699c0 2023-06-09T04:38:36.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabc7fff640 1 --2- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80699c0 0x7fabc80b3280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabb80097c0 tx=0x7fabb801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3aeb6a457fac525 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabc67fc640 1 -- 172.21.15.18:0/705333063 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80ab600 con 0x7fabc80699c0 2023-06-09T04:38:36.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabc67fc640 1 -- 172.21.15.18:0/705333063 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80a7050 con 0x7fabc80699c0 2023-06-09T04:38:36.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabc67fc640 1 -- 172.21.15.18:0/705333063 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80ab9c0 con 0x7fabc80699c0 2023-06-09T04:38:36.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 Processor -- start 2023-06-09T04:38:36.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 -- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80699c0 msgr2=0x7fabc80b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 --2- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80699c0 0x7fabc80b3280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabb80097c0 tx=0x7fabb801c3c0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 -- 172.21.15.18:0/705333063 shutdown_connections 2023-06-09T04:38:36.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 --2- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80699c0 0x7fabc80b3280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 --2- 172.21.15.18:0/705333063 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80708d0 0x7fabc8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 -- 172.21.15.18:0/705333063 >> 172.21.15.18:0/705333063 conn(0x7fabc80ce520 msgr2=0x7fabc80ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 -- 172.21.15.18:0/705333063 shutdown_connections 2023-06-09T04:38:36.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7fabcdd3b640 1 -- 172.21.15.18:0/705333063 wait complete. 2023-06-09T04:38:36.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 -- start start 2023-06-09T04:38:36.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f06e4069f90 0x7f06e4163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40cd4d0 con 0x7f06e415fa50 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e40ccc70 con 0x7f06e4069f90 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.647+0000 7f06ea9f4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41640e0 con 0x7f06e415f680 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f06e415fa50 0x7f06e41633d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59214/0 (socket says 172.21.15.18:59214) 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e37fe640 1 -- 172.21.15.18:0/2728218455 learned_addr learned my addr 172.21.15.18:0/2728218455 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e8f91640 1 --2- 172.21.15.18:0/2728218455 >> v2:172.21.15.18:3300/0 conn(0x7f06e4069f90 0x7f06e4163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e3fff640 1 --2- 172.21.15.18:0/2728218455 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e8f91640 1 -- 172.21.15.18:0/2728218455 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 msgr2=0x7f06e40b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e8f91640 1 --2- 172.21.15.18:0/2728218455 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e8f91640 1 -- 172.21.15.18:0/2728218455 >> v1:172.21.15.18:6789/0 conn(0x7f06e415fa50 legacy=0x7f06e41633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f06e8f91640 1 -- 172.21.15.18:0/2728218455 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40cce80 con 0x7f06e4069f90 2023-06-09T04:38:36.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 Processor -- start 2023-06-09T04:38:36.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 -- start start 2023-06-09T04:38:36.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 Processor -- start 2023-06-09T04:38:36.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 Processor -- start 2023-06-09T04:38:36.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 -- start start 2023-06-09T04:38:36.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 -- start start 2023-06-09T04:38:36.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 Processor -- start 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80699c0 0x7fabc80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80708d0 0x7fabc80c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabc80b2e10 0x7fabc80c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8145e10 con 0x7fabc80b2e10 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81460f0 con 0x7fabc80708d0 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81463d0 con 0x7fabc80699c0 2023-06-09T04:38:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc77fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80699c0 0x7fabc80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc77fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80699c0 0x7fabc80c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:36624/0 (socket says 172.21.15.18:36624) 2023-06-09T04:38:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc77fe640 1 -- 172.21.15.18:0/1743142605 learned_addr learned my addr 172.21.15.18:0/1743142605 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabc80b2e10 0x7fabc80c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f18e815f8f0 0x7f18e80708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e8070270 0x7f18e806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e8069350 con 0x7f18e80c0f80 2023-06-09T04:38:36.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e80ce8a0 con 0x7f18e815f8f0 2023-06-09T04:38:36.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18ecde6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80695f0 con 0x7f18e8070270 2023-06-09T04:38:36.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0f1815f9c0 0x7f0f180cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f1806aa10 0x7f0f1806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 0x7f0f1806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1815fd90 con 0x7f0f1815f9c0 2023-06-09T04:38:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f18163550 con 0x7f0f1806aa10 2023-06-09T04:38:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1dd98640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18163830 con 0x7f0f180cb970 2023-06-09T04:38:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 -- start start 2023-06-09T04:38:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f17fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f1806aa10 0x7f0f1806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f17fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f1806aa10 0x7f0f1806f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33464/0 (socket says 172.21.15.18:33464) 2023-06-09T04:38:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f17fff640 1 -- 172.21.15.18:0/2750027472 learned_addr learned my addr 172.21.15.18:0/2750027472 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/2750027472 >> v2:172.21.15.18:3300/0 conn(0x7f0f1815f9c0 0x7f0f180cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 -- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80699c0 msgr2=0x7fabc80c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fabc80699c0 0x7fabc80c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 -- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80708d0 msgr2=0x7fabc80c4960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:38:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80708d0 0x7fabc80c4960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 -- 172.21.15.18:0/1743142605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8009420 con 0x7fabc80b2e10 2023-06-09T04:38:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18e5d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f18e80c0f80 0x7f18e806fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:56646/0 (socket says 172.21.15.18:56646) 2023-06-09T04:38:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f18e5d9b640 1 -- 172.21.15.18:0/3342911554 learned_addr learned my addr 172.21.15.18:0/3342911554 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffaa40b7640 0x7ffaa40cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa406b830 0x7ffaa40cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40ce520 con 0x7ffaa4069cc0 2023-06-09T04:38:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa406a130 con 0x7ffaa40b7640 2023-06-09T04:38:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaaaa47640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40cc300 con 0x7ffaa406b830 2023-06-09T04:38:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabc7fff640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabc80b2e10 0x7fabc80c4ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ab000 tx=0x7fabb8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaa37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffaa4069cc0 0x7ffaa406b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59228/0 (socket says 172.21.15.18:59228) 2023-06-09T04:38:36.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaa37fe640 1 -- 172.21.15.18:0/521715056 learned_addr learned my addr 172.21.15.18:0/521715056 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:36.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f6a40d81640 1 Processor -- start 2023-06-09T04:38:36.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1cd96640 1 -- 172.21.15.18:0/2750027472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 msgr2=0x7f0f1806fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/2750027472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 0x7f0f1806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f6a40d81640 1 -- start start 2023-06-09T04:38:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1cd96640 1 -- 172.21.15.18:0/2750027472 >> v2:172.21.15.81:3300/0 conn(0x7f0f1806aa10 msgr2=0x7f0f1806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/2750027472 >> v2:172.21.15.81:3300/0 conn(0x7f0f1806aa10 0x7f0f1806f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7f0f1cd96640 1 -- 172.21.15.18:0/2750027472 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f18163b10 con 0x7f0f1815f9c0 2023-06-09T04:38:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80b4820 con 0x7fabc80b2e10 2023-06-09T04:38:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80b4980 con 0x7fabc80b2e10 2023-06-09T04:38:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80b4d10 con 0x7fabc80b2e10 2023-06-09T04:38:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7ffaa8fe4640 1 --2- 172.21.15.18:0/521715056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa406b830 0x7ffaa40cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 -- 172.21.15.18:0/1743142605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc81466b0 con 0x7fabc80b2e10 2023-06-09T04:38:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.651+0000 7fabcdd3b640 1 -- 172.21.15.18:0/1743142605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc80c8d90 con 0x7fabc80b2e10 2023-06-09T04:38:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa2ffd640 1 -- 172.21.15.18:0/521715056 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158960180 0 0) 0x7ffaa40ce520 con 0x7ffaa4069cc0 2023-06-09T04:38:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa2ffd640 1 -- 172.21.15.18:0/521715056 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa8c003530 con 0x7ffaa4069cc0 2023-06-09T04:38:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7fabcdd3b640 1 -- 172.21.15.18:0/1743142605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabc8146260 con 0x7fabc80b2e10 2023-06-09T04:38:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa3fff640 1 --2- 172.21.15.18:0/521715056 >> v2:172.21.15.81:3300/0 conn(0x7ffaa40b7640 0x7ffaa40cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa8fe4640 1 -- 172.21.15.18:0/521715056 >> v2:172.21.15.81:3300/0 conn(0x7ffaa40b7640 msgr2=0x7ffaa40cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa8fe4640 1 --2- 172.21.15.18:0/521715056 >> v2:172.21.15.81:3300/0 conn(0x7ffaa40b7640 0x7ffaa40cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa8fe4640 1 -- 172.21.15.18:0/521715056 >> v1:172.21.15.18:6789/0 conn(0x7ffaa4069cc0 legacy=0x7ffaa406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7ffaa8fe4640 1 -- 172.21.15.18:0/521715056 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40cc5e0 con 0x7ffaa406b830 2023-06-09T04:38:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a40d81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a3c0b7520 0x7f6a3c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a40d81640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6a3c06a4e0 0x7f6a3c06b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a40d81640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c15fec0 con 0x7f6a3c15f9c0 2023-06-09T04:38:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a40d81640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cc630 con 0x7f6a3c06a4e0 2023-06-09T04:38:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a40d81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cc330 con 0x7f6a3c0b7520 2023-06-09T04:38:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a3c0b7520 0x7f6a3c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71369746 0 0) 0x7f18e8069350 con 0x7f18e80c0f80 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e659c640 1 --2- 172.21.15.18:0/3342911554 >> v2:172.21.15.18:3300/0 conn(0x7f18e815f8f0 0x7f18e80708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d0003530 con 0x7f18e80c0f80 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526837522 0 0) 0x7f18d0003530 con 0x7f18e80c0f80 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e8070270 msgr2=0x7f18e806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18e8070270 0x7f18e806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 >> v2:172.21.15.18:3300/0 conn(0x7f18e815f8f0 msgr2=0x7f18e80708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 --2- 172.21.15.18:0/3342911554 >> v2:172.21.15.18:3300/0 conn(0x7f18e815f8f0 0x7f18e80708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e80698d0 con 0x7f18e80c0f80 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f18dc001680 con 0x7f18e80c0f80 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 >> v1:172.21.15.81:6789/0 conn(0x7f18e80c0f80 legacy=0x7f18e806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18d0003980 0x7f18d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d00047d0 0x7f18d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80ce8a0 con 0x7f18d00047d0 2023-06-09T04:38:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80695f0 con 0x7f18d0003980 2023-06-09T04:38:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d000c060 con 0x7f18d0005180 2023-06-09T04:38:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f06e8f91640 1 --2- 172.21.15.18:0/2728218455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e4069f90 0x7f06e4163ae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097c0 tx=0x7f06d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cbf24217ef2354 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a3c0b7520 0x7f6a3c0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33484/0 (socket says 172.21.15.18:33484) 2023-06-09T04:38:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 -- 172.21.15.18:0/1250150387 learned_addr learned my addr 172.21.15.18:0/1250150387 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e659c640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18d0003980 0x7f18d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a39d9b640 1 --2- 172.21.15.18:0/1250150387 >> v2:172.21.15.18:3300/0 conn(0x7f6a3c06a4e0 0x7f6a3c06b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 -- 172.21.15.18:0/1250150387 >> v2:172.21.15.18:3300/0 conn(0x7f6a3c06a4e0 msgr2=0x7f6a3c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 --2- 172.21.15.18:0/1250150387 >> v2:172.21.15.18:3300/0 conn(0x7f6a3c06a4e0 0x7f6a3c06b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 -- 172.21.15.18:0/1250150387 >> v1:172.21.15.81:6789/0 conn(0x7f6a3c15f9c0 legacy=0x7f6a3c0692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a3a59c640 1 -- 172.21.15.18:0/1250150387 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0cde90 con 0x7f6a3c0b7520 2023-06-09T04:38:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f6a39d9b640 1 --2- 172.21.15.18:0/1250150387 >> v2:172.21.15.18:3300/0 conn(0x7f6a3c06a4e0 0x7f6a3c06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f06e2ffd640 1 -- 172.21.15.18:0/2728218455 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ad660 con 0x7f06e4069f90 2023-06-09T04:38:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f06e2ffd640 1 -- 172.21.15.18:0/2728218455 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d00ad7c0 con 0x7f06e4069f90 2023-06-09T04:38:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f06e2ffd640 1 -- 172.21.15.18:0/2728218455 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00adb50 con 0x7f06e4069f90 2023-06-09T04:38:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e5d9b640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d00047d0 0x7f18d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/2750027472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f1815f9c0 0x7f0f180cb430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0f180acb60 tx=0x7f0f1001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ffaabd84491d34 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e6d9d640 1 -- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18d0003980 msgr2=0x7f18d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18d0003980 0x7f18d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e6d9d640 1 -- 172.21.15.18:0/3342911554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d00047d0 msgr2=0x7f18d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f0f177fe640 1 -- 172.21.15.18:0/2750027472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100a5960 con 0x7f0f1815f9c0 2023-06-09T04:38:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d00047d0 0x7f18d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f18e6d9d640 1 -- 172.21.15.18:0/3342911554 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e80698d0 con 0x7f18d0005180 2023-06-09T04:38:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f0f177fe640 1 -- 172.21.15.18:0/2750027472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f100a5ac0 con 0x7f0f1815f9c0 2023-06-09T04:38:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f0f177fe640 1 -- 172.21.15.18:0/2750027472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100a5e50 con 0x7f0f1815f9c0 2023-06-09T04:38:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f428cbf5640 1 Processor -- start 2023-06-09T04:38:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2728218455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e4069f90 msgr2=0x7f06e4163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f06ea9f4640 1 --2- 172.21.15.18:0/2728218455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e4069f90 0x7f06e4163ae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f06d00097c0 tx=0x7f06d001c450 comp rx=0 tx=0).stop 2023-06-09T04:38:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7f428cbf5640 1 -- start start 2023-06-09T04:38:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2728218455 shutdown_connections 2023-06-09T04:38:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 --2- 172.21.15.18:0/2728218455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e4069f90 0x7f06e4163ae0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 --2- 172.21.15.18:0/2728218455 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2728218455 >> 172.21.15.18:0/2728218455 conn(0x7f06e40cb440 msgr2=0x7f06e40cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabb80b2040 con 0x7fabc80b2e10 2023-06-09T04:38:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7fabaffff640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fabb4066380 0x7fabb4068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.655+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabb811eb20 con 0x7fabc80b2e10 2023-06-09T04:38:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabaffff640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] conn(0x7fabb4070050 0x7fabb4072480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 --> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fabb4072b50 con 0x7fabb4070050 2023-06-09T04:38:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabc77fe640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fabb4066380 0x7fabb4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb811eed0 con 0x7fabc80b2e10 2023-06-09T04:38:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2728218455 shutdown_connections 2023-06-09T04:38:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- 172.21.15.18:0/2750027472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f1815f9c0 msgr2=0x7f0f180cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/2750027472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f1815f9c0 0x7f0f180cb430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0f180acb60 tx=0x7f0f1001c900 comp rx=0 tx=0).stop 2023-06-09T04:38:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- 172.21.15.18:0/2750027472 shutdown_connections 2023-06-09T04:38:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/2750027472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 0x7f0f1806fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/2750027472 >> v2:172.21.15.81:3300/0 conn(0x7f0f1806aa10 0x7f0f1806f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaa8fe4640 1 --2- 172.21.15.18:0/521715056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa406b830 0x7ffaa40cfc20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009d90 tx=0x7ffa9c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0bb92f5326f3001 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/2750027472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f1815f9c0 0x7f0f180cb430 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- 172.21.15.18:0/2750027472 >> 172.21.15.18:0/2750027472 conn(0x7f0f180cd860 msgr2=0x7f0f180cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabc6ffd640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] conn(0x7fabb4070050 0x7fabb4072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- 172.21.15.18:0/2750027472 shutdown_connections 2023-06-09T04:38:36.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- 172.21.15.18:0/2750027472 wait complete. 2023-06-09T04:38:36.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428cbf5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 0x7f42880708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428cbf5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4288070270 0x7f428806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428cbf5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4288069350 con 0x7f42880c0f80 2023-06-09T04:38:36.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428cbf5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880ce8a0 con 0x7f428815f8f0 2023-06-09T04:38:36.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428cbf5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880695f0 con 0x7f4288070270 2023-06-09T04:38:36.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 0x7f42880708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 0x7f42880708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58346/0 (socket says 172.21.15.18:58346) 2023-06-09T04:38:36.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabc77fe640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fabb4066380 0x7fabb4068830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009c20 tx=0x7fabbc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428659c640 1 -- 172.21.15.18:0/935878651 learned_addr learned my addr 172.21.15.18:0/935878651 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f4286d9d640 1 --2- 172.21.15.18:0/935878651 >> v2:172.21.15.81:3300/0 conn(0x7f4288070270 0x7f428806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a3a59c640 1 --2- 172.21.15.18:0/1250150387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0d1190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c06ca30 tx=0x7f6a3001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7e22735c1770d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f4286d9d640 1 -- 172.21.15.18:0/935878651 >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 msgr2=0x7f42880708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.688 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2728218455 wait complete. 2023-06-09T04:38:36.688 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 Processor -- start 2023-06-09T04:38:36.688 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a3959a640 1 -- 172.21.15.18:0/1250150387 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300aa650 con 0x7f6a3c0b7520 2023-06-09T04:38:36.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a3959a640 1 -- 172.21.15.18:0/1250150387 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a300aa7b0 con 0x7f6a3c0b7520 2023-06-09T04:38:36.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaa2ffd640 1 -- 172.21.15.18:0/521715056 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a5890 con 0x7ffaa406b830 2023-06-09T04:38:36.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaa2ffd640 1 -- 172.21.15.18:0/521715056 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c0a59f0 con 0x7ffaa406b830 2023-06-09T04:38:36.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaa2ffd640 1 -- 172.21.15.18:0/521715056 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0a5d80 con 0x7ffaa406b830 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 -- 172.21.15.18:0/521715056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa406b830 msgr2=0x7ffaa40cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 --2- 172.21.15.18:0/521715056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa406b830 0x7ffaa40cfc20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009d90 tx=0x7ffa9c01c8e0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 -- 172.21.15.18:0/521715056 shutdown_connections 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 --2- 172.21.15.18:0/521715056 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa406b830 0x7ffaa40cfc20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 --2- 172.21.15.18:0/521715056 >> v2:172.21.15.81:3300/0 conn(0x7ffaa40b7640 0x7ffaa40cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 -- 172.21.15.18:0/521715056 >> 172.21.15.18:0/521715056 conn(0x7ffaa40d1cb0 msgr2=0x7ffaa40d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabc6ffd640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] conn(0x7fabb4070050 0x7fabb4072480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a3959a640 1 -- 172.21.15.18:0/1250150387 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300aab40 con 0x7f6a3c0b7520 2023-06-09T04:38:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 -- 172.21.15.18:0/1250150387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0b7520 msgr2=0x7f6a3c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 --2- 172.21.15.18:0/1250150387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0d1190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c06ca30 tx=0x7f6a3001c4d0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- start start 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e4069f90 0x7f06e40c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e415fa50 0x7f06e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e415e650 con 0x7f06e415fa50 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41526c0 con 0x7f06e4069f90 2023-06-09T04:38:36.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06ea9f4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e415e2b0 con 0x7f06e415f680 2023-06-09T04:38:36.693 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 -- 172.21.15.18:0/1250150387 shutdown_connections 2023-06-09T04:38:36.693 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 --2- 172.21.15.18:0/1250150387 >> v2:172.21.15.18:3300/0 conn(0x7f6a3c06a4e0 0x7f6a3c06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.693 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 --2- 172.21.15.18:0/1250150387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0d1190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.693 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 -- 172.21.15.18:0/1250150387 >> 172.21.15.18:0/1250150387 conn(0x7f6a3c0d1c40 msgr2=0x7f6a3c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e4069f90 0x7f06e40c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e4069f90 0x7f06e40c0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33512/0 (socket says 172.21.15.18:33512) 2023-06-09T04:38:36.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 -- 172.21.15.18:0/2951997446 learned_addr learned my addr 172.21.15.18:0/2951997446 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 -- 172.21.15.18:0/1250150387 shutdown_connections 2023-06-09T04:38:36.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e37fe640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 -- 172.21.15.18:0/521715056 shutdown_connections 2023-06-09T04:38:36.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== osd.0 v2:172.21.15.18:6800/1873893604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fabb4072b50 con 0x7fabb4070050 2023-06-09T04:38:36.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 -- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 msgr2=0x7f06e40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 -- 172.21.15.18:0/2951997446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e415fa50 msgr2=0x7f06e406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06e415fa50 0x7f06e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e3fff640 1 -- 172.21.15.18:0/2951997446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009420 con 0x7f06e4069f90 2023-06-09T04:38:36.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f06e37fe640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06e415f680 0x7f06e40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:36.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f6a40d81640 1 -- 172.21.15.18:0/1250150387 wait complete. 2023-06-09T04:38:36.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7ffaaaa47640 1 -- 172.21.15.18:0/521715056 wait complete. 2023-06-09T04:38:36.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06e3fff640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e4069f90 0x7f06e40c0d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06d800e930 tx=0x7f06d800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 Processor -- start 2023-06-09T04:38:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- start start 2023-06-09T04:38:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 0x7f0f18152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1815f9c0 0x7f0f18157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f18158530 0x7f0f181558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18156da0 con 0x7f0f18158530 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181589a0 con 0x7f0f1815f9c0 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f1dd98640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1815a880 con 0x7f0f180cb970 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1815f9c0 0x7f0f18157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1815f9c0 0x7f0f18157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33518/0 (socket says 172.21.15.18:33518) 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f0f17fff640 1 -- 172.21.15.18:0/3777287923 learned_addr learned my addr 172.21.15.18:0/3777287923 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 0x7f0f18152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f1d597640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f18158530 0x7f0f181558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f428559a640 1 -- 172.21.15.18:0/935878651 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887559353 0 0) 0x7f4288069350 con 0x7f42880c0f80 2023-06-09T04:38:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f4286d9d640 1 --2- 172.21.15.18:0/935878651 >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 0x7f42880708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f4286d9d640 1 -- 172.21.15.18:0/935878651 >> v1:172.21.15.81:6789/0 conn(0x7f42880c0f80 legacy=0x7f428806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.659+0000 7f4286d9d640 1 -- 172.21.15.18:0/935878651 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880698d0 con 0x7f4288070270 2023-06-09T04:38:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428659c640 1 --2- 172.21.15.18:0/935878651 >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 0x7f42880708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 Processor -- start 2023-06-09T04:38:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 Processor -- start 2023-06-09T04:38:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8009690 con 0x7f06e4069f90 2023-06-09T04:38:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800c980 con 0x7f06e4069f90 2023-06-09T04:38:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800ccf0 con 0x7f06e4069f90 2023-06-09T04:38:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e4200c90 con 0x7f06e4069f90 2023-06-09T04:38:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e40b41d0 con 0x7f06e4069f90 2023-06-09T04:38:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f17fff640 1 -- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 msgr2=0x7f0f18152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f17fff640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f180cb970 0x7f0f18152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f17fff640 1 -- 172.21.15.18:0/3777287923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f18158530 msgr2=0x7f0f181558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f17fff640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f18158530 0x7f0f181558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f17fff640 1 -- 172.21.15.18:0/3777287923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10009a70 con 0x7f0f1815f9c0 2023-06-09T04:38:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f17fff640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1815f9c0 0x7f0f18157230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800e890 tx=0x7f0f0800ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f4286d9d640 1 --2- 172.21.15.18:0/935878651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f428806a0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42880cc140 tx=0x7f428001d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=147e8f14afcd71bf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428559a640 1 -- 172.21.15.18:0/935878651 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800a58e0 con 0x7f4288070270 2023-06-09T04:38:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428559a640 1 -- 172.21.15.18:0/935878651 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42800a5a40 con 0x7f4288070270 2023-06-09T04:38:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428559a640 1 -- 172.21.15.18:0/935878651 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800a5dd0 con 0x7f4288070270 2023-06-09T04:38:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800c940 con 0x7f0f1815f9c0 2023-06-09T04:38:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0800caa0 con 0x7f0f1815f9c0 2023-06-09T04:38:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800ce30 con 0x7f0f1815f9c0 2023-06-09T04:38:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 -- start start 2023-06-09T04:38:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c15f9c0 0x7f6a3c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6a3c0cb930 0x7f6a3c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cafe0 con 0x7f6a3c0b7520 2023-06-09T04:38:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0ca180 con 0x7f6a3c15f9c0 2023-06-09T04:38:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0ca460 con 0x7f6a3c0cb930 2023-06-09T04:38:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 -- start start 2023-06-09T04:38:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa4069cc0 0x7ffaa40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa406b830 0x7ffaa40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa40b7640 0x7ffaa40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4156d40 con 0x7ffaa4069cc0 2023-06-09T04:38:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40c8060 con 0x7ffaa406b830 2023-06-09T04:38:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaaaa47640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40c8340 con 0x7ffaa40b7640 2023-06-09T04:38:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1815ab60 con 0x7f0f1815f9c0 2023-06-09T04:38:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f18156a30 con 0x7f0f1815f9c0 2023-06-09T04:38:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58388/0 (socket says 172.21.15.18:58388) 2023-06-09T04:38:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 -- 172.21.15.18:0/870433670 learned_addr learned my addr 172.21.15.18:0/870433670 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a39d9b640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c15f9c0 0x7f6a3c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3ad9d640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6a3c0cb930 0x7f6a3c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 -- 172.21.15.18:0/935878651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 msgr2=0x7f428806a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 --2- 172.21.15.18:0/935878651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f428806a0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42880cc140 tx=0x7f428001d3b0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa4069cc0 0x7ffaa40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa4069cc0 0x7ffaa40b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58396/0 (socket says 172.21.15.18:58396) 2023-06-09T04:38:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 -- 172.21.15.18:0/916603110 learned_addr learned my addr 172.21.15.18:0/916603110 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa37fe640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa406b830 0x7ffaa40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06e415e110 con 0x7f06e4069f90 2023-06-09T04:38:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 -- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6a3c0cb930 msgr2=0x7f6a3c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6a3c0cb930 0x7f6a3c0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 -- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c15f9c0 msgr2=0x7f6a3c0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a3c15f9c0 0x7f6a3c0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 -- 172.21.15.18:0/870433670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300094d0 con 0x7f6a3c0b7520 2023-06-09T04:38:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 -- 172.21.15.18:0/935878651 shutdown_connections 2023-06-09T04:38:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 --2- 172.21.15.18:0/935878651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f428806a0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 --2- 172.21.15.18:0/935878651 >> v2:172.21.15.18:3300/0 conn(0x7f428815f8f0 0x7f42880708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 -- 172.21.15.18:0/935878651 >> 172.21.15.18:0/935878651 conn(0x7f42880b0240 msgr2=0x7f42880cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 -- 172.21.15.18:0/935878651 shutdown_connections 2023-06-09T04:38:36.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f428cbf5640 1 -- 172.21.15.18:0/935878651 wait complete. 2023-06-09T04:38:36.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 -- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa40b7640 msgr2=0x7ffaa40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaa40b7640 0x7ffaa40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 -- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa406b830 msgr2=0x7ffaa40b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaa406b830 0x7ffaa40b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 -- 172.21.15.18:0/916603110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009a70 con 0x7ffaa4069cc0 2023-06-09T04:38:36.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f1804dea0 con 0x7f0f1815f9c0 2023-06-09T04:38:36.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a3a59c640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0c5ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6a3001a100 tx=0x7f6a3001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18d000b990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f18e806b770 tx=0x7f18d801cd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eef140ac85fdac0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7ffaa3fff640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa4069cc0 0x7ffaa40b1510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c7f0 tx=0x7ffa9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300b3800 con 0x7f6a3c0b7520 2023-06-09T04:38:36.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a300b3960 con 0x7f6a3c0b7520 2023-06-09T04:38:36.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300b3d10 con 0x7f6a3c0b7520 2023-06-09T04:38:36.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 -- 172.21.15.18:0/870433670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c0ca740 con 0x7f6a3c0b7520 2023-06-09T04:38:36.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.663+0000 7f6a40d81640 1 -- 172.21.15.18:0/870433670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c0cad00 con 0x7f6a3c0b7520 2023-06-09T04:38:36.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 Processor -- start 2023-06-09T04:38:36.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a14000fd0 con 0x7f6a3c0b7520 2023-06-09T04:38:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06d8013470 con 0x7f06e4069f90 2023-06-09T04:38:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98004220 con 0x7ffaa4069cc0 2023-06-09T04:38:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98004380 con 0x7ffaa4069cc0 2023-06-09T04:38:36.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98003860 con 0x7ffaa4069cc0 2023-06-09T04:38:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e0ff9640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06c8066280 0x7f06c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06d8084560 con 0x7f06e4069f90 2023-06-09T04:38:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e0ff9640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] conn(0x7f06c806fed0 0x7f06c8072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 --> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c80729d0 con 0x7f06c806fed0 2023-06-09T04:38:36.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d8084980 con 0x7f06e4069f90 2023-06-09T04:38:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaaaa47640 1 -- 172.21.15.18:0/916603110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40c8620 con 0x7ffaa4069cc0 2023-06-09T04:38:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaaaa47640 1 -- 172.21.15.18:0/916603110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa40b1a50 con 0x7ffaa4069cc0 2023-06-09T04:38:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f08013470 con 0x7f0f1815f9c0 2023-06-09T04:38:36.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f157fa640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f040662b0 0x7f0f04068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e37fe640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06c8066280 0x7f06c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f080844a0 con 0x7f0f1815f9c0 2023-06-09T04:38:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f157fa640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] conn(0x7f0f0406ff00 0x7f0f04072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 --> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f04072a00 con 0x7f0f0406ff00 2023-06-09T04:38:36.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f080848f0 con 0x7f0f1815f9c0 2023-06-09T04:38:36.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e8f91640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] conn(0x7f06c806fed0 0x7f06c8072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e37fe640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06c8066280 0x7f06c8068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06e40c8c90 tx=0x7f06dc009610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a300c6390 con 0x7f6a3c0b7520 2023-06-09T04:38:36.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a2affd640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6a1c066350 0x7f6a1c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a3011ecb0 con 0x7f6a3c0b7520 2023-06-09T04:38:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a2affd640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] conn(0x7f6a1c070020 0x7f6a1c072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 --> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a1c072b20 con 0x7f6a1c070020 2023-06-09T04:38:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a3011f060 con 0x7f6a3c0b7520 2023-06-09T04:38:36.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f06e8f91640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] conn(0x7f06c806fed0 0x7f06c8072300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80a5950 con 0x7f18d0005180 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d80a5ad0 con 0x7f18d0005180 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18e559a640 1 -- 172.21.15.18:0/3342911554 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80a5e80 con 0x7f18d0005180 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18ecde6640 1 -- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 msgr2=0x7f18d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18ecde6640 1 --2- 172.21.15.18:0/3342911554 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18d000b990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f18e806b770 tx=0x7f18d801cd10 comp rx=0 tx=0).stop 2023-06-09T04:38:36.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18e6d9d640 1 -- 172.21.15.18:0/3342911554 reap_dead start 2023-06-09T04:38:36.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 -- start start 2023-06-09T04:38:36.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f42880c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42880c0f80 0x7f428815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f428815f8f0 0x7f42881502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c3ca0 con 0x7f42880c0f80 2023-06-09T04:38:36.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c3f80 con 0x7f4288070270 2023-06-09T04:38:36.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428cbf5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c4260 con 0x7f428815f8f0 2023-06-09T04:38:36.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f42880c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a3ad9d640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] conn(0x7f6a1c070020 0x7f6a1c072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f6a39d9b640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6a1c066350 0x7f6a1c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa98003bd0 con 0x7ffaa4069cc0 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaa0ff9640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffa900662d0 0x7ffa90068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa98084260 con 0x7ffaa4069cc0 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f1d597640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] conn(0x7f0f0406ff00 0x7f0f04072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f040662b0 0x7f0f04068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f42880c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33546/0 (socket says 172.21.15.18:33546) 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f428659c640 1 -- 172.21.15.18:0/1721076863 learned_addr learned my addr 172.21.15.18:0/1721076863 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f4285d9b640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42880c0f80 0x7f428815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18ecde6640 1 -- 172.21.15.18:0/3342911554 shutdown_connections 2023-06-09T04:38:36.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18ecde6640 1 -- 172.21.15.18:0/3342911554 >> 172.21.15.18:0/3342911554 conn(0x7f18e80b0240 msgr2=0x7f18e80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.667+0000 7f18ecde6640 1 -- 172.21.15.18:0/3342911554 shutdown_connections 2023-06-09T04:38:36.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7ffaa37fe640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffa900662d0 0x7ffa90068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 -- 172.21.15.18:0/3342911554 wait complete. 2023-06-09T04:38:36.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f4286d9d640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f428815f8f0 0x7f42881502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f6a3ad9d640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] conn(0x7f6a1c070020 0x7f6a1c072450 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428659c640 1 -- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f428815f8f0 msgr2=0x7f42881502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428659c640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f428815f8f0 0x7f42881502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428659c640 1 -- 172.21.15.18:0/1721076863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42880c0f80 msgr2=0x7f428815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428659c640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42880c0f80 0x7f428815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428659c640 1 -- 172.21.15.18:0/1721076863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0094d0 con 0x7f4288070270 2023-06-09T04:38:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f0f1cd96640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f040662b0 0x7f0f04068760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f100af000 tx=0x7f0f100a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7ffaaaa47640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] conn(0x7ffa840015f0 0x7ffa84003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7ffaaaa47640 1 -- 172.21.15.18:0/916603110 --> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa84006b40 con 0x7ffa840015f0 2023-06-09T04:38:36.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7ffaa37fe640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffa900662d0 0x7ffa90068780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4154710 tx=0x7ffa94007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f6a39d9b640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6a1c066350 0x7f6a1c068800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0cd1f0 tx=0x7f6a34009990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428659c640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f42880c3680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f427c00e930 tx=0x7f427c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f0f1d597640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] conn(0x7f0f0406ff00 0x7f0f04072330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00ca00 con 0x7f4288070270 2023-06-09T04:38:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c00cb60 con 0x7f4288070270 2023-06-09T04:38:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428cbf5640 1 -- 172.21.15.18:0/1721076863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280009a70 con 0x7f4288070270 2023-06-09T04:38:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428cbf5640 1 -- 172.21.15.18:0/1721076863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4288155060 con 0x7f4288070270 2023-06-09T04:38:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c013470 con 0x7f4288070270 2023-06-09T04:38:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 Processor -- start 2023-06-09T04:38:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 -- start start 2023-06-09T04:38:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f428cbf5640 1 -- 172.21.15.18:0/1721076863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f426c000fd0 con 0x7f4288070270 2023-06-09T04:38:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7ffaa8fe4640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] conn(0x7ffa840015f0 0x7ffa84003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== osd.4 v2:172.21.15.81:6800/2322864303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06c80729d0 con 0x7f06c806fed0 2023-06-09T04:38:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18e80c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18e8160e30 0x7f18e81fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e8162400 0x7f18e8162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8162db0 con 0x7f18e8160e30 2023-06-09T04:38:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81613f0 con 0x7f18e8162400 2023-06-09T04:38:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18ecde6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81616d0 con 0x7f18d0005180 2023-06-09T04:38:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== osd.5 v2:172.21.15.81:6802/1268428013 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0f04072a00 con 0x7f0f0406ff00 2023-06-09T04:38:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18e5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18e8160e30 0x7f18e81fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18e5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18e8160e30 0x7f18e81fd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58412/0 (socket says 172.21.15.18:58412) 2023-06-09T04:38:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18e5d9b640 1 -- 172.21.15.18:0/3356201805 learned_addr learned my addr 172.21.15.18:0/3356201805 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e8162400 0x7f18e8162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7f18e659c640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18e80c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.671+0000 7ffaa8fe4640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] conn(0x7ffa840015f0 0x7ffa84003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18e5d9b640 1 -- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 msgr2=0x7f18e80c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18e5d9b640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d0005180 0x7f18e80c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18e5d9b640 1 -- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e8162400 msgr2=0x7f18e8162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18e5d9b640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e8162400 0x7f18e8162870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18e5d9b640 1 -- 172.21.15.18:0/3356201805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e81619b0 con 0x7f18e8160e30 2023-06-09T04:38:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 Processor -- start 2023-06-09T04:38:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18e5d9b640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18e8160e30 0x7f18e81fd4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f18dc001210 tx=0x7f18dc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc007760 con 0x7f18e8160e30 2023-06-09T04:38:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18ecde6640 1 -- 172.21.15.18:0/3356201805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e80c13c0 con 0x7f18e8160e30 2023-06-09T04:38:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18ecde6640 1 -- 172.21.15.18:0/3356201805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e8159fb0 con 0x7f18e8160e30 2023-06-09T04:38:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f427c0135d0 con 0x7f4288070270 2023-06-09T04:38:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4276ffd640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4268066280 0x7f4268068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f427c084580 con 0x7f4288070270 2023-06-09T04:38:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4276ffd640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] conn(0x7f426806fe50 0x7f4268072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 --> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4268072950 con 0x7f426806fe50 2023-06-09T04:38:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f427c0849d0 con 0x7f4288070270 2023-06-09T04:38:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 -- start start 2023-06-09T04:38:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 0x7f299815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cbe60 0x7f299806c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29980cc2b0 0x7f299806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299815c710 con 0x7f29980cc2b0 2023-06-09T04:38:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980cd410 con 0x7f29980cd040 2023-06-09T04:38:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f299d084640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980c9470 con 0x7f29980cbe60 2023-06-09T04:38:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18ecde6640 1 -- 172.21.15.18:0/3356201805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18e8070ea0 con 0x7f18e8160e30 2023-06-09T04:38:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== osd.3 v2:172.21.15.18:6816/3842375988 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffa84006b40 con 0x7ffa840015f0 2023-06-09T04:38:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4285d9b640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4268066280 0x7f4268068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f2996d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 0x7f299815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f2996d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 0x7f299815b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33562/0 (socket says 172.21.15.18:33562) 2023-06-09T04:38:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f2996d9d640 1 -- 172.21.15.18:0/2629575500 learned_addr learned my addr 172.21.15.18:0/2629575500 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f298ffff640 1 --2- 172.21.15.18:0/2629575500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cbe60 0x7f299806c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4285d9b640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4268066280 0x7f4268068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42881513f0 tx=0x7f4278009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f4286d9d640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] conn(0x7f426806fe50 0x7f4268072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f298ffff640 1 -- 172.21.15.18:0/2629575500 >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 msgr2=0x7f299815b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f298ffff640 1 --2- 172.21.15.18:0/2629575500 >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 0x7f299815b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f298ffff640 1 -- 172.21.15.18:0/2629575500 >> v2:172.21.15.18:3300/0 conn(0x7f29980cc2b0 msgr2=0x7f299806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f298ffff640 1 --2- 172.21.15.18:0/2629575500 >> v2:172.21.15.18:3300/0 conn(0x7f29980cc2b0 0x7f299806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f298ffff640 1 -- 172.21.15.18:0/2629575500 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980c8e80 con 0x7f29980cbe60 2023-06-09T04:38:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f2996d9d640 1 --2- 172.21.15.18:0/2629575500 >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 0x7f299815b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.675+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc011790 con 0x7f18e8160e30 2023-06-09T04:38:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011b40 con 0x7f18e8160e30 2023-06-09T04:38:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18dc011ca0 con 0x7f18e8160e30 2023-06-09T04:38:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f4286d9d640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] conn(0x7f426806fe50 0x7f4268072280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== osd.6 v2:172.21.15.81:6817/2275675681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6a1c072b20 con 0x7f6a1c070020 2023-06-09T04:38:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f18c8066300 0x7f18c80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18dc086c10 con 0x7f18e8160e30 2023-06-09T04:38:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18e659c640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f18c8066300 0x7f18c80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] conn(0x7f18c806fe60 0x7f18c8072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 --> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18c8072960 con 0x7f18c806fe60 2023-06-09T04:38:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18dc08b2a0 con 0x7f18e8160e30 2023-06-09T04:38:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f18e659c640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f18c8066300 0x7f18c80687b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18e0003730 tx=0x7f18e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== osd.7 v2:172.21.15.81:6816/2314094884 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4268072950 con 0x7f426806fe50 2023-06-09T04:38:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.679+0000 7f298ffff640 1 --2- 172.21.15.18:0/2629575500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cbe60 0x7f299806c420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29980cbe10 tx=0x7f298801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899decba97cc361d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299659c640 1 -- 172.21.15.18:0/2629575500 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880ad680 con 0x7f29980cbe60 2023-06-09T04:38:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299659c640 1 -- 172.21.15.18:0/2629575500 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880ad7e0 con 0x7f29980cbe60 2023-06-09T04:38:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299659c640 1 -- 172.21.15.18:0/2629575500 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880adb70 con 0x7f29980cbe60 2023-06-09T04:38:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] conn(0x7f18c806fe60 0x7f18c8072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 -- 172.21.15.18:0/2629575500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cbe60 msgr2=0x7f299806c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 --2- 172.21.15.18:0/2629575500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cbe60 0x7f299806c420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29980cbe10 tx=0x7f298801c460 comp rx=0 tx=0).stop 2023-06-09T04:38:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 -- 172.21.15.18:0/2629575500 shutdown_connections 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 --2- 172.21.15.18:0/2629575500 >> v2:172.21.15.18:3300/0 conn(0x7f29980cc2b0 0x7f299806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 --2- 172.21.15.18:0/2629575500 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cbe60 0x7f299806c420 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 --2- 172.21.15.18:0/2629575500 >> v2:172.21.15.81:3300/0 conn(0x7f29980cd040 0x7f299815b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 -- 172.21.15.18:0/2629575500 >> 172.21.15.18:0/2629575500 conn(0x7f29980b0ab0 msgr2=0x7f29980ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 -- 172.21.15.18:0/2629575500 shutdown_connections 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.683+0000 7f299d084640 1 -- 172.21.15.18:0/2629575500 wait complete. 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 Processor -- start 2023-06-09T04:38:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 -- start start 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29980cbe60 0x7f29980b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29980cc2b0 0x7f299814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cd040 0x7f299814f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b1ec0 con 0x7f29980cbe60 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980b21a0 con 0x7f29980cc2b0 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299d084640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980c5400 con 0x7f29980cd040 2023-06-09T04:38:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29980cbe60 0x7f29980b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29980cbe60 0x7f29980b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58428/0 (socket says 172.21.15.18:58428) 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 -- 172.21.15.18:0/2963599738 learned_addr learned my addr 172.21.15.18:0/2963599738 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f298ffff640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29980cc2b0 0x7f299814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f299759e640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cd040 0x7f299814f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 -- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cd040 msgr2=0x7f299814f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29980cd040 0x7f299814f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 -- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29980cc2b0 msgr2=0x7f299814ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29980cc2b0 0x7f299814ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.687+0000 7f2996d9d640 1 -- 172.21.15.18:0/2963599738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009420 con 0x7f29980cbe60 2023-06-09T04:38:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f2996d9d640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29980cbe60 0x7f29980b3350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f298000dbd0 tx=0x7f298000a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f18e6d9d640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] conn(0x7f18c806fe60 0x7f18c8072290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980009030 con 0x7f29980cbe60 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f299d084640 1 -- 172.21.15.18:0/2963599738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29980c56e0 con 0x7f29980cbe60 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== osd.2 v2:172.21.15.18:6818/676299974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f18c8072960 con 0x7f18c806fe60 2023-06-09T04:38:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 --> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f18156bc0 con 0x7f0f0406ff00 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7fabcdd3b640 1 -- 172.21.15.18:0/1743142605 --> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabc806a450 con 0x7fabb4070050 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7fabaffff640 1 -- 172.21.15.18:0/1743142605 <== osd.0 v2:172.21.15.18:6800/1873893604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fabc000c880 con 0x7fabb4070050 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.691+0000 7f299d084640 1 -- 172.21.15.18:0/2963599738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29980b3890 con 0x7f29980cbe60 2023-06-09T04:38:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2980004030 con 0x7f29980cbe60 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] conn(0x7fabb4070050 msgr2=0x7fabb4072480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:6800/1873893604,v1:172.21.15.18:6801/1873893604] conn(0x7fabb4070050 0x7fabb4072480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29800043a0 con 0x7f29980cbe60 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fabb4066380 msgr2=0x7fabb4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fabb4066380 0x7fabb4068830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009c20 tx=0x7fabbc009190 comp rx=0 tx=0).stop 2023-06-09T04:38:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2980003620 con 0x7f29980cbe60 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabc80b2e10 msgr2=0x7fabc80c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 --2- 172.21.15.18:0/1743142605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabc80b2e10 0x7fabc80c4ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ab000 tx=0x7fabb8019160 comp rx=0 tx=0).stop 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabc7fff640 1 -- 172.21.15.18:0/1743142605 reap_dead start 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 shutdown_connections 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 >> 172.21.15.18:0/1743142605 conn(0x7fabc80ce520 msgr2=0x7fabc80c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 shutdown_connections 2023-06-09T04:38:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7fabadffb640 1 -- 172.21.15.18:0/1743142605 wait complete. 2023-06-09T04:38:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f157fa640 1 -- 172.21.15.18:0/3777287923 <== osd.5 v2:172.21.15.81:6802/1268428013 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f18156bc0 con 0x7f0f0406ff00 2023-06-09T04:38:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7ffaaaa47640 1 -- 172.21.15.18:0/916603110 --> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa84005bc0 con 0x7ffa840015f0 2023-06-09T04:38:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f298f7fe640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f297c0663d0 0x7f297c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] conn(0x7f0f0406ff00 msgr2=0x7f0f04072330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6802/1268428013,v1:172.21.15.81:6805/1268428013] conn(0x7f0f0406ff00 0x7f0f04072330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f040662b0 msgr2=0x7f0f04068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f040662b0 0x7f0f04068760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f100af000 tx=0x7f0f100a7070 comp rx=0 tx=0).stop 2023-06-09T04:38:36.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1815f9c0 msgr2=0x7f0f18157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 --2- 172.21.15.18:0/3777287923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f1815f9c0 0x7f0f18157230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800e890 tx=0x7f0f0800ed50 comp rx=0 tx=0).stop 2023-06-09T04:38:36.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7ffaa0ff9640 1 -- 172.21.15.18:0/916603110 <== osd.3 v2:172.21.15.18:6816/3842375988 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa84005bc0 con 0x7ffa840015f0 2023-06-09T04:38:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1d597640 1 -- 172.21.15.18:0/3777287923 reap_dead start 2023-06-09T04:38:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 shutdown_connections 2023-06-09T04:38:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 >> 172.21.15.18:0/3777287923 conn(0x7f0f180cd860 msgr2=0x7f0f1806fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 shutdown_connections 2023-06-09T04:38:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f0f1dd98640 1 -- 172.21.15.18:0/3777287923 wait complete. 2023-06-09T04:38:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2980085020 con 0x7f29980cbe60 2023-06-09T04:38:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f298ffff640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f297c0663d0 0x7f297c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f299d084640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] conn(0x7f29700015f0 0x7f2970003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.695+0000 7f299d084640 1 -- 172.21.15.18:0/2963599738 --> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2970006b40 con 0x7f29700015f0 2023-06-09T04:38:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] conn(0x7ffa840015f0 msgr2=0x7ffa84003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:6816/3842375988,v1:172.21.15.18:6817/3842375988] conn(0x7ffa840015f0 0x7ffa84003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffa900662d0 msgr2=0x7ffa90068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ffa900662d0 0x7ffa90068780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4154710 tx=0x7ffa94007d60 comp rx=0 tx=0).stop 2023-06-09T04:38:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa4069cc0 msgr2=0x7ffaa40b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 --2- 172.21.15.18:0/916603110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa4069cc0 0x7ffaa40b1510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c7f0 tx=0x7ffa9800ccb0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffaa8fe4640 1 -- 172.21.15.18:0/916603110 reap_dead start 2023-06-09T04:38:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7f298ffff640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f297c0663d0 0x7f297c068880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29880af000 tx=0x7f29880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7f299759e640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] conn(0x7f29700015f0 0x7f2970003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 shutdown_connections 2023-06-09T04:38:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 >> 172.21.15.18:0/916603110 conn(0x7ffaa40d1cb0 msgr2=0x7ffaa40d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 shutdown_connections 2023-06-09T04:38:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7ffa8a7fc640 1 -- 172.21.15.18:0/916603110 wait complete. 2023-06-09T04:38:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7f299759e640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] conn(0x7f29700015f0 0x7f2970003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 --> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06e40669a0 con 0x7f06c806fed0 2023-06-09T04:38:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== osd.1 v2:172.21.15.18:6808/3186243316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2970006b40 con 0x7f29700015f0 2023-06-09T04:38:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.699+0000 7f06e0ff9640 1 -- 172.21.15.18:0/2951997446 <== osd.4 v2:172.21.15.81:6800/2322864303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06e40669a0 con 0x7f06c806fed0 2023-06-09T04:38:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 --> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a14002cc0 con 0x7f6a1c070020 2023-06-09T04:38:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] conn(0x7f06c806fed0 msgr2=0x7f06c8072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6800/2322864303,v1:172.21.15.81:6801/2322864303] conn(0x7f06c806fed0 0x7f06c8072300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06c8066280 msgr2=0x7f06c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06c8066280 0x7f06c8068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06e40c8c90 tx=0x7f06dc009610 comp rx=0 tx=0).stop 2023-06-09T04:38:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e4069f90 msgr2=0x7f06e40c0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 --2- 172.21.15.18:0/2951997446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06e4069f90 0x7f06e40c0d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06d800e930 tx=0x7f06d800edf0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06e8f91640 1 -- 172.21.15.18:0/2951997446 reap_dead start 2023-06-09T04:38:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 shutdown_connections 2023-06-09T04:38:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 >> 172.21.15.18:0/2951997446 conn(0x7f06e40cb440 msgr2=0x7f06e40cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 shutdown_connections 2023-06-09T04:38:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f06ea9f4640 1 -- 172.21.15.18:0/2951997446 wait complete. 2023-06-09T04:38:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.703+0000 7f6a2affd640 1 -- 172.21.15.18:0/870433670 <== osd.6 v2:172.21.15.81:6817/2275675681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a14002cc0 con 0x7f6a1c070020 2023-06-09T04:38:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] conn(0x7f6a1c070020 msgr2=0x7f6a1c072450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6817/2275675681,v1:172.21.15.81:6819/2275675681] conn(0x7f6a1c070020 0x7f6a1c072450 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f428cbf5640 1 -- 172.21.15.18:0/1721076863 --> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f426c002cc0 con 0x7f426806fe50 2023-06-09T04:38:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6a1c066350 msgr2=0x7f6a1c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6a1c066350 0x7f6a1c068800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0cd1f0 tx=0x7f6a34009990 comp rx=0 tx=0).stop 2023-06-09T04:38:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a3c0b7520 msgr2=0x7f6a3c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 --2- 172.21.15.18:0/870433670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a3c0b7520 0x7f6a3c0c5ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6a3001a100 tx=0x7f6a3001ad10 comp rx=0 tx=0).stop 2023-06-09T04:38:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a3ad9d640 1 -- 172.21.15.18:0/870433670 reap_dead start 2023-06-09T04:38:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 shutdown_connections 2023-06-09T04:38:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 >> 172.21.15.18:0/870433670 conn(0x7f6a3c0d1c40 msgr2=0x7f6a3c0b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.707+0000 7f4276ffd640 1 -- 172.21.15.18:0/1721076863 <== osd.7 v2:172.21.15.81:6816/2314094884 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f426c002cc0 con 0x7f426806fe50 2023-06-09T04:38:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 shutdown_connections 2023-06-09T04:38:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] conn(0x7f426806fe50 msgr2=0x7f4268072280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6816/2314094884,v1:172.21.15.81:6818/2314094884] conn(0x7f426806fe50 0x7f4268072280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f6a28ff9640 1 -- 172.21.15.18:0/870433670 wait complete. 2023-06-09T04:38:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4268066280 msgr2=0x7f4268068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4268066280 0x7f4268068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42881513f0 tx=0x7f4278009040 comp rx=0 tx=0).stop 2023-06-09T04:38:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 msgr2=0x7f42880c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 --2- 172.21.15.18:0/1721076863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4288070270 0x7f42880c3680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f427c00e930 tx=0x7f427c00edf0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4286d9d640 1 -- 172.21.15.18:0/1721076863 reap_dead start 2023-06-09T04:38:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 shutdown_connections 2023-06-09T04:38:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 >> 172.21.15.18:0/1721076863 conn(0x7f42880b0240 msgr2=0x7f42880adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 shutdown_connections 2023-06-09T04:38:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.711+0000 7f4274ff9640 1 -- 172.21.15.18:0/1721076863 wait complete. 2023-06-09T04:38:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.719+0000 7f18ecde6640 1 -- 172.21.15.18:0/3356201805 --> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18e8069bb0 con 0x7f18c806fe60 2023-06-09T04:38:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.719+0000 7f18d6ffd640 1 -- 172.21.15.18:0/3356201805 <== osd.2 v2:172.21.15.18:6818/676299974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18d80a5870 con 0x7f18c806fe60 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] conn(0x7f18c806fe60 msgr2=0x7f18c8072290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:6818/676299974,v1:172.21.15.18:6820/676299974] conn(0x7f18c806fe60 0x7f18c8072290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f18c8066300 msgr2=0x7f18c80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f18c8066300 0x7f18c80687b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18e0003730 tx=0x7f18e0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18e8160e30 msgr2=0x7f18e81fd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 --2- 172.21.15.18:0/3356201805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18e8160e30 0x7f18e81fd4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f18dc001210 tx=0x7f18dc007430 comp rx=0 tx=0).stop 2023-06-09T04:38:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18e6d9d640 1 -- 172.21.15.18:0/3356201805 reap_dead start 2023-06-09T04:38:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 shutdown_connections 2023-06-09T04:38:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 >> 172.21.15.18:0/3356201805 conn(0x7f18e80b0240 msgr2=0x7f18e80ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 shutdown_connections 2023-06-09T04:38:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.723+0000 7f18d4ff9640 1 -- 172.21.15.18:0/3356201805 wait complete. 2023-06-09T04:38:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f299d084640 1 -- 172.21.15.18:0/2963599738 --> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2970005c20 con 0x7f29700015f0 2023-06-09T04:38:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298f7fe640 1 -- 172.21.15.18:0/2963599738 <== osd.1 v2:172.21.15.18:6808/3186243316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2970005c20 con 0x7f29700015f0 2023-06-09T04:38:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] conn(0x7f29700015f0 msgr2=0x7f2970003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:6808/3186243316,v1:172.21.15.18:6809/3186243316] conn(0x7f29700015f0 0x7f2970003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f297c0663d0 msgr2=0x7f297c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f297c0663d0 0x7f297c068880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29880af000 tx=0x7f29880a7000 comp rx=0 tx=0).stop 2023-06-09T04:38:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29980cbe60 msgr2=0x7f29980b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 --2- 172.21.15.18:0/2963599738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29980cbe60 0x7f29980b3350 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f298000dbd0 tx=0x7f298000a520 comp rx=0 tx=0).stop 2023-06-09T04:38:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f299759e640 1 -- 172.21.15.18:0/2963599738 reap_dead start 2023-06-09T04:38:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 shutdown_connections 2023-06-09T04:38:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.727+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 >> 172.21.15.18:0/2963599738 conn(0x7f29980b0ab0 msgr2=0x7f29980c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:36.783 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2023-06-09T04:38:36.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:38:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.731+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 shutdown_connections 2023-06-09T04:38:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:36.731+0000 7f298d7fa640 1 -- 172.21.15.18:0/2963599738 wait complete. 2023-06-09T04:38:36.785 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2023-06-09T04:38:36.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:38:36.786 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2023-06-09T04:38:36.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:38:36.787 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2023-06-09T04:38:36.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:38:36.788 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:36.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:38:36.789 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:36.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:38:36.790 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2023-06-09T04:38:36.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:38:36.791 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:36.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:38:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 Processor -- start 2023-06-09T04:38:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 -- start start 2023-06-09T04:38:37.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 Processor -- start 2023-06-09T04:38:37.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fd258491640 1 Processor -- start 2023-06-09T04:38:37.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fd258491640 1 -- start start 2023-06-09T04:38:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc15fae0 0x7f85bc0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f85bc0ade40 0x7f85bc0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0cd260 con 0x7f85bc163480 2023-06-09T04:38:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc1639f0 con 0x7f85bc0ade40 2023-06-09T04:38:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85c1ed0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc163cd0 con 0x7f85bc15fae0 2023-06-09T04:38:37.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85bbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f85bc0ade40 0x7f85bc0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fe58b309640 1 Processor -- start 2023-06-09T04:38:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85bbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f85bc0ade40 0x7f85bc0cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38128/0 (socket says 172.21.15.18:38128) 2023-06-09T04:38:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85bbfff640 1 -- 172.21.15.18:0/4073624947 learned_addr learned my addr 172.21.15.18:0/4073624947 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.008 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f85bb7fe640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc15fae0 0x7f85bc0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 -- start start 2023-06-09T04:38:37.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e015f8f0 0x7f37e00c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f37e00b0a50 0x7f37e00cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e0163c80 con 0x7f37e0164110 2023-06-09T04:38:37.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e00ca250 con 0x7f37e00b0a50 2023-06-09T04:38:37.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37df59e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c9f70 con 0x7f37e015f8f0 2023-06-09T04:38:37.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37de59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e015f8f0 0x7f37e00c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37ded9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f37e00b0a50 0x7f37e00cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fd258491640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2500b3480 0x7fd250069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37de59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e015f8f0 0x7f37e00c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:54332/0 (socket says 172.21.15.18:54332) 2023-06-09T04:38:37.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7f37de59c640 1 -- 172.21.15.18:0/3348928714 learned_addr learned my addr 172.21.15.18:0/3348928714 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd258491640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd2500b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85bbfff640 1 -- 172.21.15.18:0/4073624947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc15fae0 msgr2=0x7f85bc0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85bbfff640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc15fae0 0x7f85bc0b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85bbfff640 1 -- 172.21.15.18:0/4073624947 >> v1:172.21.15.81:6789/0 conn(0x7f85bc163480 legacy=0x7f85bc0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85bbfff640 1 -- 172.21.15.18:0/4073624947 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc163fb0 con 0x7f85bc0ade40 2023-06-09T04:38:37.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85bb7fe640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc15fae0 0x7f85bc0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:37.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd258491640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25006c390 con 0x7fd250157740 2023-06-09T04:38:37.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd258491640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25006a1c0 con 0x7fd2500b3480 2023-06-09T04:38:37.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd258491640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd250157b10 con 0x7fd250069980 2023-06-09T04:38:37.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2500b3480 0x7fd250069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2500b3480 0x7fd250069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39436/0 (socket says 172.21.15.18:39436) 2023-06-09T04:38:37.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 -- 172.21.15.18:0/3550301922 learned_addr learned my addr 172.21.15.18:0/3550301922 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd256a2e640 1 --2- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd2500b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f37ded9d640 1 -- 172.21.15.18:0/3348928714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e015f8f0 msgr2=0x7f37e00c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f37dd59a640 1 -- 172.21.15.18:0/3348928714 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718372097 0 0) 0x7f37e0163c80 con 0x7f37e0164110 2023-06-09T04:38:37.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 -- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 msgr2=0x7fd2500b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 --2- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd2500b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 -- 172.21.15.18:0/3550301922 >> v1:172.21.15.81:6789/0 conn(0x7fd250157740 legacy=0x7fd2500b2d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:38:37.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fd255a2c640 1 -- 172.21.15.18:0/3550301922 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25006ba60 con 0x7fd2500b3480 2023-06-09T04:38:37.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fb7ca88b640 1 Processor -- start 2023-06-09T04:38:37.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fb7ca88b640 1 -- start start 2023-06-09T04:38:37.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f37ded9d640 1 --2- 172.21.15.18:0/3348928714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e015f8f0 0x7f37e00c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f37ded9d640 1 -- 172.21.15.18:0/3348928714 >> v1:172.21.15.18:6789/0 conn(0x7f37e0164110 legacy=0x7f37e00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.003+0000 7fe58b309640 1 -- start start 2023-06-09T04:38:37.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe58b309640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe57c0e6f60 0x7fe57c049df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe58b309640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c036620 con 0x7fe57c051470 2023-06-09T04:38:37.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe58b309640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c037480 con 0x7fe57c0e7330 2023-06-09T04:38:37.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe58b309640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c0577d0 con 0x7fe57c0e6f60 2023-06-09T04:38:37.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f37ded9d640 1 -- 172.21.15.18:0/3348928714 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0163630 con 0x7f37e00b0a50 2023-06-09T04:38:37.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7ca88b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7c406d570 0x7fb7c40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7ca88b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb7c406b910 0x7fb7c415fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7ca88b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c41602a0 con 0x7fb7c406f8b0 2023-06-09T04:38:37.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7ca88b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c40692b0 con 0x7fb7c406b910 2023-06-09T04:38:37.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7ca88b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c4160540 con 0x7fb7c406d570 2023-06-09T04:38:37.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe5890a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe57c0e6f60 0x7fe57c049df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe5890a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe57c0e6f60 0x7fe57c049df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38136/0 (socket says 172.21.15.18:38136) 2023-06-09T04:38:37.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe5890a5640 1 -- 172.21.15.18:0/848934672 learned_addr learned my addr 172.21.15.18:0/848934672 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9889640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7c406d570 0x7fb7c40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb7c406b910 0x7fb7c415fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe5890a5640 1 -- 172.21.15.18:0/848934672 >> v1:172.21.15.81:6789/0 conn(0x7fe57c0e7330 legacy=0x7fe57c037910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe5890a5640 1 -- 172.21.15.18:0/848934672 >> v1:172.21.15.18:6789/0 conn(0x7fe57c051470 legacy=0x7fe57c038020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb7c406b910 0x7fb7c415fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38148/0 (socket says 172.21.15.18:38148) 2023-06-09T04:38:37.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 -- 172.21.15.18:0/1031285682 learned_addr learned my addr 172.21.15.18:0/1031285682 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72f57e8640 1 Processor -- start 2023-06-09T04:38:37.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72f57e8640 1 -- start start 2023-06-09T04:38:37.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 -- 172.21.15.18:0/1031285682 >> v2:172.21.15.81:3300/0 conn(0x7fb7c406d570 msgr2=0x7fb7c40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 --2- 172.21.15.18:0/1031285682 >> v2:172.21.15.81:3300/0 conn(0x7fb7c406d570 0x7fb7c40cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 -- 172.21.15.18:0/1031285682 >> v1:172.21.15.81:6789/0 conn(0x7fb7c406f8b0 legacy=0x7fb7c41632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fb7c9088640 1 -- 172.21.15.18:0/1031285682 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c4160820 con 0x7fb7c406b910 2023-06-09T04:38:37.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85bbfff640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc0ade40 0x7f85bc0cd760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009e50 tx=0x7f85b401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9eadd672d336670 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72f57e8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72e8036d50 0x7f72e804f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72f57e8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e80db150 con 0x7f72e80dad80 2023-06-09T04:38:37.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72f57e8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e80e0c20 con 0x7f72e80e16e0 2023-06-09T04:38:37.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72f57e8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e8037db0 con 0x7f72e8036d50 2023-06-09T04:38:37.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85ba7fc640 1 -- 172.21.15.18:0/4073624947 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40a56c0 con 0x7f85bc0ade40 2023-06-09T04:38:37.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85ba7fc640 1 -- 172.21.15.18:0/4073624947 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b40a5820 con 0x7f85bc0ade40 2023-06-09T04:38:37.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f85ba7fc640 1 -- 172.21.15.18:0/4073624947 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40a5bb0 con 0x7f85bc0ade40 2023-06-09T04:38:37.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72effff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f72e80dad80 0x7f72e80e4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43570/0 (socket says 172.21.15.18:43570) 2023-06-09T04:38:37.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7f72effff640 1 -- 172.21.15.18:0/2149193588 learned_addr learned my addr 172.21.15.18:0/2149193588 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:37.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72f4fe7640 1 --2- 172.21.15.18:0/2149193588 >> v2:172.21.15.81:3300/0 conn(0x7f72e8036d50 0x7f72e804f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd255a2c640 1 --2- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2500b3480 0x7fd250069440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd240007360 tx=0x7fd24001e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1c51e414196014 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd25522b640 1 -- 172.21.15.18:0/3550301922 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240008be0 con 0x7fd2500b3480 2023-06-09T04:38:37.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.007+0000 7fe5890a5640 1 -- 172.21.15.18:0/848934672 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c036870 con 0x7fe57c0e6f60 2023-06-09T04:38:37.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 -- 172.21.15.18:0/4073624947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc0ade40 msgr2=0x7f85bc0cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc0ade40 0x7f85bc0cd760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009e50 tx=0x7f85b401c8a0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 -- 172.21.15.18:0/4073624947 shutdown_connections 2023-06-09T04:38:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc0ade40 0x7f85bc0cd760 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/4073624947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc15fae0 0x7f85bc0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 -- 172.21.15.18:0/4073624947 >> 172.21.15.18:0/4073624947 conn(0x7f85bc0cb410 msgr2=0x7f85bc0cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 -- 172.21.15.18:0/4073624947 shutdown_connections 2023-06-09T04:38:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 -- 172.21.15.18:0/4073624947 wait complete. 2023-06-09T04:38:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff550c3e640 1 Processor -- start 2023-06-09T04:38:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff550c3e640 1 -- start start 2023-06-09T04:38:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff550c3e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff54c15fae0 0x7ff54c0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff550c3e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c0cd260 con 0x7ff54c163480 2023-06-09T04:38:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff550c3e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c1639f0 con 0x7ff54c0ade40 2023-06-09T04:38:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff550c3e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c163cd0 con 0x7ff54c15fae0 2023-06-09T04:38:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2149193588 >> v1:172.21.15.81:6789/0 conn(0x7f72e80e16e0 legacy=0x7f72e8036640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2149193588 >> v1:172.21.15.18:6789/0 conn(0x7f72e80dad80 legacy=0x7f72e80e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2149193588 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8038090 con 0x7f72e8036d50 2023-06-09T04:38:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37ded9d640 1 --2- 172.21.15.18:0/3348928714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e00b0a50 0x7f37e00cc5b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009a20 tx=0x7f37d401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b38a10138c3610b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37dd59a640 1 -- 172.21.15.18:0/3348928714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40a8630 con 0x7f37e00b0a50 2023-06-09T04:38:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd25522b640 1 -- 172.21.15.18:0/3550301922 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240008d40 con 0x7fd2500b3480 2023-06-09T04:38:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd25522b640 1 -- 172.21.15.18:0/3550301922 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24000a2f0 con 0x7fd2500b3480 2023-06-09T04:38:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 -- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2500b3480 msgr2=0x7fd250069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 --2- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2500b3480 0x7fd250069440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd240007360 tx=0x7fd24001e600 comp rx=0 tx=0).stop 2023-06-09T04:38:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 Processor -- start 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 -- start start 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06c80e4740 0x7f06c80eb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f06c80555a0 0x7f06c803aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c803b030 con 0x7f06c8058440 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c8007540 con 0x7f06c80555a0 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d6609640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c803b300 con 0x7f06c80e4740 2023-06-09T04:38:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f06c80555a0 0x7f06c803aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d5607640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06c80e4740 0x7f06c80eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f06c80555a0 0x7f06c803aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38160/0 (socket says 172.21.15.18:38160) 2023-06-09T04:38:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 -- 172.21.15.18:0/820400965 learned_addr learned my addr 172.21.15.18:0/820400965 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37dd59a640 1 -- 172.21.15.18:0/3348928714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d40a8790 con 0x7f37e00b0a50 2023-06-09T04:38:37.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 -- 172.21.15.18:0/3348928714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e00b0a50 msgr2=0x7f37e00cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 -- 172.21.15.18:0/820400965 >> v2:172.21.15.81:3300/0 conn(0x7f06c80e4740 msgr2=0x7f06c80eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 --2- 172.21.15.18:0/820400965 >> v2:172.21.15.81:3300/0 conn(0x7f06c80e4740 0x7f06c80eb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 -- 172.21.15.18:0/820400965 >> v1:172.21.15.81:6789/0 conn(0x7f06c8058440 legacy=0x7f06c80e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f06d4e06640 1 -- 172.21.15.18:0/820400965 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c803b5e0 con 0x7f06c80555a0 2023-06-09T04:38:37.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff549d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff54c163480 0x7ff54c0ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43586/0 (socket says 172.21.15.18:43586) 2023-06-09T04:38:37.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff549d9b640 1 -- 172.21.15.18:0/2820750812 learned_addr learned my addr 172.21.15.18:0/2820750812 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:37.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37dd59a640 1 -- 172.21.15.18:0/3348928714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40a8630 con 0x7f37e00b0a50 2023-06-09T04:38:37.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fe5890a5640 1 --2- 172.21.15.18:0/848934672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e6f60 0x7fe57c049df0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe584072ca0 tx=0x7fe584095930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139f8310cc2debb2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 --2- 172.21.15.18:0/3348928714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e00b0a50 0x7f37e00cc5b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009a20 tx=0x7f37d401c6b0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fe57bfff640 1 -- 172.21.15.18:0/848934672 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584122710 con 0x7fe57c0e6f60 2023-06-09T04:38:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 -- 172.21.15.18:0/3348928714 shutdown_connections 2023-06-09T04:38:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 --2- 172.21.15.18:0/3348928714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e00b0a50 0x7f37e00cc5b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 --2- 172.21.15.18:0/3348928714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e015f8f0 0x7f37e00c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 -- 172.21.15.18:0/3348928714 >> 172.21.15.18:0/3348928714 conn(0x7f37e00cb340 msgr2=0x7f37e00cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 Processor -- start 2023-06-09T04:38:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fe57bfff640 1 -- 172.21.15.18:0/848934672 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584122870 con 0x7fe57c0e6f60 2023-06-09T04:38:37.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fe57bfff640 1 -- 172.21.15.18:0/848934672 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584122ca0 con 0x7fe57c0e6f60 2023-06-09T04:38:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54a59c640 1 --2- 172.21.15.18:0/2820750812 >> v2:172.21.15.18:3300/0 conn(0x7ff54c15fae0 0x7ff54c0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f85c1ed0640 1 -- start start 2023-06-09T04:38:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 -- 172.21.15.18:0/3550301922 shutdown_connections 2023-06-09T04:38:37.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 --2- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd2500b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 --2- 172.21.15.18:0/3550301922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2500b3480 0x7fd250069440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 -- 172.21.15.18:0/3550301922 >> 172.21.15.18:0/3550301922 conn(0x7fd2500ce520 msgr2=0x7fd2500ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368125206 0 0) 0x7ff54c0cd260 con 0x7ff54c163480 2023-06-09T04:38:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 -- 172.21.15.18:0/3550301922 shutdown_connections 2023-06-09T04:38:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff534003530 con 0x7ff54c163480 2023-06-09T04:38:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24075995 0 0) 0x7ff54c1639f0 con 0x7ff54c0ade40 2023-06-09T04:38:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c0cd260 con 0x7ff54c0ade40 2023-06-09T04:38:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72f4fe7640 1 --2- 172.21.15.18:0/2149193588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e804f210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72f0073fc0 tx=0x7f72f0095850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa85e52dcf32dc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fd258491640 1 -- 172.21.15.18:0/3550301922 wait complete. 2023-06-09T04:38:37.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72eeffd640 1 -- 172.21.15.18:0/2149193588 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0127070 con 0x7f72e8036d50 2023-06-09T04:38:37.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72eeffd640 1 -- 172.21.15.18:0/2149193588 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0122540 con 0x7f72e8036d50 2023-06-09T04:38:37.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f72eeffd640 1 -- 172.21.15.18:0/2149193588 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0122970 con 0x7f72e8036d50 2023-06-09T04:38:37.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446938115 0 0) 0x7ff534003530 con 0x7ff54c163480 2023-06-09T04:38:37.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 >> v2:172.21.15.18:3300/0 conn(0x7ff54c15fae0 msgr2=0x7ff54c0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 --2- 172.21.15.18:0/2820750812 >> v2:172.21.15.18:3300/0 conn(0x7ff54c15fae0 0x7ff54c0b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 >> v1:172.21.15.81:6789/0 conn(0x7ff54c0ade40 legacy=0x7ff54c0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 -- 172.21.15.18:0/3348928714 shutdown_connections 2023-06-09T04:38:37.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fb7c9088640 1 --2- 172.21.15.18:0/1031285682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406b910 0x7fb7c415fd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7c406b2d0 tx=0x7fb7b401c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad928c502a2c3e5b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7f37df59e640 1 -- 172.21.15.18:0/3348928714 wait complete. 2023-06-09T04:38:37.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fe58b309640 1 -- 172.21.15.18:0/848934672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e6f60 msgr2=0x7fe57c049df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.011+0000 7fe58b309640 1 --2- 172.21.15.18:0/848934672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e6f60 0x7fe57c049df0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe584072ca0 tx=0x7fe584095930 comp rx=0 tx=0).stop 2023-06-09T04:38:37.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c163fb0 con 0x7ff54c163480 2023-06-09T04:38:37.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7ff53c001680 con 0x7ff54c163480 2023-06-09T04:38:37.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7c8887640 1 -- 172.21.15.18:0/1031285682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40aa650 con 0x7fb7c406b910 2023-06-09T04:38:37.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7c8887640 1 -- 172.21.15.18:0/1031285682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b40aa7b0 con 0x7fb7c406b910 2023-06-09T04:38:37.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7c8887640 1 -- 172.21.15.18:0/1031285682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40aab40 con 0x7fb7c406b910 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85c1ed0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85bc0ade40 0x7f85bc0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85c1ed0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc15fae0 0x7f85bc153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85c1ed0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc163480 0x7f85bc1616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85c1ed0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c2b80 con 0x7f85bc15fae0 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85c1ed0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0b2790 con 0x7f85bc0ade40 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85c1ed0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0b2a70 con 0x7f85bc163480 2023-06-09T04:38:37.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85baffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc15fae0 0x7f85bc153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85baffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc15fae0 0x7f85bc153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38194/0 (socket says 172.21.15.18:38194) 2023-06-09T04:38:37.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85baffd640 1 -- 172.21.15.18:0/1052213303 learned_addr learned my addr 172.21.15.18:0/1052213303 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bb7fe640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85bc0ade40 0x7f85bc0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bbfff640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc163480 0x7f85bc1616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 >> v1:172.21.15.18:6789/0 conn(0x7ff54c163480 legacy=0x7ff54c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff534003b90 0x7ff534003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340047d0 0x7ff534004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5340051d0 0x7ff53400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440014f0 con 0x7ff5340051d0 2023-06-09T04:38:37.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c163cd0 con 0x7ff534003b90 2023-06-09T04:38:37.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53400c160 con 0x7ff5340047d0 2023-06-09T04:38:37.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54ad9d640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5340051d0 0x7ff53400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff549d9b640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340047d0 0x7ff534004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54a59c640 1 --2- 172.21.15.18:0/2820750812 >> v2:172.21.15.18:3300/0 conn(0x7ff54c15fae0 0x7ff54c0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:37.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 -- 172.21.15.18:0/2149193588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 msgr2=0x7f72e804f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2149193588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e804f210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72f0073fc0 tx=0x7f72f0095850 comp rx=0 tx=0).stop 2023-06-09T04:38:37.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 -- 172.21.15.18:0/2149193588 shutdown_connections 2023-06-09T04:38:37.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2149193588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e804f210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 -- 172.21.15.18:0/2149193588 >> 172.21.15.18:0/2149193588 conn(0x7f72e8051640 msgr2=0x7f72e8051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 Processor -- start 2023-06-09T04:38:37.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- 172.21.15.18:0/848934672 shutdown_connections 2023-06-09T04:38:37.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 --2- 172.21.15.18:0/848934672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e6f60 0x7fe57c049df0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- 172.21.15.18:0/848934672 >> 172.21.15.18:0/848934672 conn(0x7fe57c00a760 msgr2=0x7fe57c056e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- 172.21.15.18:0/848934672 shutdown_connections 2023-06-09T04:38:37.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- 172.21.15.18:0/848934672 wait complete. 2023-06-09T04:38:37.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bb7fe640 1 -- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc163480 msgr2=0x7f85bc1616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bb7fe640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc163480 0x7f85bc1616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bb7fe640 1 -- 172.21.15.18:0/1052213303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc15fae0 msgr2=0x7f85bc153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bb7fe640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc15fae0 0x7f85bc153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bb7fe640 1 -- 172.21.15.18:0/1052213303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009420 con 0x7f85bc0ade40 2023-06-09T04:38:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d4e06640 1 --2- 172.21.15.18:0/820400965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c803aaf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f06d0072ca0 tx=0x7f06c80e8140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c906a038800cb3d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f85bbfff640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc163480 0x7f85bc1616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 -- start start 2023-06-09T04:38:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd25014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2500b3480 0x7fd250153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd250157740 0x7fd2501589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd250151900 con 0x7fd2500b3480 2023-06-09T04:38:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25014e480 con 0x7fd250157740 2023-06-09T04:38:37.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd258491640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd250154450 con 0x7fd250069980 2023-06-09T04:38:37.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54ad9d640 1 -- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340047d0 msgr2=0x7ff534004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54ad9d640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340047d0 0x7ff534004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54a59c640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff534003b90 0x7ff534003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54ad9d640 1 -- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff534003b90 msgr2=0x7ff534003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 Processor -- start 2023-06-09T04:38:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd256a2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd250157740 0x7fd2501589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd25014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd256a2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd250157740 0x7fd2501589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39494/0 (socket says 172.21.15.18:39494) 2023-06-09T04:38:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd25014df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:54374/0 (socket says 172.21.15.18:54374) 2023-06-09T04:38:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd256a2e640 1 -- 172.21.15.18:0/324796344 learned_addr learned my addr 172.21.15.18:0/324796344 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06c7fff640 1 -- 172.21.15.18:0/820400965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d01216c0 con 0x7f06c80555a0 2023-06-09T04:38:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06c7fff640 1 -- 172.21.15.18:0/820400965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0121820 con 0x7f06c80555a0 2023-06-09T04:38:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06c7fff640 1 -- 172.21.15.18:0/820400965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0121c50 con 0x7f06c80555a0 2023-06-09T04:38:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 -- 172.21.15.18:0/1031285682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406b910 msgr2=0x7fb7c415fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/1031285682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406b910 0x7fb7c415fd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7c406b2d0 tx=0x7fb7b401c600 comp rx=0 tx=0).stop 2023-06-09T04:38:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd255a2c640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2500b3480 0x7fd250153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 -- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd250157740 msgr2=0x7fd2501589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd250157740 0x7fd2501589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 -- 172.21.15.18:0/324796344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2500b3480 msgr2=0x7fd250153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2500b3480 0x7fd250153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 -- 172.21.15.18:0/324796344 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240007040 con 0x7fd250069980 2023-06-09T04:38:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- start start 2023-06-09T04:38:37.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe57c051470 0x7fe57c0dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0e6f60 0x7fe57c050690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e7330 0x7fe57c034d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c050e50 con 0x7fe57c0e7330 2023-06-09T04:38:37.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c050bd0 con 0x7fe57c0e6f60 2023-06-09T04:38:37.058 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe58b309640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c04a880 con 0x7fe57c051470 2023-06-09T04:38:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 -- 172.21.15.18:0/820400965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 msgr2=0x7f06c803aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 --2- 172.21.15.18:0/820400965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c803aaf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f06d0072ca0 tx=0x7f06c80e8140 comp rx=0 tx=0).stop 2023-06-09T04:38:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 -- 172.21.15.18:0/1031285682 shutdown_connections 2023-06-09T04:38:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/1031285682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406b910 0x7fb7c415fd60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/1031285682 >> v2:172.21.15.81:3300/0 conn(0x7fb7c406d570 0x7fb7c40cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 -- 172.21.15.18:0/1031285682 >> 172.21.15.18:0/1031285682 conn(0x7fb7c40cd860 msgr2=0x7fb7c40cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fb7ca88b640 1 -- 172.21.15.18:0/1031285682 shutdown_connections 2023-06-09T04:38:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 -- 172.21.15.18:0/2149193588 shutdown_connections 2023-06-09T04:38:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5890a5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe57c051470 0x7fe57c0dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5890a5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe57c051470 0x7fe57c0dfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:54376/0 (socket says 172.21.15.18:54376) 2023-06-09T04:38:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5890a5640 1 -- 172.21.15.18:0/3823853082 learned_addr learned my addr 172.21.15.18:0/3823853082 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5888a4640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0e6f60 0x7fe57c050690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 -- 172.21.15.18:0/820400965 shutdown_connections 2023-06-09T04:38:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 --2- 172.21.15.18:0/820400965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c803aaf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 --2- 172.21.15.18:0/820400965 >> v2:172.21.15.81:3300/0 conn(0x7f06c80e4740 0x7f06c80eb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 -- 172.21.15.18:0/820400965 >> 172.21.15.18:0/820400965 conn(0x7f06c8059070 msgr2=0x7f06c8059470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 -- 172.21.15.18:0/820400965 shutdown_connections 2023-06-09T04:38:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e7330 0x7fe57c034d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54ad9d640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff534003b90 0x7ff534003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54ad9d640 1 -- 172.21.15.18:0/2820750812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534003530 con 0x7ff5340051d0 2023-06-09T04:38:37.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff549d9b640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340047d0 0x7ff534004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:37.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7ff54a59c640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff534003b90 0x7ff534003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:37.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f37df59e640 1 Processor -- start 2023-06-09T04:38:37.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f37df59e640 1 -- start start 2023-06-09T04:38:37.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 -- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe57c051470 msgr2=0x7fe57c0dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe57c051470 0x7fe57c0dfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 -- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0e6f60 msgr2=0x7fe57c050690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0e6f60 0x7fe57c050690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 -- 172.21.15.18:0/3823853082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c04f8a0 con 0x7fe57c0e7330 2023-06-09T04:38:37.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fd25622d640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd25014df40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00b410 tx=0x7fd24c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f72f57e8640 1 -- 172.21.15.18:0/2149193588 wait complete. 2023-06-09T04:38:37.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7fe5898a6640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e7330 0x7fe57c034d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c390 tx=0x7fe58000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.015+0000 7f06d6609640 1 -- 172.21.15.18:0/820400965 wait complete. 2023-06-09T04:38:37.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800052d0 con 0x7fe57c0e7330 2023-06-09T04:38:37.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 Processor -- start 2023-06-09T04:38:37.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 -- 172.21.15.18:0/1031285682 wait complete. 2023-06-09T04:38:37.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 Processor -- start 2023-06-09T04:38:37.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85bb7fe640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85bc0ade40 0x7f85bc0b3fe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85b000e8e0 tx=0x7f85b000eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000c8e0 con 0x7f85bc0ade40 2023-06-09T04:38:37.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000ca40 con 0x7f85bc0ade40 2023-06-09T04:38:37.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000cdf0 con 0x7f85bc0ade40 2023-06-09T04:38:37.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b4009b30 con 0x7f85bc0ade40 2023-06-09T04:38:37.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc0b0df0 con 0x7f85bc0ade40 2023-06-09T04:38:37.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7ff54ad9d640 1 -- 172.21.15.18:0/2820750812 reap_dead start 2023-06-09T04:38:37.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 Processor -- start 2023-06-09T04:38:37.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 -- start start 2023-06-09T04:38:37.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37df59e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 0x7f37e00c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37df59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e015f8f0 0x7f37e00c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37df59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0164110 0x7f37e00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37df59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c3500 con 0x7f37e015f8f0 2023-06-09T04:38:37.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37df59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00c3780 con 0x7f37e0164110 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37df59e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00b2b20 con 0x7f37e00b0a50 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 0x7f37e00c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 0x7f37e00c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:54386/0 (socket says 172.21.15.18:54386) 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 -- 172.21.15.18:0/1992321512 learned_addr learned my addr 172.21.15.18:0/1992321512 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 -- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0164110 msgr2=0x7f37e00ce0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0164110 0x7f37e00ce0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c011830 con 0x7fd250069980 2023-06-09T04:38:37.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c011990 con 0x7fd250069980 2023-06-09T04:38:37.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c011d40 con 0x7fd250069980 2023-06-09T04:38:37.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd258491640 1 -- 172.21.15.18:0/324796344 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2501587d0 con 0x7fd250069980 2023-06-09T04:38:37.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd258491640 1 -- 172.21.15.18:0/324796344 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd250150f60 con 0x7fd250069980 2023-06-09T04:38:37.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd258491640 1 -- 172.21.15.18:0/324796344 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25004dea0 con 0x7fd250069980 2023-06-09T04:38:37.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe58b309640 1 -- 172.21.15.18:0/3823853082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c04fb80 con 0x7fe57c0e7330 2023-06-09T04:38:37.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe58b309640 1 -- 172.21.15.18:0/3823853082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c0352c0 con 0x7fe57c0e7330 2023-06-09T04:38:37.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580005430 con 0x7fe57c0e7330 2023-06-09T04:38:37.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580003840 con 0x7fe57c0e7330 2023-06-09T04:38:37.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe58b309640 1 -- 172.21.15.18:0/3823853082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe564005260 con 0x7fe57c0e7330 2023-06-09T04:38:37.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 -- start start 2023-06-09T04:38:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c80e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c8058440 0x7f06c80dae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06c80e4740 0x7f06c80e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80e5bf0 con 0x7f06c80555a0 2023-06-09T04:38:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80e5ed0 con 0x7f06c8058440 2023-06-09T04:38:37.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d6609640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80e61b0 con 0x7f06c80e4740 2023-06-09T04:38:37.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 -- 172.21.15.18:0/1992321512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e015f8f0 msgr2=0x7f37e00c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e015f8f0 0x7f37e00c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 -- 172.21.15.18:0/1992321512 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009420 con 0x7f37e00b0a50 2023-06-09T04:38:37.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 -- start start 2023-06-09T04:38:37.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e80da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72e80dad80 0x7f72e8180510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 0x7f72e804e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8034800 con 0x7f72e80e16e0 2023-06-09T04:38:37.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e804d5c0 con 0x7f72e8036d50 2023-06-09T04:38:37.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f57e8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8033ed0 con 0x7f72e80dad80 2023-06-09T04:38:37.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d5e08640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06c80e4740 0x7f06c80e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d5e08640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06c80e4740 0x7f06c80e5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:54392/0 (socket says 172.21.15.18:54392) 2023-06-09T04:38:37.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d5e08640 1 -- 172.21.15.18:0/1066707335 learned_addr learned my addr 172.21.15.18:0/1066707335 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d4e06640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c8058440 0x7f06c80dae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7ff54ad9d640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5340051d0 0x7ff53400b990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0695f0 tx=0x7ff54401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424120e27aa8b388 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5800039a0 con 0x7fe57c0e7330 2023-06-09T04:38:37.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc0c2cf0 con 0x7f85bc0ade40 2023-06-09T04:38:37.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72ef7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72e80dad80 0x7f72e8180510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72effff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e80da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d5607640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c80e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440a5a30 con 0x7ff5340051d0 2023-06-09T04:38:37.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5440a5bb0 con 0x7ff5340051d0 2023-06-09T04:38:37.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7ff54959a640 1 -- 172.21.15.18:0/2820750812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440ad440 con 0x7ff5340051d0 2023-06-09T04:38:37.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f4fe7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 0x7f72e804e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f4fe7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 0x7f72e804e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38248/0 (socket says 172.21.15.18:38248) 2023-06-09T04:38:37.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2691706538 learned_addr learned my addr 172.21.15.18:0/2691706538 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f37de59c640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 0x7f37e00c4f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37d80070b0 tx=0x7f37d800d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb7c406b910 0x7fb7c40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 0x7fb7c42009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c406f8b0 0x7fb7c40b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40b0040 con 0x7fb7c406d570 2023-06-09T04:38:37.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c4157640 con 0x7fb7c406f8b0 2023-06-09T04:38:37.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fb7ca88b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40b0ec0 con 0x7fb7c406b910 2023-06-09T04:38:37.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d4e06640 1 -- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06c80e4740 msgr2=0x7f06c80e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d4e06640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06c80e4740 0x7f06c80e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d4e06640 1 -- 172.21.15.18:0/1066707335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 msgr2=0x7f06c80e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d4e06640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c80e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7f06d4e06640 1 -- 172.21.15.18:0/1066707335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80e6490 con 0x7f06c8058440 2023-06-09T04:38:37.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72e80dad80 msgr2=0x7f72e8180510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f72f4fe7640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72e80dad80 0x7f72e8180510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 msgr2=0x7f72e80da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f72f4fe7640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e80da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f72f4fe7640 1 -- 172.21.15.18:0/2691706538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80341b0 con 0x7f72e80e16e0 2023-06-09T04:38:37.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 0x7fb7c42009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd24c0058e0 con 0x7fd250069980 2023-06-09T04:38:37.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fd246ffd640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd2340662d0 0x7fd234068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd24c084440 con 0x7fd250069980 2023-06-09T04:38:37.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- 172.21.15.18:0/2820750812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5340051d0 msgr2=0x7ff53400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5340051d0 0x7ff53400b990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0695f0 tx=0x7ff54401cc40 comp rx=0 tx=0).stop 2023-06-09T04:38:37.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 0x7fb7c42009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38262/0 (socket says 172.21.15.18:38262) 2023-06-09T04:38:37.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 -- 172.21.15.18:0/3197823584 learned_addr learned my addr 172.21.15.18:0/3197823584 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.019+0000 7fe579ffb640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5680662d0 0x7fe568068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5800833e0 con 0x7fe57c0e7330 2023-06-09T04:38:37.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- 172.21.15.18:0/2820750812 shutdown_connections 2023-06-09T04:38:37.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 --2- 172.21.15.18:0/2820750812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5340051d0 0x7ff53400b990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- 172.21.15.18:0/2820750812 >> 172.21.15.18:0/2820750812 conn(0x7ff54c0cb410 msgr2=0x7ff54c0cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- 172.21.15.18:0/2820750812 shutdown_connections 2023-06-09T04:38:37.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9889640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb7c406b910 0x7fb7c40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- 172.21.15.18:0/2820750812 wait complete. 2023-06-09T04:38:37.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fe5890a5640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5680662d0 0x7fe568068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f72f4fe7640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 0x7f72e804e070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f72f0068b70 tx=0x7f72f0094090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fd255a2c640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd2340662d0 0x7fd234068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 -- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb7c406b910 msgr2=0x7fb7c40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb7c406b910 0x7fb7c40b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 -- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c406f8b0 msgr2=0x7fb7c40b2880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:37.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c406f8b0 0x7fb7c40b2880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 -- 172.21.15.18:0/3197823584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40094d0 con 0x7fb7c406d570 2023-06-09T04:38:37.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9889640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb7c406b910 0x7fb7c40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:37.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fb7c9088640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 0x7fb7c42009e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7b401acb0 tx=0x7fb7b401ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85b0013470 con 0x7f85bc0ade40 2023-06-09T04:38:37.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fe5890a5640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5680662d0 0x7fe568068780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe584068b70 tx=0x7fe584122000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7fd255a2c640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd2340662d0 0x7fd234068780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd2400b0000 tx=0x7fd24000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 Processor -- start 2023-06-09T04:38:37.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- start start 2023-06-09T04:38:37.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f85a3fff640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85a8066380 0x7f85a8068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85b0084810 con 0x7f85bc0ade40 2023-06-09T04:38:37.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f85baffd640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85a8066380 0x7f85a8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340051d0 0x7ff54c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 0x7ff54c1f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54c0c4110 0x7ff54c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1f6460 con 0x7ff54c0c3930 2023-06-09T04:38:37.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0c2690 con 0x7ff54c0c4110 2023-06-09T04:38:37.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff550c3e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1f5990 con 0x7ff5340051d0 2023-06-09T04:38:37.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 0x7ff54c1f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 0x7ff54c1f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38276/0 (socket says 172.21.15.18:38276) 2023-06-09T04:38:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 -- 172.21.15.18:0/237813012 learned_addr learned my addr 172.21.15.18:0/237813012 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff54a59c640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340051d0 0x7ff54c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 -- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340051d0 msgr2=0x7ff54c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340051d0 0x7ff54c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 -- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54c0c4110 msgr2=0x7ff54c0c4580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:37.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54c0c4110 0x7ff54c0c4580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 -- 172.21.15.18:0/237813012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c0c3da0 con 0x7ff54c0c3930 2023-06-09T04:38:37.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7ff549d9b640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 0x7ff54c1f5450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0124c0 tx=0x7ff53c012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f85baffd640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85a8066380 0x7f85a8068830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85bc1f8440 tx=0x7f85ac00c060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.023+0000 7f06d4e06640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c8058440 0x7f06c80dae90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06d004e4a0 tx=0x7f06d00925f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0132070 con 0x7f72e80e16e0 2023-06-09T04:38:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e8034490 con 0x7f72e80e16e0 2023-06-09T04:38:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e8180a50 con 0x7f72e80e16e0 2023-06-09T04:38:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40bd5f0 con 0x7fb7c406d570 2023-06-09T04:38:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c40b11a0 con 0x7fb7c406d570 2023-06-09T04:38:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c4157b70 con 0x7fb7c406d570 2023-06-09T04:38:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c014810 con 0x7ff54c0c3930 2023-06-09T04:38:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe580050700 con 0x7fe57c0e7330 2023-06-09T04:38:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c1f5bc0 con 0x7ff54c0c3930 2023-06-09T04:38:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c1f6180 con 0x7ff54c0c3930 2023-06-09T04:38:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8034970 con 0x7f72e80e16e0 2023-06-09T04:38:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c4157d60 con 0x7fb7c406d570 2023-06-09T04:38:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.027+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c0c27d0 con 0x7ff54c0c3930 2023-06-09T04:38:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0128040 con 0x7f72e80e16e0 2023-06-09T04:38:37.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b40059a0 con 0x7fb7c406d570 2023-06-09T04:38:37.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4005d30 con 0x7fb7c406d570 2023-06-09T04:38:37.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c014970 con 0x7ff54c0c3930 2023-06-09T04:38:37.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c014ce0 con 0x7ff54c0c3930 2023-06-09T04:38:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0127050 con 0x7f72e80e16e0 2023-06-09T04:38:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72f0137410 con 0x7f72e80e16e0 2023-06-09T04:38:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff53c0153e0 con 0x7ff54c0c3930 2023-06-09T04:38:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7b40c6440 con 0x7fb7c406d570 2023-06-09T04:38:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7ff53affd640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff52c066280 0x7ff52c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7f72ecff9640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72d4066280 0x7f72d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff53c087100 con 0x7ff54c0c3930 2023-06-09T04:38:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f72f01681e0 con 0x7f72e80e16e0 2023-06-09T04:38:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7ff54a59c640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff52c066280 0x7ff52c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7fb7ba7fc640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb7a80662b0 0x7fb7a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7f72effff640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72d4066280 0x7f72d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7b411f080 con 0x7fb7c406d570 2023-06-09T04:38:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.031+0000 7fb7c9889640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb7a80662b0 0x7fb7a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7ff54a59c640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff52c066280 0x7ff52c068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff540006fd0 tx=0x7ff540008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f72effff640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72d4066280 0x7f72d4068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005890 tx=0x7f72dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7fb7c9889640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb7a80662b0 0x7fb7a8068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a9d0 tx=0x7fb7c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8009e40 con 0x7f37e00b0a50 2023-06-09T04:38:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d800f040 con 0x7f37e00b0a50 2023-06-09T04:38:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8015600 con 0x7f37e00b0a50 2023-06-09T04:38:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd24c0517f0 con 0x7fd250069980 2023-06-09T04:38:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0121c10 con 0x7f06c8058440 2023-06-09T04:38:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0121d70 con 0x7f06c8058440 2023-06-09T04:38:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0132690 con 0x7f06c8058440 2023-06-09T04:38:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85b0051a30 con 0x7f85bc0ade40 2023-06-09T04:38:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f37df59e640 1 -- 172.21.15.18:0/1992321512 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e00b2e00 con 0x7f37e00b0a50 2023-06-09T04:38:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f37df59e640 1 -- 172.21.15.18:0/1992321512 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e00c3a60 con 0x7f37e00b0a50 2023-06-09T04:38:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f37df59e640 1 -- 172.21.15.18:0/1992321512 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e00b3320 con 0x7f37e00b0a50 2023-06-09T04:38:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c80e6770 con 0x7f06c8058440 2023-06-09T04:38:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80db3d0 con 0x7f06c8058440 2023-06-09T04:38:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.035+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c8005390 con 0x7f06c8058440 2023-06-09T04:38:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06d013b440 con 0x7f06c8058440 2023-06-09T04:38:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f06c5ffb640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06b40662b0 0x7f06b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06d0197330 con 0x7f06c8058440 2023-06-09T04:38:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37d8015760 con 0x7f37e00b0a50 2023-06-09T04:38:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f37ceffd640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f37c00662d0 0x7f37c0068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37d80845c0 con 0x7f37e00b0a50 2023-06-09T04:38:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f06d5607640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06b40662b0 0x7f06b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f37c00662d0 0x7f37c0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:37.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f37c00662d0 0x7f37c0068780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37d0007fd0 tx=0x7f37d0007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f06d5607640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06b40662b0 0x7f06b4068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009ac0 tx=0x7f06c0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:37.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.039+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72f0164520 con 0x7f72e80e16e0 2023-06-09T04:38:37.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.043+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7b40ec2b0 con 0x7fb7c406d570 2023-06-09T04:38:37.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.047+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06d0164800 con 0x7f06c8058440 2023-06-09T04:38:37.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.051+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff53c054180 con 0x7ff54c0c3930 2023-06-09T04:38:37.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.051+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37d8051970 con 0x7f37e00b0a50 2023-06-09T04:38:37.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.331+0000 7fe58b309640 1 -- 172.21.15.18:0/3823853082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5640057e0 con 0x7fe57c0e7330 2023-06-09T04:38:37.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.331+0000 7fe579ffb640 1 -- 172.21.15.18:0/3823853082 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe580053d20 con 0x7fe57c0e7330 2023-06-09T04:38:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2023-06-09T04:38:37.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 -- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5680662d0 msgr2=0x7fe568068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5680662d0 0x7fe568068780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe584068b70 tx=0x7fe584122000 comp rx=0 tx=0).stop 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 -- 172.21.15.18:0/3823853082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e7330 msgr2=0x7fe57c034d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e7330 0x7fe57c034d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c390 tx=0x7fe58000c850 comp rx=0 tx=0).stop 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 -- 172.21.15.18:0/3823853082 shutdown_connections 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe57c0e7330 0x7fe57c034d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0e6f60 0x7fe57c050690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5680662d0 0x7fe568068780 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 --2- 172.21.15.18:0/3823853082 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe57c051470 0x7fe57c0dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 -- 172.21.15.18:0/3823853082 >> 172.21.15.18:0/3823853082 conn(0x7fe57c00a760 msgr2=0x7fe57c0527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 -- 172.21.15.18:0/3823853082 shutdown_connections 2023-06-09T04:38:37.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.335+0000 7fe56f7fe640 1 -- 172.21.15.18:0/3823853082 wait complete. 2023-06-09T04:38:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.343+0000 7fd258491640 1 -- 172.21.15.18:0/324796344 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd25006cef0 con 0x7fd250069980 2023-06-09T04:38:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.343+0000 7fd246ffd640 1 -- 172.21.15.18:0/324796344 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd24c015090 con 0x7fd250069980 2023-06-09T04:38:37.349 INFO:teuthology.orchestra.run.smithi018.stdout:60129542152 2023-06-09T04:38:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f85bc0c2cf0 con 0x7f85bc0ade40 2023-06-09T04:38:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 -- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd2340662d0 msgr2=0x7fd234068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd2340662d0 0x7fd234068780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd2400b0000 tx=0x7fd24000e040 comp rx=0 tx=0).stop 2023-06-09T04:38:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 -- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 msgr2=0x7fd25014df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd25014df40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00b410 tx=0x7fd24c00b8d0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 -- 172.21.15.18:0/324796344 shutdown_connections 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd250157740 0x7fd2501589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2500b3480 0x7fd250153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd2340662d0 0x7fd234068780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 --2- 172.21.15.18:0/324796344 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd250069980 0x7fd25014df40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 -- 172.21.15.18:0/324796344 >> 172.21.15.18:0/324796344 conn(0x7fd2500ce520 msgr2=0x7fd2500cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 -- 172.21.15.18:0/324796344 shutdown_connections 2023-06-09T04:38:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7fd244ff9640 1 -- 172.21.15.18:0/324796344 wait complete. 2023-06-09T04:38:37.356 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.351+0000 7f85a3fff640 1 -- 172.21.15.18:0/1052213303 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85bc0c2cf0 con 0x7f85bc0ade40 2023-06-09T04:38:37.356 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:37.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85a8066380 msgr2=0x7f85a8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85a8066380 0x7f85a8068830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f85bc1f8440 tx=0x7f85ac00c060 comp rx=0 tx=0).stop 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85bc0ade40 msgr2=0x7f85bc0b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85bc0ade40 0x7f85bc0b3fe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85b000e8e0 tx=0x7f85b000eda0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 shutdown_connections 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85a8066380 0x7f85a8068830 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85bc163480 0x7f85bc1616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85bc15fae0 0x7f85bc153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 --2- 172.21.15.18:0/1052213303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85bc0ade40 0x7f85bc0b3fe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 >> 172.21.15.18:0/1052213303 conn(0x7f85bc0cb410 msgr2=0x7f85bc0c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 shutdown_connections 2023-06-09T04:38:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.355+0000 7f85c1ed0640 1 -- 172.21.15.18:0/1052213303 wait complete. 2023-06-09T04:38:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.359+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f72e8005390 con 0x7f72e80e16e0 2023-06-09T04:38:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.359+0000 7f72ecff9640 1 -- 172.21.15.18:0/2691706538 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72f0167b40 con 0x7f72e80e16e0 2023-06-09T04:38:37.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2023-06-09T04:38:37.362 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7c404dea0 con 0x7fb7c406d570 2023-06-09T04:38:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72d4066280 msgr2=0x7f72d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72d4066280 0x7f72d4068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f72dc005890 tx=0x7f72dc009040 comp rx=0 tx=0).stop 2023-06-09T04:38:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 msgr2=0x7f72e804e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 0x7f72e804e070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f72f0068b70 tx=0x7f72f0094090 comp rx=0 tx=0).stop 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 shutdown_connections 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72e80e16e0 0x7f72e804e070 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72d4066280 0x7f72d4068730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72e80dad80 0x7f72e8180510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 --2- 172.21.15.18:0/2691706538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e8036d50 0x7f72e80da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 >> 172.21.15.18:0/2691706538 conn(0x7f72e8051640 msgr2=0x7f72e80e2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37df59e640 1 -- 172.21.15.18:0/1992321512 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f37e00b3320 con 0x7f37e00b0a50 2023-06-09T04:38:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7fb7ba7fc640 1 -- 172.21.15.18:0/3197823584 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7b40ef8d0 con 0x7fb7c406d570 2023-06-09T04:38:37.366 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2023-06-09T04:38:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ceffd640 1 -- 172.21.15.18:0/1992321512 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37e00b3320 con 0x7f37e00b0a50 2023-06-09T04:38:37.367 INFO:teuthology.orchestra.run.smithi018.stdout:60129542152 2023-06-09T04:38:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 shutdown_connections 2023-06-09T04:38:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f72f57e8640 1 -- 172.21.15.18:0/2691706538 wait complete. 2023-06-09T04:38:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 -- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f37c00662d0 msgr2=0x7f37c0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f37c00662d0 0x7f37c0068780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37d0007fd0 tx=0x7f37d0007940 comp rx=0 tx=0).stop 2023-06-09T04:38:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 -- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 msgr2=0x7f37e00c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 0x7f37e00c4f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37d80070b0 tx=0x7f37d800d4a0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 -- 172.21.15.18:0/1992321512 shutdown_connections 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0164110 0x7f37e00ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e015f8f0 0x7f37e00c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f37c00662d0 0x7f37c0068780 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37d0007fd0 tx=0x7f37d0007940 comp rx=0 tx=0).stop 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 --2- 172.21.15.18:0/1992321512 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f37e00b0a50 0x7f37e00c4f40 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37d80070b0 tx=0x7f37d800d4a0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.363+0000 7f37ccff9640 1 -- 172.21.15.18:0/1992321512 >> 172.21.15.18:0/1992321512 conn(0x7f37e00cb340 msgr2=0x7f37e0069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7f37ccff9640 1 -- 172.21.15.18:0/1992321512 shutdown_connections 2023-06-09T04:38:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7f37ccff9640 1 -- 172.21.15.18:0/1992321512 wait complete. 2023-06-09T04:38:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb7a80662b0 msgr2=0x7fb7a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb7a80662b0 0x7fb7a8068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000a9d0 tx=0x7fb7c0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 msgr2=0x7fb7c42009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 0x7fb7c42009e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7b401acb0 tx=0x7fb7b401ae40 comp rx=0 tx=0).stop 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 shutdown_connections 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7c406f8b0 0x7fb7c40b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7c406d570 0x7fb7c42009e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb7a80662b0 0x7fb7a8068760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 --2- 172.21.15.18:0/3197823584 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb7c406b910 0x7fb7c40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 >> 172.21.15.18:0/3197823584 conn(0x7fb7c40cd860 msgr2=0x7fb7c40c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 shutdown_connections 2023-06-09T04:38:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7fb7ca88b640 1 -- 172.21.15.18:0/3197823584 wait complete. 2023-06-09T04:38:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06c80e6010 con 0x7f06c8058440 2023-06-09T04:38:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.367+0000 7f06c5ffb640 1 -- 172.21.15.18:0/1066707335 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06c80e6010 con 0x7f06c8058440 2023-06-09T04:38:37.373 INFO:teuthology.orchestra.run.smithi018.stdout:60129542152 2023-06-09T04:38:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06b40662b0 msgr2=0x7f06b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06b40662b0 0x7f06b4068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009ac0 tx=0x7f06c0009190 comp rx=0 tx=0).stop 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c8058440 msgr2=0x7f06c80dae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c8058440 0x7f06c80dae90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06d004e4a0 tx=0x7f06d00925f0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 shutdown_connections 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f06b40662b0 0x7f06b4068760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06c80e4740 0x7f06c80e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c8058440 0x7f06c80dae90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 --2- 172.21.15.18:0/1066707335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c80555a0 0x7f06c80e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 >> 172.21.15.18:0/1066707335 conn(0x7f06c8059070 msgr2=0x7f06c8005e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 shutdown_connections 2023-06-09T04:38:37.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7f06d6609640 1 -- 172.21.15.18:0/1066707335 wait complete. 2023-06-09T04:38:37.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.371+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff54c0c27d0 con 0x7ff54c0c3930 2023-06-09T04:38:37.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.375+0000 7ff53affd640 1 -- 172.21.15.18:0/237813012 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff54c0c27d0 con 0x7ff54c0c3930 2023-06-09T04:38:37.376 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2023-06-09T04:38:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.375+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff52c066280 msgr2=0x7ff52c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff52c066280 0x7ff52c068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff540006fd0 tx=0x7ff540008040 comp rx=0 tx=0).stop 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 msgr2=0x7ff54c1f5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 0x7ff54c1f5450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0124c0 tx=0x7ff53c012980 comp rx=0 tx=0).stop 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 shutdown_connections 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff54c0c4110 0x7ff54c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff54c0c3930 0x7ff54c1f5450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff52c066280 0x7ff52c068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 --2- 172.21.15.18:0/237813012 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5340051d0 0x7ff54c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:37.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 >> 172.21.15.18:0/237813012 conn(0x7ff54c0cb410 msgr2=0x7ff54c0c17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:37.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 shutdown_connections 2023-06-09T04:38:37.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:37.379+0000 7ff550c3e640 1 -- 172.21.15.18:0/237813012 wait complete. 2023-06-09T04:38:37.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2023-06-09T04:38:37.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2023-06-09T04:38:37.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2023-06-09T04:38:37.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2023-06-09T04:38:37.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.2 2023-06-09T04:38:37.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2023-06-09T04:38:37.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2023-06-09T04:38:38.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:38:38.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:38:38.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:38:38.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:38:38.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:38:38.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:38:38.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:38:38.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:38:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 Processor -- start 2023-06-09T04:38:38.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 -- start start 2023-06-09T04:38:38.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f94e8157620 0x7f94e80b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94e80699c0 0x7f94e80c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80b19d0 con 0x7f94e80b3350 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e806a730 con 0x7f94e8157620 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.527+0000 7f94edd99640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e80b37f0 con 0x7f94e80699c0 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f94e80b3350 0x7f94e80692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43600/0 (socket says 172.21.15.18:43600) 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e6ffd640 1 -- 172.21.15.18:0/3076124922 learned_addr learned my addr 172.21.15.18:0/3076124922 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e77fe640 1 --2- 172.21.15.18:0/3076124922 >> v2:172.21.15.18:3300/0 conn(0x7f94e8157620 0x7f94e80b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e77fe640 1 -- 172.21.15.18:0/3076124922 >> v2:172.21.15.81:3300/0 conn(0x7f94e80699c0 msgr2=0x7f94e80c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e77fe640 1 --2- 172.21.15.18:0/3076124922 >> v2:172.21.15.81:3300/0 conn(0x7f94e80699c0 0x7f94e80c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e77fe640 1 -- 172.21.15.18:0/3076124922 >> v1:172.21.15.18:6789/0 conn(0x7f94e80b3350 legacy=0x7f94e80692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.531+0000 7f94e77fe640 1 -- 172.21.15.18:0/3076124922 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8069e90 con 0x7f94e8157620 2023-06-09T04:38:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94e77fe640 1 --2- 172.21.15.18:0/3076124922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e8157620 0x7f94e80b2e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94e8065850 tx=0x7f94e001ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4de9ee173d79d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94e67fc640 1 -- 172.21.15.18:0/3076124922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00a7b00 con 0x7f94e8157620 2023-06-09T04:38:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94e67fc640 1 -- 172.21.15.18:0/3076124922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e00a7c60 con 0x7f94e8157620 2023-06-09T04:38:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94e67fc640 1 -- 172.21.15.18:0/3076124922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00af640 con 0x7f94e8157620 2023-06-09T04:38:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 -- 172.21.15.18:0/3076124922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e8157620 msgr2=0x7f94e80b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 --2- 172.21.15.18:0/3076124922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e8157620 0x7f94e80b2e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94e8065850 tx=0x7f94e001ea30 comp rx=0 tx=0).stop 2023-06-09T04:38:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 -- 172.21.15.18:0/3076124922 shutdown_connections 2023-06-09T04:38:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 --2- 172.21.15.18:0/3076124922 >> v2:172.21.15.81:3300/0 conn(0x7f94e80699c0 0x7f94e80c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 --2- 172.21.15.18:0/3076124922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e8157620 0x7f94e80b2e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 -- 172.21.15.18:0/3076124922 >> 172.21.15.18:0/3076124922 conn(0x7f94e80ce520 msgr2=0x7f94e80ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 -- 172.21.15.18:0/3076124922 shutdown_connections 2023-06-09T04:38:38.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.535+0000 7f94edd99640 1 -- 172.21.15.18:0/3076124922 wait complete. 2023-06-09T04:38:38.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 Processor -- start 2023-06-09T04:38:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 -- start start 2023-06-09T04:38:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 0x7f94e8149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e80b3350 0x7f94e8147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94e8157620 0x7f94e806b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8148510 con 0x7f94e80699c0 2023-06-09T04:38:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8148760 con 0x7f94e80b3350 2023-06-09T04:38:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94edd99640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8148a40 con 0x7f94e8157620 2023-06-09T04:38:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 0x7f94e8149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 0x7f94e8149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38290/0 (socket says 172.21.15.18:38290) 2023-06-09T04:38:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 -- 172.21.15.18:0/1669797744 learned_addr learned my addr 172.21.15.18:0/1669797744 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e6ffd640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e80b3350 0x7f94e8147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 -- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94e8157620 msgr2=0x7f94e806b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e7fff640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94e8157620 0x7f94e806b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94e8157620 0x7f94e806b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 -- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e80b3350 msgr2=0x7f94e8147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e80b3350 0x7f94e8147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 -- 172.21.15.18:0/1669797744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e000aa70 con 0x7f94e80699c0 2023-06-09T04:38:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.539+0000 7f94e77fe640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 0x7f94e8149520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f94e001b640 tx=0x7f94e001b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.543+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004240 con 0x7f94e80699c0 2023-06-09T04:38:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.543+0000 7f94edd99640 1 -- 172.21.15.18:0/1669797744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e8148d20 con 0x7f94e80699c0 2023-06-09T04:38:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.543+0000 7f94edd99640 1 -- 172.21.15.18:0/1669797744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e8148290 con 0x7f94e80699c0 2023-06-09T04:38:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.543+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e00043a0 con 0x7f94e80699c0 2023-06-09T04:38:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.543+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004750 con 0x7f94e80699c0 2023-06-09T04:38:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.543+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94e00b6070 con 0x7f94e80699c0 2023-06-09T04:38:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.547+0000 7f94cffff640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94d40663d0 0x7f94d4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.547+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94e011f020 con 0x7f94e80699c0 2023-06-09T04:38:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.547+0000 7f94e6ffd640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94d40663d0 0x7f94d4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.547+0000 7f94edd99640 1 -- 172.21.15.18:0/1669797744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c8005260 con 0x7f94e80699c0 2023-06-09T04:38:38.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.555+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94e00ec190 con 0x7f94e80699c0 2023-06-09T04:38:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.555+0000 7f94e6ffd640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94d40663d0 0x7f94d4068880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94d800a490 tx=0x7f94d800a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f96637640 1 Processor -- start 2023-06-09T04:38:38.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f96637640 1 -- start start 2023-06-09T04:38:38.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f50993ec640 1 Processor -- start 2023-06-09T04:38:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f96637640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f8803a8b0 0x7f4f88038860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f96637640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8803ad20 con 0x7f4f880e6f20 2023-06-09T04:38:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f96637640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f88051bd0 con 0x7f4f88038da0 2023-06-09T04:38:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f96637640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88039220 con 0x7f4f8803a8b0 2023-06-09T04:38:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f95635640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4f880e6f20 0x7f4f880559a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43614/0 (socket says 172.21.15.18:43614) 2023-06-09T04:38:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f4f95635640 1 -- 172.21.15.18:0/741033954 learned_addr learned my addr 172.21.15.18:0/741033954 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:38.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.587+0000 7f50993ec640 1 -- start start 2023-06-09T04:38:38.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678953995 0 0) 0x7f4f800012a0 con 0x7f4f880e6f20 2023-06-09T04:38:38.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c003530 con 0x7f4f880e6f20 2023-06-09T04:38:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f8803a8b0 0x7f4f88038860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f50993ec640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c052790 0x7f508c052ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f50993ec640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f508c03a760 0x7f508c0531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f50993ec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c0e2330 con 0x7f508c0e1f60 2023-06-09T04:38:38.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f50993ec640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c04fed0 con 0x7f508c03a760 2023-06-09T04:38:38.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f50993ec640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0e2790 con 0x7f508c052790 2023-06-09T04:38:38.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f508c03a760 0x7f508c0531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f508c03a760 0x7f508c0531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38306/0 (socket says 172.21.15.18:38306) 2023-06-09T04:38:38.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 -- 172.21.15.18:0/1451470565 learned_addr learned my addr 172.21.15.18:0/1451470565 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283802682 0 0) 0x7f4f7c003530 con 0x7f4f880e6f20 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f8803a8b0 msgr2=0x7f4f88038860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f8803a8b0 0x7f4f88038860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 >> v1:172.21.15.81:6789/0 conn(0x7f4f88038da0 legacy=0x7f4f88052060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88056420 con 0x7f4f880e6f20 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4f80001990 con 0x7f4f880e6f20 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 >> v1:172.21.15.18:6789/0 conn(0x7f4f880e6f20 legacy=0x7f4f880559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f7c0039b0 0x7f4f7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f7c0047d0 0x7f4f7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0051d0 0x7f4f7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88039220 con 0x7f4f7c0047d0 2023-06-09T04:38:38.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00c0c0 con 0x7f4f7c0051d0 2023-06-09T04:38:38.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c00c280 con 0x7f4f7c0039b0 2023-06-09T04:38:38.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f50937fe640 1 --2- 172.21.15.18:0/1451470565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c052790 0x7f508c052ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f95635640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f7c0039b0 0x7f4f7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 -- 172.21.15.18:0/1451470565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c052790 msgr2=0x7f508c052ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 --2- 172.21.15.18:0/1451470565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c052790 0x7f508c052ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 -- 172.21.15.18:0/1451470565 >> v1:172.21.15.81:6789/0 conn(0x7f508c0e1f60 legacy=0x7f508c0e2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 -- 172.21.15.18:0/1451470565 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c033c00 con 0x7f508c03a760 2023-06-09T04:38:38.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f7c0047d0 0x7f4f7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 -- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f7c0039b0 msgr2=0x7f4f7c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f7c0039b0 0x7f4f7c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 -- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0051d0 msgr2=0x7f4f7c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f95e36640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0051d0 0x7f4f7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0051d0 0x7f4f7c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f94e34640 1 -- 172.21.15.18:0/741033954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c003530 con 0x7f4f7c0047d0 2023-06-09T04:38:38.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f4f95e36640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0051d0 0x7f4f7c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:38.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5098beb640 1 --2- 172.21.15.18:0/1451470565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c03a760 0x7f508c0531e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5080008870 tx=0x7f508001ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3acc43f186060d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5092ffd640 1 -- 172.21.15.18:0/1451470565 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800a78a0 con 0x7f508c03a760 2023-06-09T04:38:38.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7f5092ffd640 1 -- 172.21.15.18:0/1451470565 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800ab070 con 0x7f508c03a760 2023-06-09T04:38:38.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 Processor -- start 2023-06-09T04:38:38.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 -- start start 2023-06-09T04:38:38.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- 172.21.15.18:0/1451470565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c03a760 msgr2=0x7f508c0531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 --2- 172.21.15.18:0/1451470565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c03a760 0x7f508c0531e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5080008870 tx=0x7f508001ea10 comp rx=0 tx=0).stop 2023-06-09T04:38:38.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f94e34640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f7c0047d0 0x7f4f7c004c40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f880eaa00 tx=0x7f4f8c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4532895ee06bb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- 172.21.15.18:0/1451470565 shutdown_connections 2023-06-09T04:38:38.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 --2- 172.21.15.18:0/1451470565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c03a760 0x7f508c0531e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 --2- 172.21.15.18:0/1451470565 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c052790 0x7f508c052ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- 172.21.15.18:0/1451470565 >> 172.21.15.18:0/1451470565 conn(0x7f508c051640 msgr2=0x7f508c051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e8157b00 0x7ff8e815c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8e80cbe20 0x7ff8e806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e8069b40 con 0x7ff8e806c850 2023-06-09T04:38:38.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80cc590 con 0x7ff8e80cbe20 2023-06-09T04:38:38.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8ed8be640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80cc870 con 0x7ff8e8157b00 2023-06-09T04:38:38.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 Processor -- start 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 -- start start 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5e806bb20 0x7ff5e80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 0x7ff5e80c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8088d40 con 0x7ff5e8088480 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80c9820 con 0x7ff5e806bb20 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5ed3a8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e806cf40 con 0x7ff5e806bef0 2023-06-09T04:38:38.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5dffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff5e8088480 0x7ff5e80c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43616/0 (socket says 172.21.15.18:43616) 2023-06-09T04:38:38.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5dffff640 1 -- 172.21.15.18:0/2269216578 learned_addr learned my addr 172.21.15.18:0/2269216578 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:38.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5e77fe640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 0x7ff5e80c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5e6ffd640 1 --2- 172.21.15.18:0/2269216578 >> v2:172.21.15.81:3300/0 conn(0x7ff5e806bb20 0x7ff5e80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.591+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452954653 0 0) 0x7ff5e8088d40 con 0x7ff5e8088480 2023-06-09T04:38:38.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d4003510 con 0x7ff5e8088480 2023-06-09T04:38:38.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8e80cbe20 0x7ff8e806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e8157b00 0x7ff8e815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0a4e70 con 0x7f4f7c0047d0 2023-06-09T04:38:38.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0ac440 con 0x7f4f7c0047d0 2023-06-09T04:38:38.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f87fff640 1 -- 172.21.15.18:0/741033954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0ac830 con 0x7f4f7c0047d0 2023-06-09T04:38:38.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff8e80cbe20 0x7ff8e806c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39582/0 (socket says 172.21.15.18:39582) 2023-06-09T04:38:38.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 -- 172.21.15.18:0/2739517478 learned_addr learned my addr 172.21.15.18:0/2739517478 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 -- 172.21.15.18:0/741033954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f7c0047d0 msgr2=0x7f4f7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 --2- 172.21.15.18:0/741033954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f7c0047d0 0x7f4f7c004c40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f880eaa00 tx=0x7f4f8c01c450 comp rx=0 tx=0).stop 2023-06-09T04:38:38.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f95e36640 1 -- 172.21.15.18:0/741033954 reap_dead start 2023-06-09T04:38:38.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- 172.21.15.18:0/1451470565 shutdown_connections 2023-06-09T04:38:38.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- 172.21.15.18:0/1451470565 wait complete. 2023-06-09T04:38:38.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2780794777 0 0) 0x7ff5d4003510 con 0x7ff5e8088480 2023-06-09T04:38:38.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 msgr2=0x7ff5e80c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 0x7ff5e80c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 >> v2:172.21.15.81:3300/0 conn(0x7ff5e806bb20 msgr2=0x7ff5e80b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 -- 172.21.15.18:0/741033954 shutdown_connections 2023-06-09T04:38:38.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 -- 172.21.15.18:0/741033954 >> 172.21.15.18:0/741033954 conn(0x7f4f88053860 msgr2=0x7f4f88053c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 --2- 172.21.15.18:0/2269216578 >> v2:172.21.15.81:3300/0 conn(0x7ff5e806bb20 0x7ff5e80b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80b0340 con 0x7ff5e8088480 2023-06-09T04:38:38.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7ff5d0001680 con 0x7ff5e8088480 2023-06-09T04:38:38.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 >> v1:172.21.15.18:6789/0 conn(0x7ff5e8088480 legacy=0x7ff5e80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4003ab0 0x7ff5d4003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d4004500 0x7ff5d4004970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 0x7ff5d40050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80c9820 con 0x7ff5d4004500 2023-06-09T04:38:38.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e806cf40 con 0x7ff5d4003ab0 2023-06-09T04:38:38.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d400b9a0 con 0x7ff5e806bef0 2023-06-09T04:38:38.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 -- 172.21.15.18:0/741033954 shutdown_connections 2023-06-09T04:38:38.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 -- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e8157b00 msgr2=0x7ff8e815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 --2- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e8157b00 0x7ff8e815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 -- 172.21.15.18:0/2739517478 >> v1:172.21.15.81:6789/0 conn(0x7ff8e806c850 legacy=0x7ff8e80703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 -- 172.21.15.18:0/741033954 wait complete. 2023-06-09T04:38:38.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff8e67fc640 1 -- 172.21.15.18:0/2739517478 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e806ccb0 con 0x7ff8e80cbe20 2023-06-09T04:38:38.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d4004500 0x7ff5d4004970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e6ffd640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4003ab0 0x7ff5d4003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e77fe640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 0x7ff5d40050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 Processor -- start 2023-06-09T04:38:38.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 Processor -- start 2023-06-09T04:38:38.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- start start 2023-06-09T04:38:38.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c03a760 0x7f508c0d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 0x7f508c0d8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0e1f60 0x7f508c04e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c183570 con 0x7f508c052790 2023-06-09T04:38:38.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c183290 con 0x7f508c0e1f60 2023-06-09T04:38:38.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f50993ec640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c04d480 con 0x7f508c03a760 2023-06-09T04:38:38.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5dffff640 1 -- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 msgr2=0x7ff5d40050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e806bef0 0x7ff5d40050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5dffff640 1 -- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4003ab0 msgr2=0x7ff5d4003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4003ab0 0x7ff5d4003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5dffff640 1 -- 172.21.15.18:0/2269216578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80b0340 con 0x7ff5d4004500 2023-06-09T04:38:38.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7ff5e6ffd640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4003ab0 0x7ff5d4003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:38.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 0x7f508c0d8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 0x7f508c0d8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38330/0 (socket says 172.21.15.18:38330) 2023-06-09T04:38:38.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 -- 172.21.15.18:0/3413107629 learned_addr learned my addr 172.21.15.18:0/3413107629 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f5093fff640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c03a760 0x7f508c0d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f5098beb640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0e1f60 0x7f508c04e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 -- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c03a760 msgr2=0x7f508c0d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c03a760 0x7f508c0d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 -- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0e1f60 msgr2=0x7f508c04e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0e1f60 0x7f508c04e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 -- 172.21.15.18:0/3413107629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080008550 con 0x7f508c052790 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.595+0000 7f4f96637640 1 -- start start 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0047d0 0x7f4f8804b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 0x7f4f880dd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f88037300 0x7f4f88037770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88037cb0 con 0x7f4f88007c20 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8817c710 con 0x7f4f7c0047d0 2023-06-09T04:38:38.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88009630 con 0x7f4f88037300 2023-06-09T04:38:38.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 0x7f4f880dd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 0x7f4f880dd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38346/0 (socket says 172.21.15.18:38346) 2023-06-09T04:38:38.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 -- 172.21.15.18:0/2176638341 learned_addr learned my addr 172.21.15.18:0/2176638341 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50937fe640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 0x7f508c0d8360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f508800d800 tx=0x7f508800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f95635640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0047d0 0x7f4f8804b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f95e36640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f88037300 0x7f4f88037770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50880096a0 con 0x7f508c052790 2023-06-09T04:38:38.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5088009800 con 0x7f508c052790 2023-06-09T04:38:38.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088009b70 con 0x7f508c052790 2023-06-09T04:38:38.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 -- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f88037300 msgr2=0x7f4f88037770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f88037300 0x7f4f88037770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 -- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0047d0 msgr2=0x7f4f8804b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0047d0 0x7f4f8804b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 -- 172.21.15.18:0/2176638341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8804b560 con 0x7f4f88007c20 2023-06-09T04:38:38.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f94e34640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 0x7f4f880dd2d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c097a90 tx=0x7f4f7c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c04d760 con 0x7f508c052790 2023-06-09T04:38:38.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c04dd20 con 0x7f508c052790 2023-06-09T04:38:38.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0bd070 con 0x7f4f88007c20 2023-06-09T04:38:38.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 -- 172.21.15.18:0/2176638341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8804b800 con 0x7f4f88007c20 2023-06-09T04:38:38.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 -- 172.21.15.18:0/2176638341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8804bdc0 con 0x7f4f88007c20 2023-06-09T04:38:38.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0b7630 con 0x7f4f88007c20 2023-06-09T04:38:38.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7ff8e67fc640 1 --2- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e80cbe20 0x7ff8e806c310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00bb10 tx=0x7ff8dc01ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3399965282526393 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0b79e0 con 0x7f4f88007c20 2023-06-09T04:38:38.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f4f96637640 1 -- 172.21.15.18:0/2176638341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f70005260 con 0x7f4f88007c20 2023-06-09T04:38:38.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7ff8e5ffb640 1 -- 172.21.15.18:0/2739517478 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0a7c70 con 0x7ff8e80cbe20 2023-06-09T04:38:38.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7ff8e5ffb640 1 -- 172.21.15.18:0/2739517478 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc0a7dd0 con 0x7ff8e80cbe20 2023-06-09T04:38:38.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7ff8e5ffb640 1 -- 172.21.15.18:0/2739517478 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0af660 con 0x7ff8e80cbe20 2023-06-09T04:38:38.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d4004500 0x7ff5d4004970 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c260 tx=0x7ff5d001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8df3abc2bce985 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c005390 con 0x7f508c052790 2023-06-09T04:38:38.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.599+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5088009cd0 con 0x7f508c052790 2023-06-09T04:38:38.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f5090ff9640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f50780662d0 0x7f5078068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f8c0b3040 con 0x7f4f88007c20 2023-06-09T04:38:38.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50880845b0 con 0x7f508c052790 2023-06-09T04:38:38.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f5093fff640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f50780662d0 0x7f5078068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f4f85ffb640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4f74066280 0x7f4f74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f8c11d650 con 0x7f4f88007c20 2023-06-09T04:38:38.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 -- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e80cbe20 msgr2=0x7ff8e806c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e80cbe20 0x7ff8e806c310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00bb10 tx=0x7ff8dc01ec20 comp rx=0 tx=0).stop 2023-06-09T04:38:38.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 -- 172.21.15.18:0/2739517478 shutdown_connections 2023-06-09T04:38:38.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e80cbe20 0x7ff8e806c310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/2739517478 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e8157b00 0x7ff8e815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 -- 172.21.15.18:0/2739517478 >> 172.21.15.18:0/2739517478 conn(0x7ff8e80cb960 msgr2=0x7ff8e80ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 -- 172.21.15.18:0/2739517478 shutdown_connections 2023-06-09T04:38:38.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f4f95635640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4f74066280 0x7f4f74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f5093fff640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f50780662d0 0x7f5078068780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50940633d0 tx=0x7f5094066830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7f4f95635640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4f74066280 0x7f4f74068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f80001440 tx=0x7f4f80007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf57056640 1 Processor -- start 2023-06-09T04:38:38.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf57056640 1 -- start start 2023-06-09T04:38:38.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf57056640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf5015bec0 0x7fcf5006b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 -- 172.21.15.18:0/2739517478 wait complete. 2023-06-09T04:38:38.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 Processor -- start 2023-06-09T04:38:38.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf57056640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf50158770 con 0x7fcf500ad9b0 2023-06-09T04:38:38.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf57056640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf50070ae0 con 0x7fcf500b0410 2023-06-09T04:38:38.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf57056640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf50071760 con 0x7fcf5015bec0 2023-06-09T04:38:38.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf54df2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcf500b0410 0x7fcf500b07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:38204/0 (socket says 172.21.15.18:38204) 2023-06-09T04:38:38.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf54df2640 1 -- 172.21.15.18:0/1882510193 learned_addr learned my addr 172.21.15.18:0/1882510193 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:38.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff8ed8be640 1 -- start start 2023-06-09T04:38:38.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059329035 0 0) 0x7fcf50070ae0 con 0x7fcf500b0410 2023-06-09T04:38:38.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf40005740 con 0x7fcf500b0410 2023-06-09T04:38:38.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00058e0 con 0x7ff5d4004500 2023-06-09T04:38:38.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d0005a40 con 0x7ff5d4004500 2023-06-09T04:38:38.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff5e67fc640 1 -- 172.21.15.18:0/2269216578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0005e50 con 0x7ff5d4004500 2023-06-09T04:38:38.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2269216578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d4004500 msgr2=0x7ff5d4004970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.603+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2269216578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5d4004500 0x7ff5d4004970 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c260 tx=0x7ff5d001cc50 comp rx=0 tx=0).stop 2023-06-09T04:38:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 230480864 0 0) 0x7fcf40005740 con 0x7fcf500b0410 2023-06-09T04:38:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 >> v2:172.21.15.18:3300/0 conn(0x7fcf5015bec0 msgr2=0x7fcf5006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 --2- 172.21.15.18:0/1882510193 >> v2:172.21.15.18:3300/0 conn(0x7fcf5015bec0 0x7fcf5006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5e77fe640 1 -- 172.21.15.18:0/2269216578 reap_dead start 2023-06-09T04:38:38.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2269216578 shutdown_connections 2023-06-09T04:38:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2269216578 >> 172.21.15.18:0/2269216578 conn(0x7ff5e80ce520 msgr2=0x7ff5e80ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 >> v1:172.21.15.18:6789/0 conn(0x7fcf500ad9b0 legacy=0x7fcf5006bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50070dc0 con 0x7fcf500b0410 2023-06-09T04:38:38.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fcf3c001680 con 0x7fcf500b0410 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 >> v1:172.21.15.81:6789/0 conn(0x7fcf500b0410 legacy=0x7fcf500b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf40005b90 0x7fcf40005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf400069e0 0x7fcf40006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf4000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50071760 con 0x7fcf400069e0 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40010590 con 0x7fcf40007390 2023-06-09T04:38:38.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40010750 con 0x7fcf40005b90 2023-06-09T04:38:38.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf4ffff640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf400069e0 0x7fcf40006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf555f3640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf4000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2269216578 shutdown_connections 2023-06-09T04:38:38.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf54df2640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf40005b90 0x7fcf40005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2269216578 wait complete. 2023-06-09T04:38:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 0x7ff8e80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e80cbe20 0x7ff8e815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e8149a80 0x7ff8e80b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e814be50 con 0x7ff8e8149a80 2023-06-09T04:38:38.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e814b2d0 con 0x7ff8e806c850 2023-06-09T04:38:38.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e814b5b0 con 0x7ff8e80cbe20 2023-06-09T04:38:38.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf555f3640 1 -- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf40005b90 msgr2=0x7fcf40005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf555f3640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf40005b90 0x7fcf40005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf555f3640 1 -- 172.21.15.18:0/1882510193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf400069e0 msgr2=0x7fcf40006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf555f3640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf400069e0 0x7fcf40006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7fcf555f3640 1 -- 172.21.15.18:0/1882510193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40005740 con 0x7fcf40007390 2023-06-09T04:38:38.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 0x7ff8e80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 0x7ff8e80b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39632/0 (socket says 172.21.15.18:39632) 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 -- 172.21.15.18:0/240312467 learned_addr learned my addr 172.21.15.18:0/240312467 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e77fe640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e8149a80 0x7ff8e80b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 -- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e80cbe20 msgr2=0x7ff8e815a940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e80cbe20 0x7ff8e815a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 -- 172.21.15.18:0/240312467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e8149a80 msgr2=0x7ff8e80b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e8149a80 0x7ff8e80b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 -- 172.21.15.18:0/240312467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc00b770 con 0x7ff8e806c850 2023-06-09T04:38:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e77fe640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e8149a80 0x7ff8e80b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 Processor -- start 2023-06-09T04:38:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- start start 2023-06-09T04:38:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8e6ffd640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 0x7ff8e80b3bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800d560 tx=0x7ff8d800d650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800de80 con 0x7ff8e806c850 2023-06-09T04:38:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d80125f0 con 0x7ff8e806c850 2023-06-09T04:38:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8012960 con 0x7ff8e806c850 2023-06-09T04:38:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 0x7ff5e80c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e80c0770 0x7ff5e80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e80b2750 0x7ff5e8166da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80b2bd0 con 0x7ff5e8087760 2023-06-09T04:38:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8165a80 con 0x7ff5e80c0770 2023-06-09T04:38:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff5ed3a8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8087b30 con 0x7ff5e80b2750 2023-06-09T04:38:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80cd290 con 0x7ff8e806c850 2023-06-09T04:38:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.607+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e814bb70 con 0x7ff8e806c850 2023-06-09T04:38:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7fcf555f3640 1 -- 172.21.15.18:0/1882510193 reap_dead start 2023-06-09T04:38:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 0x7ff5e80c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 0x7ff5e80c0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38368/0 (socket says 172.21.15.18:38368) 2023-06-09T04:38:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e77fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e80b2750 0x7ff5e8166da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 -- 172.21.15.18:0/2182635421 learned_addr learned my addr 172.21.15.18:0/2182635421 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e80c0770 0x7ff5e80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e80ceeb0 con 0x7ff8e806c850 2023-06-09T04:38:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7fcf555f3640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf4000ffa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf48001d80 tx=0x7fcf4801c660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=394c35790f651e0c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 -- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e80b2750 msgr2=0x7ff5e8166da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e80b2750 0x7ff5e8166da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 -- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e80c0770 msgr2=0x7ff5e80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e80c0770 0x7ff5e80b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 -- 172.21.15.18:0/2182635421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8164eb0 con 0x7ff5e8087760 2023-06-09T04:38:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff5e6ffd640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 0x7ff5e80c0230 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800b6b0 tx=0x7ff5d800bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48003b80 con 0x7fcf40007390 2023-06-09T04:38:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8d8012ac0 con 0x7ff8e806c850 2023-06-09T04:38:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff8cffff640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff8d4066280 0x7ff8d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50880518d0 con 0x7f508c052790 2023-06-09T04:38:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7fce08ab8640 1 Processor -- start 2023-06-09T04:38:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff8d80849a0 con 0x7ff8e806c850 2023-06-09T04:38:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.611+0000 7fce08ab8640 1 -- start start 2023-06-09T04:38:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce08ab8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdfc0e6c10 0x7fcdfc052ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce08ab8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcdfc033860 0x7fcdfc04f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce08ab8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc006bb0 0x7fcdfc036530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce08ab8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0e6fe0 con 0x7fcdfc033860 2023-06-09T04:38:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce08ab8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc006780 con 0x7fcdfc0e6c10 2023-06-09T04:38:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce08ab8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0513d0 con 0x7fcdfc006bb0 2023-06-09T04:38:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcdfc033860 0x7fcdfc04f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7ff8e67fc640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff8d4066280 0x7ff8d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcdfc033860 0x7fcdfc04f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38378/0 (socket says 172.21.15.18:38378) 2023-06-09T04:38:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 -- 172.21.15.18:0/2465103309 learned_addr learned my addr 172.21.15.18:0/2465103309 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce0259c640 1 --2- 172.21.15.18:0/2465103309 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc0e6c10 0x7fcdfc052ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7ff8e67fc640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff8d4066280 0x7ff8d4068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0b1000 tx=0x7ff8dc0a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 -- 172.21.15.18:0/2465103309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc006bb0 msgr2=0x7fcdfc036530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:38:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 --2- 172.21.15.18:0/2465103309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc006bb0 0x7fcdfc036530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 -- 172.21.15.18:0/2465103309 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc0e6c10 msgr2=0x7fcdfc052ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 --2- 172.21.15.18:0/2465103309 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc0e6c10 0x7fcdfc052ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 -- 172.21.15.18:0/2465103309 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0544d0 con 0x7fcdfc033860 2023-06-09T04:38:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.615+0000 7fce01d9b640 1 --2- 172.21.15.18:0/2465103309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc033860 0x7fcdfc04f070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc037460 tx=0x7fcdf401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca8f676defbb3e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce0159a640 1 -- 172.21.15.18:0/2465103309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40aa610 con 0x7fcdfc033860 2023-06-09T04:38:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8010a50 con 0x7ff5e8087760 2023-06-09T04:38:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8010bb0 con 0x7ff5e8087760 2023-06-09T04:38:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8004020 con 0x7ff5e8087760 2023-06-09T04:38:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f8c0ea7f0 con 0x7f4f88007c20 2023-06-09T04:38:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e8165150 con 0x7ff5e8087760 2023-06-09T04:38:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e8165710 con 0x7ff5e8087760 2023-06-09T04:38:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce0159a640 1 -- 172.21.15.18:0/2465103309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40a6040 con 0x7fcdfc033860 2023-06-09T04:38:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e804dea0 con 0x7ff5e8087760 2023-06-09T04:38:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 -- 172.21.15.18:0/2465103309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc033860 msgr2=0x7fcdfc04f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 --2- 172.21.15.18:0/2465103309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc033860 0x7fcdfc04f070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc037460 tx=0x7fcdf401c4f0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 -- 172.21.15.18:0/2465103309 shutdown_connections 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 --2- 172.21.15.18:0/2465103309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc006bb0 0x7fcdfc036530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 --2- 172.21.15.18:0/2465103309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc033860 0x7fcdfc04f070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 --2- 172.21.15.18:0/2465103309 >> v2:172.21.15.81:3300/0 conn(0x7fcdfc0e6c10 0x7fcdfc052ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 -- 172.21.15.18:0/2465103309 >> 172.21.15.18:0/2465103309 conn(0x7fcdfc051530 msgr2=0x7fcdfc051930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 -- 172.21.15.18:0/2465103309 shutdown_connections 2023-06-09T04:38:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7fce08ab8640 1 -- 172.21.15.18:0/2465103309 wait complete. 2023-06-09T04:38:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5d8013070 con 0x7ff5e8087760 2023-06-09T04:38:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 Processor -- start 2023-06-09T04:38:38.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 -- start start 2023-06-09T04:38:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.619+0000 7ff5df7fe640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5c80662d0 0x7ff5c8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5d8084540 con 0x7ff5e8087760 2023-06-09T04:38:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5c80662d0 0x7ff5c8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7ff5dffff640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5c80662d0 0x7ff5c8068780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00aa000 tx=0x7ff5d0001940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 0x7fcdfc0d7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc033860 0x7fcdfc0e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0e6c10 0x7fcdfc0dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0e1f90 con 0x7fcdfc006bb0 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0de070 con 0x7fcdfc0e6c10 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce08ab8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0de350 con 0x7fcdfc033860 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 0x7fcdfc0d7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 0x7fcdfc0d7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38390/0 (socket says 172.21.15.18:38390) 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 -- 172.21.15.18:0/3188872201 learned_addr learned my addr 172.21.15.18:0/3188872201 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce02d9d640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0e6c10 0x7fcdfc0dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce01d9b640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc033860 0x7fcdfc0e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 -- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc033860 msgr2=0x7fcdfc0e15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc033860 0x7fcdfc0e15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 -- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0e6c10 msgr2=0x7fcdfc0dbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0e6c10 0x7fcdfc0dbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 -- 172.21.15.18:0/3188872201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40094d0 con 0x7fcdfc006bb0 2023-06-09T04:38:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48003ce0 con 0x7fcf40007390 2023-06-09T04:38:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf4f7fe640 1 -- 172.21.15.18:0/1882510193 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480052b0 con 0x7fcf40007390 2023-06-09T04:38:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fce0259c640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 0x7fcdfc0d7210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800e870 tx=0x7fcdf800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8d8051ba0 con 0x7ff8e806c850 2023-06-09T04:38:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf57056640 1 -- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 msgr2=0x7fcf4000ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf57056640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf4000ffa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf48001d80 tx=0x7fcf4801c660 comp rx=0 tx=0).stop 2023-06-09T04:38:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf57056640 1 -- 172.21.15.18:0/1882510193 shutdown_connections 2023-06-09T04:38:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf57056640 1 --2- 172.21.15.18:0/1882510193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf4000ffa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.623+0000 7fcf57056640 1 -- 172.21.15.18:0/1882510193 >> 172.21.15.18:0/1882510193 conn(0x7fcf500cb410 msgr2=0x7fcf500cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- 172.21.15.18:0/1882510193 shutdown_connections 2023-06-09T04:38:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- 172.21.15.18:0/1882510193 wait complete. 2023-06-09T04:38:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 Processor -- start 2023-06-09T04:38:38.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5d80517f0 con 0x7ff5e8087760 2023-06-09T04:38:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- start start 2023-06-09T04:38:38.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf5015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf50148920 0x7fcf501454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 0x7fcf500ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5015b690 con 0x7fcf50148920 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5015aa80 con 0x7fcf40007390 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5015ad60 con 0x7fcf501459f0 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 0x7fcf500ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 0x7fcf500ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:54542/0 (socket says 172.21.15.18:54542) 2023-06-09T04:38:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 -- 172.21.15.18:0/419809090 learned_addr learned my addr 172.21.15.18:0/419809090 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 -- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 msgr2=0x7fcf5015a450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf5015a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 -- 172.21.15.18:0/419809090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf50148920 msgr2=0x7fcf501454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf50148920 0x7fcf501454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 -- 172.21.15.18:0/419809090 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5015b040 con 0x7fcf501459f0 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf555f3640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 0x7fcf500ceea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf48007fd0 tx=0x7fcf40007a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480b0070 con 0x7fcf501459f0 2023-06-09T04:38:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48005610 con 0x7fcf501459f0 2023-06-09T04:38:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5015b320 con 0x7fcf501459f0 2023-06-09T04:38:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48006b40 con 0x7fcf501459f0 2023-06-09T04:38:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.627+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf50148d90 con 0x7fcf501459f0 2023-06-09T04:38:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf48006ca0 con 0x7fcf501459f0 2023-06-09T04:38:38.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8009510 con 0x7fcdfc006bb0 2023-06-09T04:38:38.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcf4d7fa640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf34066280 0x7fcf34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800eec0 con 0x7fcdfc006bb0 2023-06-09T04:38:38.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc0de630 con 0x7fcdfc006bb0 2023-06-09T04:38:38.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc0ddc90 con 0x7fcdfc006bb0 2023-06-09T04:38:38.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf480a7070 con 0x7fcf501459f0 2023-06-09T04:38:38.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf501572e0 con 0x7fcf501459f0 2023-06-09T04:38:38.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800cb40 con 0x7fcdfc006bb0 2023-06-09T04:38:38.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7f42bbeef640 1 Processor -- start 2023-06-09T04:38:38.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.631+0000 7f42bbeef640 1 -- start start 2023-06-09T04:38:38.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fcf54df2640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf34066280 0x7fcf34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fcf54df2640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf34066280 0x7fcf34068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c001060 tx=0x7fcf3c005490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdf800cd20 con 0x7fcdfc006bb0 2023-06-09T04:38:38.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fcdf2ffd640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcde40662b0 0x7fcde4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc0e20d0 con 0x7fcdfc006bb0 2023-06-09T04:38:38.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdf80840a0 con 0x7fcdfc006bb0 2023-06-09T04:38:38.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7fce01d9b640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcde40662b0 0x7fcde4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42bbeef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42b40cd260 0x7f42b4168260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42bbeef640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f42b406c270 0x7f42b40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42bbeef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b4069c80 con 0x7f42b406be20 2023-06-09T04:38:38.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42bbeef640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b41687a0 con 0x7f42b406c270 2023-06-09T04:38:38.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42bbeef640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b4069630 con 0x7f42b40cd260 2023-06-09T04:38:38.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42b40cd260 0x7f42b4168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.639+0000 7fce01d9b640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcde40662b0 0x7fcde4068760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ae000 tx=0x7fcdf40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42b40cd260 0x7f42b4168260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39688/0 (socket says 172.21.15.18:39688) 2023-06-09T04:38:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 -- 172.21.15.18:0/2560584592 learned_addr learned my addr 172.21.15.18:0/2560584592 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 -- 172.21.15.18:0/2560584592 >> v2:172.21.15.18:3300/0 conn(0x7f42b406c270 msgr2=0x7f42b40c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 --2- 172.21.15.18:0/2560584592 >> v2:172.21.15.18:3300/0 conn(0x7f42b406c270 0x7f42b40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 -- 172.21.15.18:0/2560584592 >> v1:172.21.15.81:6789/0 conn(0x7f42b406be20 legacy=0x7f42b40cc810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:38:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.635+0000 7f42b9c8b640 1 -- 172.21.15.18:0/2560584592 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4069910 con 0x7f42b40cd260 2023-06-09T04:38:38.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.639+0000 7f42b9c8b640 1 --2- 172.21.15.18:0/2560584592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b4168260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42b4071120 tx=0x7f42b002d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e7f83b331647fa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42b8c89640 1 -- 172.21.15.18:0/2560584592 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b00bc600 con 0x7f42b40cd260 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42b8c89640 1 -- 172.21.15.18:0/2560584592 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b00b8050 con 0x7f42b40cd260 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 -- 172.21.15.18:0/2560584592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 msgr2=0x7f42b4168260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2560584592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b4168260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42b4071120 tx=0x7f42b002d460 comp rx=0 tx=0).stop 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 -- 172.21.15.18:0/2560584592 shutdown_connections 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2560584592 >> v2:172.21.15.18:3300/0 conn(0x7f42b406c270 0x7f42b40c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2560584592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b4168260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 -- 172.21.15.18:0/2560584592 >> 172.21.15.18:0/2560584592 conn(0x7f42b40ce650 msgr2=0x7f42b40ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 -- 172.21.15.18:0/2560584592 shutdown_connections 2023-06-09T04:38:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 -- 172.21.15.18:0/2560584592 wait complete. 2023-06-09T04:38:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 Processor -- start 2023-06-09T04:38:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7f42bbeef640 1 -- start start 2023-06-09T04:38:38.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.643+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcdf8051260 con 0x7fcdfc006bb0 2023-06-09T04:38:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42bbeef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42b406be20 0x7f42b4088070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42bbeef640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406c270 0x7f42b40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42bbeef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b40705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42bbeef640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b2a40 con 0x7f42b406be20 2023-06-09T04:38:38.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42bbeef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b2c70 con 0x7f42b40cd260 2023-06-09T04:38:38.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42bbeef640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b2f50 con 0x7f42b406c270 2023-06-09T04:38:38.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42b9c8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42b406be20 0x7f42b4088070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42b9c8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42b406be20 0x7f42b4088070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38418/0 (socket says 172.21.15.18:38418) 2023-06-09T04:38:38.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42b9c8b640 1 -- 172.21.15.18:0/2292059098 learned_addr learned my addr 172.21.15.18:0/2292059098 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:38.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf480ea7e0 con 0x7fcf501459f0 2023-06-09T04:38:38.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42b948a640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406c270 0x7f42b40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b40705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 -- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406c270 msgr2=0x7f42b40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406c270 0x7f42b40b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 -- 172.21.15.18:0/2292059098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42b406be20 msgr2=0x7f42b4088070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42b406be20 0x7f42b4088070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 -- 172.21.15.18:0/2292059098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b00094d0 con 0x7f42b40cd260 2023-06-09T04:38:38.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.647+0000 7f42ba48c640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b40705a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00be20 tx=0x7f42ac00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00ce70 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40b3230 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40b37f0 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac014440 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac014810 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c005260 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42ac014970 con 0x7f42b40cd260 2023-06-09T04:38:38.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42aa7fc640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f42980662d0 0x7f4298068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:38.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42ac084290 con 0x7f42b40cd260 2023-06-09T04:38:38.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.651+0000 7f42b9c8b640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f42980662d0 0x7f4298068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:38.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.655+0000 7f42b9c8b640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f42980662d0 0x7f4298068780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009280 tx=0x7f42b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:38.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.663+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42ac051540 con 0x7f42b40cd260 2023-06-09T04:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.883+0000 7f94edd99640 1 -- 172.21.15.18:0/1669797744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94c8005510 con 0x7f94e80699c0 2023-06-09T04:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.883+0000 7f94cffff640 1 -- 172.21.15.18:0/1669797744 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94e00b4030 con 0x7f94e80699c0 2023-06-09T04:38:38.888 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2023-06-09T04:38:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 -- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94d40663d0 msgr2=0x7f94d4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94d40663d0 0x7f94d4068880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94d800a490 tx=0x7f94d800a420 comp rx=0 tx=0).stop 2023-06-09T04:38:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 -- 172.21.15.18:0/1669797744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 msgr2=0x7f94e8149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 0x7f94e8149520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f94e001b640 tx=0x7f94e001b7d0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 -- 172.21.15.18:0/1669797744 shutdown_connections 2023-06-09T04:38:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94d40663d0 0x7f94d4068880 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94e8157620 0x7f94e806b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e80b3350 0x7f94e8147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 --2- 172.21.15.18:0/1669797744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94e80699c0 0x7f94e8149520 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 -- 172.21.15.18:0/1669797744 >> 172.21.15.18:0/1669797744 conn(0x7f94e80ce520 msgr2=0x7f94e80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 -- 172.21.15.18:0/1669797744 shutdown_connections 2023-06-09T04:38:38.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.891+0000 7f94cdffb640 1 -- 172.21.15.18:0/1669797744 wait complete. 2023-06-09T04:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.911+0000 7f4f96637640 1 -- 172.21.15.18:0/2176638341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f70005510 con 0x7f4f88007c20 2023-06-09T04:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f85ffb640 1 -- 172.21.15.18:0/2176638341 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f8c0ede10 con 0x7f4f88007c20 2023-06-09T04:38:38.916 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2023-06-09T04:38:38.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2023-06-09T04:38:38.917 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 -- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4f74066280 msgr2=0x7f4f74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4f74066280 0x7f4f74068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f80001440 tx=0x7f4f80007aa0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 -- 172.21.15.18:0/2176638341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 msgr2=0x7f4f880dd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 0x7f4f880dd2d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c097a90 tx=0x7f4f7c005800 comp rx=0 tx=0).stop 2023-06-09T04:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 -- 172.21.15.18:0/2176638341 shutdown_connections 2023-06-09T04:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4f74066280 0x7f4f74068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4f88037300 0x7f4f88037770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f88007c20 0x7f4f880dd2d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 --2- 172.21.15.18:0/2176638341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0047d0 0x7f4f8804b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.915+0000 7f4f7b7fe640 1 -- 172.21.15.18:0/2176638341 >> 172.21.15.18:0/2176638341 conn(0x7f4f88053860 msgr2=0x7f4f8803c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.919+0000 7f4f7b7fe640 1 -- 172.21.15.18:0/2176638341 shutdown_connections 2023-06-09T04:38:38.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.919+0000 7f4f7b7fe640 1 -- 172.21.15.18:0/2176638341 wait complete. 2023-06-09T04:38:38.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.935+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f508c0e30a0 con 0x7f508c052790 2023-06-09T04:38:38.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.935+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff8e814cb20 con 0x7ff8e806c850 2023-06-09T04:38:38.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.935+0000 7f5090ff9640 1 -- 172.21.15.18:0/3413107629 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5088054ef0 con 0x7f508c052790 2023-06-09T04:38:38.939 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:38.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7ff8cffff640 1 -- 172.21.15.18:0/240312467 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8d80551c0 con 0x7ff8e806c850 2023-06-09T04:38:38.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2023-06-09T04:38:38.941 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2023-06-09T04:38:38.941 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f50780662d0 msgr2=0x7f5078068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f50780662d0 0x7f5078068780 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50940633d0 tx=0x7f5094066830 comp rx=0 tx=0).stop 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 msgr2=0x7f508c0d8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 0x7f508c0d8360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f508800d800 tx=0x7f508800dcc0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 shutdown_connections 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508c0e1f60 0x7f508c04e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508c052790 0x7f508c0d8360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f50780662d0 0x7f5078068780 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 --2- 172.21.15.18:0/3413107629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f508c03a760 0x7f508c0d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 >> 172.21.15.18:0/3413107629 conn(0x7f508c051640 msgr2=0x7f508c0355a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 shutdown_connections 2023-06-09T04:38:38.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.939+0000 7f50993ec640 1 -- 172.21.15.18:0/3413107629 wait complete. 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff8d4066280 msgr2=0x7ff8d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff8d4066280 0x7ff8d4068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0b1000 tx=0x7ff8dc0a9070 comp rx=0 tx=0).stop 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 msgr2=0x7ff8e80b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 0x7ff8e80b3bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800d560 tx=0x7ff8d800d650 comp rx=0 tx=0).stop 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 shutdown_connections 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8e8149a80 0x7ff8e80b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff8d4066280 0x7ff8d4068730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff8e80cbe20 0x7ff8e815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 --2- 172.21.15.18:0/240312467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8e806c850 0x7ff8e80b3bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 >> 172.21.15.18:0/240312467 conn(0x7ff8e80cb960 msgr2=0x7ff8e80c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 shutdown_connections 2023-06-09T04:38:38.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff8ed8be640 1 -- 172.21.15.18:0/240312467 wait complete. 2023-06-09T04:38:38.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.943+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5e80afe80 con 0x7ff5e8087760 2023-06-09T04:38:38.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5df7fe640 1 -- 172.21.15.18:0/2182635421 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5d8054e10 con 0x7ff5e8087760 2023-06-09T04:38:38.947 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:38.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5c80662d0 msgr2=0x7ff5c8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5c80662d0 0x7ff5c8068780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00aa000 tx=0x7ff5d0001940 comp rx=0 tx=0).stop 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 msgr2=0x7ff5e80c0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 0x7ff5e80c0230 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800b6b0 tx=0x7ff5d800bb70 comp rx=0 tx=0).stop 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 shutdown_connections 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5c80662d0 0x7ff5c8068780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e80b2750 0x7ff5e8166da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e80c0770 0x7ff5e80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 --2- 172.21.15.18:0/2182635421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e8087760 0x7ff5e80c0230 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 >> 172.21.15.18:0/2182635421 conn(0x7ff5e80ce520 msgr2=0x7ff5e80b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 shutdown_connections 2023-06-09T04:38:38.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.947+0000 7ff5ed3a8640 1 -- 172.21.15.18:0/2182635421 wait complete. 2023-06-09T04:38:38.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.951+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f429c0057e0 con 0x7f42b40cd260 2023-06-09T04:38:38.952 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.951+0000 7f42aa7fc640 1 -- 172.21.15.18:0/2292059098 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42ac019020 con 0x7f42b40cd260 2023-06-09T04:38:38.952 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2023-06-09T04:38:38.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.951+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcf5004dea0 con 0x7fcf501459f0 2023-06-09T04:38:38.955 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.951+0000 7fcf4d7fa640 1 -- 172.21.15.18:0/419809090 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf480ede00 con 0x7fcf501459f0 2023-06-09T04:38:38.955 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2023-06-09T04:38:38.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f42980662d0 msgr2=0x7f4298068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f42980662d0 0x7f4298068780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009280 tx=0x7f42b0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:38.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 msgr2=0x7f42b40705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b40705a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00be20 tx=0x7f42ac00bf10 comp rx=0 tx=0).stop 2023-06-09T04:38:38.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 shutdown_connections 2023-06-09T04:38:38.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40cd260 0x7f42b40705a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f42980662d0 0x7f4298068780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406c270 0x7f42b40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 --2- 172.21.15.18:0/2292059098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42b406be20 0x7f42b4088070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 >> 172.21.15.18:0/2292059098 conn(0x7f42b40ce650 msgr2=0x7f42b4169760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 shutdown_connections 2023-06-09T04:38:38.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7f42bbeef640 1 -- 172.21.15.18:0/2292059098 wait complete. 2023-06-09T04:38:38.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf34066280 msgr2=0x7fcf34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf34066280 0x7fcf34068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c001060 tx=0x7fcf3c005490 comp rx=0 tx=0).stop 2023-06-09T04:38:38.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 msgr2=0x7fcf500ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 0x7fcf500ceea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf48007fd0 tx=0x7fcf40007a10 comp rx=0 tx=0).stop 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 shutdown_connections 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcf34066280 0x7fcf34068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcf501459f0 0x7fcf500ceea0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf50148920 0x7fcf501454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 --2- 172.21.15.18:0/419809090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf40007390 0x7fcf5015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 >> 172.21.15.18:0/419809090 conn(0x7fcf500cb410 msgr2=0x7fcf50157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 shutdown_connections 2023-06-09T04:38:38.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcf57056640 1 -- 172.21.15.18:0/419809090 wait complete. 2023-06-09T04:38:38.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcdfc0de7c0 con 0x7fcdfc006bb0 2023-06-09T04:38:38.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.955+0000 7fcdf2ffd640 1 -- 172.21.15.18:0/3188872201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcdf8021090 con 0x7fcdfc006bb0 2023-06-09T04:38:38.960 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2023-06-09T04:38:38.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcde40662b0 msgr2=0x7fcde4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcde40662b0 0x7fcde4068760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ae000 tx=0x7fcdf40b5040 comp rx=0 tx=0).stop 2023-06-09T04:38:38.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 msgr2=0x7fcdfc0d7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:38.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 0x7fcdfc0d7210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800e870 tx=0x7fcdf800ec70 comp rx=0 tx=0).stop 2023-06-09T04:38:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 shutdown_connections 2023-06-09T04:38:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc0e6c10 0x7fcdfc0dbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcde40662b0 0x7fcde4068760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcdfc033860 0x7fcdfc0e15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 --2- 172.21.15.18:0/3188872201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc006bb0 0x7fcdfc0d7210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:38.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 >> 172.21.15.18:0/3188872201 conn(0x7fcdfc051530 msgr2=0x7fcdfc0396e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:38.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 shutdown_connections 2023-06-09T04:38:38.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:38.959+0000 7fce08ab8640 1 -- 172.21.15.18:0/3188872201 wait complete. 2023-06-09T04:38:38.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2023-06-09T04:38:38.975 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2023-06-09T04:38:38.976 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2023-06-09T04:38:38.977 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2023-06-09T04:38:38.983 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2023-06-09T04:38:38.985 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2023-06-09T04:38:38.987 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:38.987 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T04:38:38.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:39.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.131+0000 7f548f1fd640 1 Processor -- start 2023-06-09T04:38:39.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.131+0000 7f548f1fd640 1 -- start start 2023-06-09T04:38:39.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548f1fd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 0x7f54880ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548f1fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f548806c3c0 0x7f548815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548f1fd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548806a900 con 0x7f5488158310 2023-06-09T04:38:39.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548f1fd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54880cd0f0 con 0x7f548806c3c0 2023-06-09T04:38:39.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548f1fd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548815ceb0 con 0x7f54881586e0 2023-06-09T04:38:39.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548cf99640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5488158310 0x7f548806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43640/0 (socket says 172.21.15.18:43640) 2023-06-09T04:38:39.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548cf99640 1 -- 172.21.15.18:0/576932624 learned_addr learned my addr 172.21.15.18:0/576932624 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:39.137 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419935813 0 0) 0x7f548806a900 con 0x7f5488158310 2023-06-09T04:38:39.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5470003530 con 0x7f5488158310 2023-06-09T04:38:39.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 0x7f54880ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548d79a640 1 --2- 172.21.15.18:0/576932624 >> v2:172.21.15.81:3300/0 conn(0x7f548806c3c0 0x7f548815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2613104693 0 0) 0x7f5470003530 con 0x7f5488158310 2023-06-09T04:38:39.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 msgr2=0x7f54880ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 0x7f54880ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 >> v2:172.21.15.81:3300/0 conn(0x7f548806c3c0 msgr2=0x7f548815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 --2- 172.21.15.18:0/576932624 >> v2:172.21.15.81:3300/0 conn(0x7f548806c3c0 0x7f548815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548815cbd0 con 0x7f5488158310 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f5478001680 con 0x7f5488158310 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548d79a640 1 --2- 172.21.15.18:0/576932624 >> v2:172.21.15.81:3300/0 conn(0x7f548806c3c0 0x7f548815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 >> v1:172.21.15.18:6789/0 conn(0x7f5488158310 legacy=0x7f548806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 0x7f5470003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470004d10 0x7f5470005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54880cd0f0 con 0x7f5470003fb0 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548815ceb0 con 0x7f5470004d10 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547000ba90 con 0x7f54881586e0 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548cf99640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 0x7f5470003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548d79a640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470004d10 0x7f5470005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 -- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 msgr2=0x7f5470003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54881586e0 0x7f5470003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 -- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470004d10 msgr2=0x7f5470005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470004d10 0x7f5470005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 -- 172.21.15.18:0/576932624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470003530 con 0x7f5470003fb0 2023-06-09T04:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f548d79a640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470004d10 0x7f5470005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f5487fff640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54700047d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f547c00ba30 tx=0x7f547c01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88161c98a708a4b7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0ad640 con 0x7f5470003fb0 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0ad7a0 con 0x7f5470003fb0 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.135+0000 7f54877fe640 1 -- 172.21.15.18:0/576932624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0adb50 con 0x7f5470003fb0 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/576932624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 msgr2=0x7f54700047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 --2- 172.21.15.18:0/576932624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54700047d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f547c00ba30 tx=0x7f547c01c640 comp rx=0 tx=0).stop 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548d79a640 1 -- 172.21.15.18:0/576932624 reap_dead start 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/576932624 shutdown_connections 2023-06-09T04:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/576932624 >> 172.21.15.18:0/576932624 conn(0x7f54880b0240 msgr2=0x7f54880cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/576932624 shutdown_connections 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/576932624 wait complete. 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 Processor -- start 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- start start 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54880c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5488142190 0x7f54880c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5488152080 0x7f54881524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488151500 con 0x7f5470003fb0 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488152d30 con 0x7f5488152080 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548813f590 con 0x7f5488142190 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54880c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54880c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38430/0 (socket says 172.21.15.18:38430) 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 -- 172.21.15.18:0/3669435440 learned_addr learned my addr 172.21.15.18:0/3669435440 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f5487fff640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5488142190 0x7f54880c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548d79a640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5488152080 0x7f54881524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 -- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5488142190 msgr2=0x7f54880c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5488142190 0x7f54880c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 -- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5488152080 msgr2=0x7f54881524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5488152080 0x7f54881524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 -- 172.21.15.18:0/3669435440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548813f870 con 0x7f5470003fb0 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548cf99640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54880c9150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5478011910 tx=0x7f5478011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800fc20 con 0x7f5470003fb0 2023-06-09T04:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547800fda0 con 0x7f5470003fb0 2023-06-09T04:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478015650 con 0x7f5470003fb0 2023-06-09T04:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548813fb50 con 0x7f5470003fb0 2023-06-09T04:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5488152a30 con 0x7f5470003fb0 2023-06-09T04:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.139+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548813f6d0 con 0x7f5470003fb0 2023-06-09T04:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.143+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54780157b0 con 0x7f5470003fb0 2023-06-09T04:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.143+0000 7f54857fa640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5474066280 0x7f5474068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.143+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54780873d0 con 0x7f5470003fb0 2023-06-09T04:38:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.143+0000 7f5487fff640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5474066280 0x7f5474068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.143+0000 7f5487fff640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5474066280 0x7f5474068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f547c0af000 tx=0x7f547c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.147+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f548813f6d0 con 0x7f5470003fb0 2023-06-09T04:38:39.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.291+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54880cc3b0 con 0x7f5474066280 2023-06-09T04:38:39.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.319+0000 7f54857fa640 1 -- 172.21.15.18:0/3669435440 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367350 (secure 0 0 0) 0x7f547c0bd090 con 0x7f5474066280 2023-06-09T04:38:39.323 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:39.325 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:38:39.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5474066280 msgr2=0x7f5474068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5474066280 0x7f5474068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f547c0af000 tx=0x7f547c0046d0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 msgr2=0x7f54880c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54880c9150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5478011910 tx=0x7f5478011dd0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 shutdown_connections 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5488152080 0x7f54881524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5474066280 0x7f5474068730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5488142190 0x7f54880c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 --2- 172.21.15.18:0/3669435440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5470003fb0 0x7f54880c9150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 >> 172.21.15.18:0/3669435440 conn(0x7f54880b0240 msgr2=0x7f5488156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 shutdown_connections 2023-06-09T04:38:39.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.323+0000 7f548f1fd640 1 -- 172.21.15.18:0/3669435440 wait complete. 2023-06-09T04:38:39.341 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-06-09T04:38:37.704220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235528,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739192,"statfs":{"total":773094113280,"available":772852932608,"internally_reserved":0,"allocated":3612672,"data_stored":2164046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005188"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985748+0000","last_change":"2023-06-09T04:38:15.615901+0000","last_active":"2023-06-09T04:38:15.985748+0000","last_peered":"2023-06-09T04:38:15.985748+0000","last_clean":"2023-06-09T04:38:15.985748+0000","last_became_active":"2023-06-09T04:38:15.614830+0000","last_became_peered":"2023-06-09T04:38:15.614830+0000","last_unstale":"2023-06-09T04:38:15.985748+0000","last_undegraded":"2023-06-09T04:38:15.985748+0000","last_fullsized":"2023-06-09T04:38:15.985748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:27:43.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561949+0000","last_change":"2023-06-09T04:38:11.203692+0000","last_active":"2023-06-09T04:38:16.561949+0000","last_peered":"2023-06-09T04:38:16.561949+0000","last_clean":"2023-06-09T04:38:16.561949+0000","last_became_active":"2023-06-09T04:38:11.202964+0000","last_became_peered":"2023-06-09T04:38:11.202964+0000","last_unstale":"2023-06-09T04:38:16.561949+0000","last_undegraded":"2023-06-09T04:38:16.561949+0000","last_fullsized":"2023-06-09T04:38:16.561949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:13.783096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981243+0000","last_change":"2023-06-09T04:38:11.594761+0000","last_active":"2023-06-09T04:38:15.981243+0000","last_peered":"2023-06-09T04:38:15.981243+0000","last_clean":"2023-06-09T04:38:15.981243+0000","last_became_active":"2023-06-09T04:38:11.594211+0000","last_became_peered":"2023-06-09T04:38:11.594211+0000","last_unstale":"2023-06-09T04:38:15.981243+0000","last_undegraded":"2023-06-09T04:38:15.981243+0000","last_fullsized":"2023-06-09T04:38:15.981243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065852+0000","last_change":"2023-06-09T04:38:15.632499+0000","last_active":"2023-06-09T04:38:16.065852+0000","last_peered":"2023-06-09T04:38:16.065852+0000","last_clean":"2023-06-09T04:38:16.065852+0000","last_became_active":"2023-06-09T04:38:15.632008+0000","last_became_peered":"2023-06-09T04:38:15.632008+0000","last_unstale":"2023-06-09T04:38:16.065852+0000","last_undegraded":"2023-06-09T04:38:16.065852+0000","last_fullsized":"2023-06-09T04:38:16.065852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561498+0000","last_change":"2023-06-09T04:38:11.200945+0000","last_active":"2023-06-09T04:38:16.561498+0000","last_peered":"2023-06-09T04:38:16.561498+0000","last_clean":"2023-06-09T04:38:16.561498+0000","last_became_active":"2023-06-09T04:38:11.200288+0000","last_became_peered":"2023-06-09T04:38:11.200288+0000","last_unstale":"2023-06-09T04:38:16.561498+0000","last_undegraded":"2023-06-09T04:38:16.561498+0000","last_fullsized":"2023-06-09T04:38:16.561498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:50.406974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560072+0000","last_change":"2023-06-09T04:38:11.585715+0000","last_active":"2023-06-09T04:38:16.560072+0000","last_peered":"2023-06-09T04:38:16.560072+0000","last_clean":"2023-06-09T04:38:16.560072+0000","last_became_active":"2023-06-09T04:38:11.584957+0000","last_became_peered":"2023-06-09T04:38:11.584957+0000","last_unstale":"2023-06-09T04:38:16.560072+0000","last_undegraded":"2023-06-09T04:38:16.560072+0000","last_fullsized":"2023-06-09T04:38:16.560072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:37:29.621473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981971+0000","last_change":"2023-06-09T04:38:15.637942+0000","last_active":"2023-06-09T04:38:15.981971+0000","last_peered":"2023-06-09T04:38:15.981971+0000","last_clean":"2023-06-09T04:38:15.981971+0000","last_became_active":"2023-06-09T04:38:15.637496+0000","last_became_peered":"2023-06-09T04:38:15.637496+0000","last_unstale":"2023-06-09T04:38:15.981971+0000","last_undegraded":"2023-06-09T04:38:15.981971+0000","last_fullsized":"2023-06-09T04:38:15.981971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:34.351945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559952+0000","last_change":"2023-06-09T04:38:11.185664+0000","last_active":"2023-06-09T04:38:16.559952+0000","last_peered":"2023-06-09T04:38:16.559952+0000","last_clean":"2023-06-09T04:38:16.559952+0000","last_became_active":"2023-06-09T04:38:11.185158+0000","last_became_peered":"2023-06-09T04:38:11.185158+0000","last_unstale":"2023-06-09T04:38:16.559952+0000","last_undegraded":"2023-06-09T04:38:16.559952+0000","last_fullsized":"2023-06-09T04:38:16.559952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.509050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981434+0000","last_change":"2023-06-09T04:38:11.585306+0000","last_active":"2023-06-09T04:38:15.981434+0000","last_peered":"2023-06-09T04:38:15.981434+0000","last_clean":"2023-06-09T04:38:15.981434+0000","last_became_active":"2023-06-09T04:38:11.584847+0000","last_became_peered":"2023-06-09T04:38:11.584847+0000","last_unstale":"2023-06-09T04:38:15.981434+0000","last_undegraded":"2023-06-09T04:38:15.981434+0000","last_fullsized":"2023-06-09T04:38:15.981434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066287+0000","last_change":"2023-06-09T04:38:15.622777+0000","last_active":"2023-06-09T04:38:16.066287+0000","last_peered":"2023-06-09T04:38:16.066287+0000","last_clean":"2023-06-09T04:38:16.066287+0000","last_became_active":"2023-06-09T04:38:15.622311+0000","last_became_peered":"2023-06-09T04:38:15.622311+0000","last_unstale":"2023-06-09T04:38:16.066287+0000","last_undegraded":"2023-06-09T04:38:16.066287+0000","last_fullsized":"2023-06-09T04:38:16.066287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:54.359850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066456+0000","last_change":"2023-06-09T04:38:11.189358+0000","last_active":"2023-06-09T04:38:16.066456+0000","last_peered":"2023-06-09T04:38:16.066456+0000","last_clean":"2023-06-09T04:38:16.066456+0000","last_became_active":"2023-06-09T04:38:11.188357+0000","last_became_peered":"2023-06-09T04:38:11.188357+0000","last_unstale":"2023-06-09T04:38:16.066456+0000","last_undegraded":"2023-06-09T04:38:16.066456+0000","last_fullsized":"2023-06-09T04:38:16.066456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:16.955337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982469+0000","last_change":"2023-06-09T04:38:11.579687+0000","last_active":"2023-06-09T04:38:15.982469+0000","last_peered":"2023-06-09T04:38:15.982469+0000","last_clean":"2023-06-09T04:38:15.982469+0000","last_became_active":"2023-06-09T04:38:11.579135+0000","last_became_peered":"2023-06-09T04:38:11.579135+0000","last_unstale":"2023-06-09T04:38:15.982469+0000","last_undegraded":"2023-06-09T04:38:15.982469+0000","last_fullsized":"2023-06-09T04:38:15.982469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:37.416450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986093+0000","last_change":"2023-06-09T04:38:15.652067+0000","last_active":"2023-06-09T04:38:15.986093+0000","last_peered":"2023-06-09T04:38:15.986093+0000","last_clean":"2023-06-09T04:38:15.986093+0000","last_became_active":"2023-06-09T04:38:15.651161+0000","last_became_peered":"2023-06-09T04:38:15.651161+0000","last_unstale":"2023-06-09T04:38:15.986093+0000","last_undegraded":"2023-06-09T04:38:15.986093+0000","last_fullsized":"2023-06-09T04:38:15.986093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:21.927575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985609+0000","last_change":"2023-06-09T04:38:11.180066+0000","last_active":"2023-06-09T04:38:15.985609+0000","last_peered":"2023-06-09T04:38:15.985609+0000","last_clean":"2023-06-09T04:38:15.985609+0000","last_became_active":"2023-06-09T04:38:11.179266+0000","last_became_peered":"2023-06-09T04:38:11.179266+0000","last_unstale":"2023-06-09T04:38:15.985609+0000","last_undegraded":"2023-06-09T04:38:15.985609+0000","last_fullsized":"2023-06-09T04:38:15.985609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:07.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986230+0000","last_change":"2023-06-09T04:38:11.594680+0000","last_active":"2023-06-09T04:38:15.986230+0000","last_peered":"2023-06-09T04:38:15.986230+0000","last_clean":"2023-06-09T04:38:15.986230+0000","last_became_active":"2023-06-09T04:38:11.594276+0000","last_became_peered":"2023-06-09T04:38:11.594276+0000","last_unstale":"2023-06-09T04:38:15.986230+0000","last_undegraded":"2023-06-09T04:38:15.986230+0000","last_fullsized":"2023-06-09T04:38:15.986230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:52.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981838+0000","last_change":"2023-06-09T04:38:15.648101+0000","last_active":"2023-06-09T04:38:15.981838+0000","last_peered":"2023-06-09T04:38:15.981838+0000","last_clean":"2023-06-09T04:38:15.981838+0000","last_became_active":"2023-06-09T04:38:15.647608+0000","last_became_peered":"2023-06-09T04:38:15.647608+0000","last_unstale":"2023-06-09T04:38:15.981838+0000","last_undegraded":"2023-06-09T04:38:15.981838+0000","last_fullsized":"2023-06-09T04:38:15.981838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066410+0000","last_change":"2023-06-09T04:38:11.201960+0000","last_active":"2023-06-09T04:38:16.066410+0000","last_peered":"2023-06-09T04:38:16.066410+0000","last_clean":"2023-06-09T04:38:16.066410+0000","last_became_active":"2023-06-09T04:38:11.201646+0000","last_became_peered":"2023-06-09T04:38:11.201646+0000","last_unstale":"2023-06-09T04:38:16.066410+0000","last_undegraded":"2023-06-09T04:38:16.066410+0000","last_fullsized":"2023-06-09T04:38:16.066410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:36.403064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559845+0000","last_change":"2023-06-09T04:38:11.594028+0000","last_active":"2023-06-09T04:38:16.559845+0000","last_peered":"2023-06-09T04:38:16.559845+0000","last_clean":"2023-06-09T04:38:16.559845+0000","last_became_active":"2023-06-09T04:38:11.593476+0000","last_became_peered":"2023-06-09T04:38:11.593476+0000","last_unstale":"2023-06-09T04:38:16.559845+0000","last_undegraded":"2023-06-09T04:38:16.559845+0000","last_fullsized":"2023-06-09T04:38:16.559845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:03:31.188379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982272+0000","last_change":"2023-06-09T04:38:15.639036+0000","last_active":"2023-06-09T04:38:15.982272+0000","last_peered":"2023-06-09T04:38:15.982272+0000","last_clean":"2023-06-09T04:38:15.982272+0000","last_became_active":"2023-06-09T04:38:15.638526+0000","last_became_peered":"2023-06-09T04:38:15.638526+0000","last_unstale":"2023-06-09T04:38:15.982272+0000","last_undegraded":"2023-06-09T04:38:15.982272+0000","last_fullsized":"2023-06-09T04:38:15.982272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:01.380927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986379+0000","last_change":"2023-06-09T04:38:11.206571+0000","last_active":"2023-06-09T04:38:15.986379+0000","last_peered":"2023-06-09T04:38:15.986379+0000","last_clean":"2023-06-09T04:38:15.986379+0000","last_became_active":"2023-06-09T04:38:11.205967+0000","last_became_peered":"2023-06-09T04:38:11.205967+0000","last_unstale":"2023-06-09T04:38:15.986379+0000","last_undegraded":"2023-06-09T04:38:15.986379+0000","last_fullsized":"2023-06-09T04:38:15.986379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.580093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984552+0000","last_change":"2023-06-09T04:38:11.591665+0000","last_active":"2023-06-09T04:38:15.984552+0000","last_peered":"2023-06-09T04:38:15.984552+0000","last_clean":"2023-06-09T04:38:15.984552+0000","last_became_active":"2023-06-09T04:38:11.591215+0000","last_became_peered":"2023-06-09T04:38:11.591215+0000","last_unstale":"2023-06-09T04:38:15.984552+0000","last_undegraded":"2023-06-09T04:38:15.984552+0000","last_fullsized":"2023-06-09T04:38:15.984552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:05.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985492+0000","last_change":"2023-06-09T04:38:15.645060+0000","last_active":"2023-06-09T04:38:15.985492+0000","last_peered":"2023-06-09T04:38:15.985492+0000","last_clean":"2023-06-09T04:38:15.985492+0000","last_became_active":"2023-06-09T04:38:15.644019+0000","last_became_peered":"2023-06-09T04:38:15.644019+0000","last_unstale":"2023-06-09T04:38:15.985492+0000","last_undegraded":"2023-06-09T04:38:15.985492+0000","last_fullsized":"2023-06-09T04:38:15.985492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559446+0000","last_change":"2023-06-09T04:38:11.195096+0000","last_active":"2023-06-09T04:38:16.559446+0000","last_peered":"2023-06-09T04:38:16.559446+0000","last_clean":"2023-06-09T04:38:16.559446+0000","last_became_active":"2023-06-09T04:38:11.193967+0000","last_became_peered":"2023-06-09T04:38:11.193967+0000","last_unstale":"2023-06-09T04:38:16.559446+0000","last_undegraded":"2023-06-09T04:38:16.559446+0000","last_fullsized":"2023-06-09T04:38:16.559446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:31:01.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560496+0000","last_change":"2023-06-09T04:38:11.598907+0000","last_active":"2023-06-09T04:38:16.560496+0000","last_peered":"2023-06-09T04:38:16.560496+0000","last_clean":"2023-06-09T04:38:16.560496+0000","last_became_active":"2023-06-09T04:38:11.598448+0000","last_became_peered":"2023-06-09T04:38:11.598448+0000","last_unstale":"2023-06-09T04:38:16.560496+0000","last_undegraded":"2023-06-09T04:38:16.560496+0000","last_fullsized":"2023-06-09T04:38:16.560496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:15:01.066687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559038+0000","last_change":"2023-06-09T04:38:11.584299+0000","last_active":"2023-06-09T04:38:16.559038+0000","last_peered":"2023-06-09T04:38:16.559038+0000","last_clean":"2023-06-09T04:38:16.559038+0000","last_became_active":"2023-06-09T04:38:11.584067+0000","last_became_peered":"2023-06-09T04:38:11.584067+0000","last_unstale":"2023-06-09T04:38:16.559038+0000","last_undegraded":"2023-06-09T04:38:16.559038+0000","last_fullsized":"2023-06-09T04:38:16.559038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:49:59.751085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.562107+0000","last_change":"2023-06-09T04:38:11.202669+0000","last_active":"2023-06-09T04:38:16.562107+0000","last_peered":"2023-06-09T04:38:16.562107+0000","last_clean":"2023-06-09T04:38:16.562107+0000","last_became_active":"2023-06-09T04:38:11.201665+0000","last_became_peered":"2023-06-09T04:38:11.201665+0000","last_unstale":"2023-06-09T04:38:16.562107+0000","last_undegraded":"2023-06-09T04:38:16.562107+0000","last_fullsized":"2023-06-09T04:38:16.562107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:40.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559172+0000","last_change":"2023-06-09T04:38:15.638570+0000","last_active":"2023-06-09T04:38:16.559172+0000","last_peered":"2023-06-09T04:38:16.559172+0000","last_clean":"2023-06-09T04:38:16.559172+0000","last_became_active":"2023-06-09T04:38:15.638066+0000","last_became_peered":"2023-06-09T04:38:15.638066+0000","last_unstale":"2023-06-09T04:38:16.559172+0000","last_undegraded":"2023-06-09T04:38:16.559172+0000","last_fullsized":"2023-06-09T04:38:16.559172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:55.971330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986040+0000","last_change":"2023-06-09T04:38:11.591894+0000","last_active":"2023-06-09T04:38:15.986040+0000","last_peered":"2023-06-09T04:38:15.986040+0000","last_clean":"2023-06-09T04:38:15.986040+0000","last_became_active":"2023-06-09T04:38:11.590872+0000","last_became_peered":"2023-06-09T04:38:11.590872+0000","last_unstale":"2023-06-09T04:38:15.986040+0000","last_undegraded":"2023-06-09T04:38:15.986040+0000","last_fullsized":"2023-06-09T04:38:15.986040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:13.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982353+0000","last_change":"2023-06-09T04:38:11.173622+0000","last_active":"2023-06-09T04:38:15.982353+0000","last_peered":"2023-06-09T04:38:15.982353+0000","last_clean":"2023-06-09T04:38:15.982353+0000","last_became_active":"2023-06-09T04:38:11.173296+0000","last_became_peered":"2023-06-09T04:38:11.173296+0000","last_unstale":"2023-06-09T04:38:15.982353+0000","last_undegraded":"2023-06-09T04:38:15.982353+0000","last_fullsized":"2023-06-09T04:38:15.982353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:14.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981275+0000","last_change":"2023-06-09T04:38:15.624872+0000","last_active":"2023-06-09T04:38:15.981275+0000","last_peered":"2023-06-09T04:38:15.981275+0000","last_clean":"2023-06-09T04:38:15.981275+0000","last_became_active":"2023-06-09T04:38:15.623576+0000","last_became_peered":"2023-06-09T04:38:15.623576+0000","last_unstale":"2023-06-09T04:38:15.981275+0000","last_undegraded":"2023-06-09T04:38:15.981275+0000","last_fullsized":"2023-06-09T04:38:15.981275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:29.450913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116345+0000","last_change":"2023-06-09T04:38:11.191574+0000","last_active":"2023-06-09T04:38:16.116345+0000","last_peered":"2023-06-09T04:38:16.116345+0000","last_clean":"2023-06-09T04:38:16.116345+0000","last_became_active":"2023-06-09T04:38:11.191265+0000","last_became_peered":"2023-06-09T04:38:11.191265+0000","last_unstale":"2023-06-09T04:38:16.116345+0000","last_undegraded":"2023-06-09T04:38:16.116345+0000","last_fullsized":"2023-06-09T04:38:16.116345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:36.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983839+0000","last_change":"2023-06-09T04:38:11.602110+0000","last_active":"2023-06-09T04:38:15.983839+0000","last_peered":"2023-06-09T04:38:15.983839+0000","last_clean":"2023-06-09T04:38:15.983839+0000","last_became_active":"2023-06-09T04:38:11.601863+0000","last_became_peered":"2023-06-09T04:38:11.601863+0000","last_unstale":"2023-06-09T04:38:15.983839+0000","last_undegraded":"2023-06-09T04:38:15.983839+0000","last_fullsized":"2023-06-09T04:38:15.983839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:33.650536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983706+0000","last_change":"2023-06-09T04:38:15.652599+0000","last_active":"2023-06-09T04:38:15.983706+0000","last_peered":"2023-06-09T04:38:15.983706+0000","last_clean":"2023-06-09T04:38:15.983706+0000","last_became_active":"2023-06-09T04:38:15.651894+0000","last_became_peered":"2023-06-09T04:38:15.651894+0000","last_unstale":"2023-06-09T04:38:15.983706+0000","last_undegraded":"2023-06-09T04:38:15.983706+0000","last_fullsized":"2023-06-09T04:38:15.983706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:39:05.473086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:21.329783+0000","last_change":"2023-06-09T04:38:11.178844+0000","last_active":"2023-06-09T04:38:21.329783+0000","last_peered":"2023-06-09T04:38:21.329783+0000","last_clean":"2023-06-09T04:38:21.329783+0000","last_became_active":"2023-06-09T04:38:11.178527+0000","last_became_peered":"2023-06-09T04:38:11.178527+0000","last_unstale":"2023-06-09T04:38:21.329783+0000","last_undegraded":"2023-06-09T04:38:21.329783+0000","last_fullsized":"2023-06-09T04:38:21.329783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:38.682351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982266+0000","last_change":"2023-06-09T04:38:11.590873+0000","last_active":"2023-06-09T04:38:15.982266+0000","last_peered":"2023-06-09T04:38:15.982266+0000","last_clean":"2023-06-09T04:38:15.982266+0000","last_became_active":"2023-06-09T04:38:11.590341+0000","last_became_peered":"2023-06-09T04:38:11.590341+0000","last_unstale":"2023-06-09T04:38:15.982266+0000","last_undegraded":"2023-06-09T04:38:15.982266+0000","last_fullsized":"2023-06-09T04:38:15.982266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982961+0000","last_change":"2023-06-09T04:38:15.641224+0000","last_active":"2023-06-09T04:38:15.982961+0000","last_peered":"2023-06-09T04:38:15.982961+0000","last_clean":"2023-06-09T04:38:15.982961+0000","last_became_active":"2023-06-09T04:38:15.630567+0000","last_became_peered":"2023-06-09T04:38:15.630567+0000","last_unstale":"2023-06-09T04:38:15.982961+0000","last_undegraded":"2023-06-09T04:38:15.982961+0000","last_fullsized":"2023-06-09T04:38:15.982961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:33.133686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981808+0000","last_change":"2023-06-09T04:38:11.591047+0000","last_active":"2023-06-09T04:38:15.981808+0000","last_peered":"2023-06-09T04:38:15.981808+0000","last_clean":"2023-06-09T04:38:15.981808+0000","last_became_active":"2023-06-09T04:38:11.590710+0000","last_became_peered":"2023-06-09T04:38:11.590710+0000","last_unstale":"2023-06-09T04:38:15.981808+0000","last_undegraded":"2023-06-09T04:38:15.981808+0000","last_fullsized":"2023-06-09T04:38:15.981808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561003+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:38:16.561003+0000","last_peered":"2023-06-09T04:38:16.561003+0000","last_clean":"2023-06-09T04:38:16.561003+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:38:16.561003+0000","last_undegraded":"2023-06-09T04:38:16.561003+0000","last_fullsized":"2023-06-09T04:38:16.561003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:56:41.217550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984485+0000","last_change":"2023-06-09T04:38:11.206839+0000","last_active":"2023-06-09T04:38:15.984485+0000","last_peered":"2023-06-09T04:38:15.984485+0000","last_clean":"2023-06-09T04:38:15.984485+0000","last_became_active":"2023-06-09T04:38:11.206136+0000","last_became_peered":"2023-06-09T04:38:11.206136+0000","last_unstale":"2023-06-09T04:38:15.984485+0000","last_undegraded":"2023-06-09T04:38:15.984485+0000","last_fullsized":"2023-06-09T04:38:15.984485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:00:59.250719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983799+0000","last_change":"2023-06-09T04:38:15.654768+0000","last_active":"2023-06-09T04:38:15.983799+0000","last_peered":"2023-06-09T04:38:15.983799+0000","last_clean":"2023-06-09T04:38:15.983799+0000","last_became_active":"2023-06-09T04:38:15.653848+0000","last_became_peered":"2023-06-09T04:38:15.653848+0000","last_unstale":"2023-06-09T04:38:15.983799+0000","last_undegraded":"2023-06-09T04:38:15.983799+0000","last_fullsized":"2023-06-09T04:38:15.983799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:35:20.247138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984327+0000","last_change":"2023-06-09T04:38:11.576946+0000","last_active":"2023-06-09T04:38:15.984327+0000","last_peered":"2023-06-09T04:38:15.984327+0000","last_clean":"2023-06-09T04:38:15.984327+0000","last_became_active":"2023-06-09T04:38:11.576234+0000","last_became_peered":"2023-06-09T04:38:11.576234+0000","last_unstale":"2023-06-09T04:38:15.984327+0000","last_undegraded":"2023-06-09T04:38:15.984327+0000","last_fullsized":"2023-06-09T04:38:15.984327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:09:39.247053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986402+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:38:15.986402+0000","last_peered":"2023-06-09T04:38:15.986402+0000","last_clean":"2023-06-09T04:38:15.986402+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:38:15.986402+0000","last_undegraded":"2023-06-09T04:38:15.986402+0000","last_fullsized":"2023-06-09T04:38:15.986402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:17.380871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985503+0000","last_change":"2023-06-09T04:38:11.207993+0000","last_active":"2023-06-09T04:38:15.985503+0000","last_peered":"2023-06-09T04:38:15.985503+0000","last_clean":"2023-06-09T04:38:15.985503+0000","last_became_active":"2023-06-09T04:38:11.207375+0000","last_became_peered":"2023-06-09T04:38:11.207375+0000","last_unstale":"2023-06-09T04:38:15.985503+0000","last_undegraded":"2023-06-09T04:38:15.985503+0000","last_fullsized":"2023-06-09T04:38:15.985503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:58.163202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559365+0000","last_change":"2023-06-09T04:38:15.629330+0000","last_active":"2023-06-09T04:38:16.559365+0000","last_peered":"2023-06-09T04:38:16.559365+0000","last_clean":"2023-06-09T04:38:16.559365+0000","last_became_active":"2023-06-09T04:38:15.628803+0000","last_became_peered":"2023-06-09T04:38:15.628803+0000","last_unstale":"2023-06-09T04:38:16.559365+0000","last_undegraded":"2023-06-09T04:38:16.559365+0000","last_fullsized":"2023-06-09T04:38:16.559365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:25.965238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985856+0000","last_change":"2023-06-09T04:38:11.582531+0000","last_active":"2023-06-09T04:38:15.985856+0000","last_peered":"2023-06-09T04:38:15.985856+0000","last_clean":"2023-06-09T04:38:15.985856+0000","last_became_active":"2023-06-09T04:38:11.581963+0000","last_became_peered":"2023-06-09T04:38:11.581963+0000","last_unstale":"2023-06-09T04:38:15.985856+0000","last_undegraded":"2023-06-09T04:38:15.985856+0000","last_fullsized":"2023-06-09T04:38:15.985856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560988+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:38:16.560988+0000","last_peered":"2023-06-09T04:38:16.560988+0000","last_clean":"2023-06-09T04:38:16.560988+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:38:16.560988+0000","last_undegraded":"2023-06-09T04:38:16.560988+0000","last_fullsized":"2023-06-09T04:38:16.560988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:08.570686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984867+0000","last_change":"2023-06-09T04:38:11.203569+0000","last_active":"2023-06-09T04:38:15.984867+0000","last_peered":"2023-06-09T04:38:15.984867+0000","last_clean":"2023-06-09T04:38:15.984867+0000","last_became_active":"2023-06-09T04:38:11.202787+0000","last_became_peered":"2023-06-09T04:38:11.202787+0000","last_unstale":"2023-06-09T04:38:15.984867+0000","last_undegraded":"2023-06-09T04:38:15.984867+0000","last_fullsized":"2023-06-09T04:38:15.984867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:57.391865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115733+0000","last_change":"2023-06-09T04:38:15.638680+0000","last_active":"2023-06-09T04:38:16.115733+0000","last_peered":"2023-06-09T04:38:16.115733+0000","last_clean":"2023-06-09T04:38:16.115733+0000","last_became_active":"2023-06-09T04:38:15.638219+0000","last_became_peered":"2023-06-09T04:38:15.638219+0000","last_unstale":"2023-06-09T04:38:16.115733+0000","last_undegraded":"2023-06-09T04:38:16.115733+0000","last_fullsized":"2023-06-09T04:38:16.115733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:36.541614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983149+0000","last_change":"2023-06-09T04:38:11.589753+0000","last_active":"2023-06-09T04:38:15.983149+0000","last_peered":"2023-06-09T04:38:15.983149+0000","last_clean":"2023-06-09T04:38:15.983149+0000","last_became_active":"2023-06-09T04:38:11.589289+0000","last_became_peered":"2023-06-09T04:38:11.589289+0000","last_unstale":"2023-06-09T04:38:15.983149+0000","last_undegraded":"2023-06-09T04:38:15.983149+0000","last_fullsized":"2023-06-09T04:38:15.983149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.797205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560927+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:38:16.560927+0000","last_peered":"2023-06-09T04:38:16.560927+0000","last_clean":"2023-06-09T04:38:16.560927+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:38:16.560927+0000","last_undegraded":"2023-06-09T04:38:16.560927+0000","last_fullsized":"2023-06-09T04:38:16.560927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:48.345845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981929+0000","last_change":"2023-06-09T04:38:11.191786+0000","last_active":"2023-06-09T04:38:15.981929+0000","last_peered":"2023-06-09T04:38:15.981929+0000","last_clean":"2023-06-09T04:38:15.981929+0000","last_became_active":"2023-06-09T04:38:11.191379+0000","last_became_peered":"2023-06-09T04:38:11.191379+0000","last_unstale":"2023-06-09T04:38:15.981929+0000","last_undegraded":"2023-06-09T04:38:15.981929+0000","last_fullsized":"2023-06-09T04:38:15.981929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984276+0000","last_change":"2023-06-09T04:38:15.652331+0000","last_active":"2023-06-09T04:38:15.984276+0000","last_peered":"2023-06-09T04:38:15.984276+0000","last_clean":"2023-06-09T04:38:15.984276+0000","last_became_active":"2023-06-09T04:38:15.651379+0000","last_became_peered":"2023-06-09T04:38:15.651379+0000","last_unstale":"2023-06-09T04:38:15.984276+0000","last_undegraded":"2023-06-09T04:38:15.984276+0000","last_fullsized":"2023-06-09T04:38:15.984276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:23.892869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984378+0000","last_change":"2023-06-09T04:38:11.581677+0000","last_active":"2023-06-09T04:38:15.984378+0000","last_peered":"2023-06-09T04:38:15.984378+0000","last_clean":"2023-06-09T04:38:15.984378+0000","last_became_active":"2023-06-09T04:38:11.580936+0000","last_became_peered":"2023-06-09T04:38:11.580936+0000","last_unstale":"2023-06-09T04:38:15.984378+0000","last_undegraded":"2023-06-09T04:38:15.984378+0000","last_fullsized":"2023-06-09T04:38:15.984378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115946+0000","last_change":"2023-06-09T04:38:11.182996+0000","last_active":"2023-06-09T04:38:16.115946+0000","last_peered":"2023-06-09T04:38:16.115946+0000","last_clean":"2023-06-09T04:38:16.115946+0000","last_became_active":"2023-06-09T04:38:11.182625+0000","last_became_peered":"2023-06-09T04:38:11.182625+0000","last_unstale":"2023-06-09T04:38:16.115946+0000","last_undegraded":"2023-06-09T04:38:16.115946+0000","last_fullsized":"2023-06-09T04:38:16.115946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:18.783819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560422+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:38:16.560422+0000","last_peered":"2023-06-09T04:38:16.560422+0000","last_clean":"2023-06-09T04:38:16.560422+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:38:16.560422+0000","last_undegraded":"2023-06-09T04:38:16.560422+0000","last_fullsized":"2023-06-09T04:38:16.560422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:23:30.684840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559603+0000","last_change":"2023-06-09T04:38:15.645663+0000","last_active":"2023-06-09T04:38:16.559603+0000","last_peered":"2023-06-09T04:38:16.559603+0000","last_clean":"2023-06-09T04:38:16.559603+0000","last_became_active":"2023-06-09T04:38:15.644922+0000","last_became_peered":"2023-06-09T04:38:15.644922+0000","last_unstale":"2023-06-09T04:38:16.559603+0000","last_undegraded":"2023-06-09T04:38:16.559603+0000","last_fullsized":"2023-06-09T04:38:16.559603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:58:02.310074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985956+0000","last_change":"2023-06-09T04:38:11.581442+0000","last_active":"2023-06-09T04:38:15.985956+0000","last_peered":"2023-06-09T04:38:15.985956+0000","last_clean":"2023-06-09T04:38:15.985956+0000","last_became_active":"2023-06-09T04:38:11.580940+0000","last_became_peered":"2023-06-09T04:38:11.580940+0000","last_unstale":"2023-06-09T04:38:15.985956+0000","last_undegraded":"2023-06-09T04:38:15.985956+0000","last_fullsized":"2023-06-09T04:38:15.985956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.557750+0000","last_change":"2023-06-09T04:38:11.201284+0000","last_active":"2023-06-09T04:38:16.557750+0000","last_peered":"2023-06-09T04:38:16.557750+0000","last_clean":"2023-06-09T04:38:16.557750+0000","last_became_active":"2023-06-09T04:38:11.200454+0000","last_became_peered":"2023-06-09T04:38:11.200454+0000","last_unstale":"2023-06-09T04:38:16.557750+0000","last_undegraded":"2023-06-09T04:38:16.557750+0000","last_fullsized":"2023-06-09T04:38:16.557750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:53.244123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559796+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:38:16.559796+0000","last_peered":"2023-06-09T04:38:16.559796+0000","last_clean":"2023-06-09T04:38:16.559796+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:38:16.559796+0000","last_undegraded":"2023-06-09T04:38:16.559796+0000","last_fullsized":"2023-06-09T04:38:16.559796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:35:18.640660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559491+0000","last_change":"2023-06-09T04:38:15.644559+0000","last_active":"2023-06-09T04:38:16.559491+0000","last_peered":"2023-06-09T04:38:16.559491+0000","last_clean":"2023-06-09T04:38:16.559491+0000","last_became_active":"2023-06-09T04:38:15.643793+0000","last_became_peered":"2023-06-09T04:38:15.643793+0000","last_unstale":"2023-06-09T04:38:16.559491+0000","last_undegraded":"2023-06-09T04:38:16.559491+0000","last_fullsized":"2023-06-09T04:38:16.559491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:27.198186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561351+0000","last_change":"2023-06-09T04:38:11.582052+0000","last_active":"2023-06-09T04:38:16.561351+0000","last_peered":"2023-06-09T04:38:16.561351+0000","last_clean":"2023-06-09T04:38:16.561351+0000","last_became_active":"2023-06-09T04:38:11.581569+0000","last_became_peered":"2023-06-09T04:38:11.581569+0000","last_unstale":"2023-06-09T04:38:16.561351+0000","last_undegraded":"2023-06-09T04:38:16.561351+0000","last_fullsized":"2023-06-09T04:38:16.561351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:27:07.420266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983212+0000","last_change":"2023-06-09T04:38:11.193727+0000","last_active":"2023-06-09T04:38:15.983212+0000","last_peered":"2023-06-09T04:38:15.983212+0000","last_clean":"2023-06-09T04:38:15.983212+0000","last_became_active":"2023-06-09T04:38:11.191671+0000","last_became_peered":"2023-06-09T04:38:11.191671+0000","last_unstale":"2023-06-09T04:38:15.983212+0000","last_undegraded":"2023-06-09T04:38:15.983212+0000","last_fullsized":"2023-06-09T04:38:15.983212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:18.631690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560388+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:38:16.560388+0000","last_peered":"2023-06-09T04:38:16.560388+0000","last_clean":"2023-06-09T04:38:16.560388+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:38:16.560388+0000","last_undegraded":"2023-06-09T04:38:16.560388+0000","last_fullsized":"2023-06-09T04:38:16.560388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:46.578064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560338+0000","last_change":"2023-06-09T04:38:15.631104+0000","last_active":"2023-06-09T04:38:16.560338+0000","last_peered":"2023-06-09T04:38:16.560338+0000","last_clean":"2023-06-09T04:38:16.560338+0000","last_became_active":"2023-06-09T04:38:15.630126+0000","last_became_peered":"2023-06-09T04:38:15.630126+0000","last_unstale":"2023-06-09T04:38:16.560338+0000","last_undegraded":"2023-06-09T04:38:16.560338+0000","last_fullsized":"2023-06-09T04:38:16.560338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:11:32.650489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560095+0000","last_change":"2023-06-09T04:38:11.609569+0000","last_active":"2023-06-09T04:38:16.560095+0000","last_peered":"2023-06-09T04:38:16.560095+0000","last_clean":"2023-06-09T04:38:16.560095+0000","last_became_active":"2023-06-09T04:38:11.608179+0000","last_became_peered":"2023-06-09T04:38:11.608179+0000","last_unstale":"2023-06-09T04:38:16.560095+0000","last_undegraded":"2023-06-09T04:38:16.560095+0000","last_fullsized":"2023-06-09T04:38:16.560095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:09:01.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984195+0000","last_change":"2023-06-09T04:38:11.180161+0000","last_active":"2023-06-09T04:38:15.984195+0000","last_peered":"2023-06-09T04:38:15.984195+0000","last_clean":"2023-06-09T04:38:15.984195+0000","last_became_active":"2023-06-09T04:38:11.179361+0000","last_became_peered":"2023-06-09T04:38:11.179361+0000","last_unstale":"2023-06-09T04:38:15.984195+0000","last_undegraded":"2023-06-09T04:38:15.984195+0000","last_fullsized":"2023-06-09T04:38:15.984195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:36:14.841594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560750+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:38:16.560750+0000","last_peered":"2023-06-09T04:38:16.560750+0000","last_clean":"2023-06-09T04:38:16.560750+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:38:16.560750+0000","last_undegraded":"2023-06-09T04:38:16.560750+0000","last_fullsized":"2023-06-09T04:38:16.560750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:05.863481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066863+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:38:16.066863+0000","last_peered":"2023-06-09T04:38:16.066863+0000","last_clean":"2023-06-09T04:38:16.066863+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:38:16.066863+0000","last_undegraded":"2023-06-09T04:38:16.066863+0000","last_fullsized":"2023-06-09T04:38:16.066863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:17.786150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116200+0000","last_change":"2023-06-09T04:38:15.648847+0000","last_active":"2023-06-09T04:38:16.116200+0000","last_peered":"2023-06-09T04:38:16.116200+0000","last_clean":"2023-06-09T04:38:16.116200+0000","last_became_active":"2023-06-09T04:38:15.648379+0000","last_became_peered":"2023-06-09T04:38:15.648379+0000","last_unstale":"2023-06-09T04:38:16.116200+0000","last_undegraded":"2023-06-09T04:38:16.116200+0000","last_fullsized":"2023-06-09T04:38:16.116200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:23.070086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559158+0000","last_change":"2023-06-09T04:38:11.599288+0000","last_active":"2023-06-09T04:38:16.559158+0000","last_peered":"2023-06-09T04:38:16.559158+0000","last_clean":"2023-06-09T04:38:16.559158+0000","last_became_active":"2023-06-09T04:38:11.598737+0000","last_became_peered":"2023-06-09T04:38:11.598737+0000","last_unstale":"2023-06-09T04:38:16.559158+0000","last_undegraded":"2023-06-09T04:38:16.559158+0000","last_fullsized":"2023-06-09T04:38:16.559158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:35.326089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986583+0000","last_change":"2023-06-09T04:38:11.191838+0000","last_active":"2023-06-09T04:38:15.986583+0000","last_peered":"2023-06-09T04:38:15.986583+0000","last_clean":"2023-06-09T04:38:15.986583+0000","last_became_active":"2023-06-09T04:38:11.191075+0000","last_became_peered":"2023-06-09T04:38:11.191075+0000","last_unstale":"2023-06-09T04:38:15.986583+0000","last_undegraded":"2023-06-09T04:38:15.986583+0000","last_fullsized":"2023-06-09T04:38:15.986583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:46.284052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560839+0000","last_change":"2023-06-09T04:38:15.613910+0000","last_active":"2023-06-09T04:38:16.560839+0000","last_peered":"2023-06-09T04:38:16.560839+0000","last_clean":"2023-06-09T04:38:16.560839+0000","last_became_active":"2023-06-09T04:38:15.613324+0000","last_became_peered":"2023-06-09T04:38:15.613324+0000","last_unstale":"2023-06-09T04:38:16.560839+0000","last_undegraded":"2023-06-09T04:38:16.560839+0000","last_fullsized":"2023-06-09T04:38:16.560839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:37:53.617189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982270+0000","last_change":"2023-06-09T04:38:11.565137+0000","last_active":"2023-06-09T04:38:15.982270+0000","last_peered":"2023-06-09T04:38:15.982270+0000","last_clean":"2023-06-09T04:38:15.982270+0000","last_became_active":"2023-06-09T04:38:11.564885+0000","last_became_peered":"2023-06-09T04:38:11.564885+0000","last_unstale":"2023-06-09T04:38:15.982270+0000","last_undegraded":"2023-06-09T04:38:15.982270+0000","last_fullsized":"2023-06-09T04:38:15.982270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:50.934840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560844+0000","last_change":"2023-06-09T04:38:11.210525+0000","last_active":"2023-06-09T04:38:16.560844+0000","last_peered":"2023-06-09T04:38:16.560844+0000","last_clean":"2023-06-09T04:38:16.560844+0000","last_became_active":"2023-06-09T04:38:11.210047+0000","last_became_peered":"2023-06-09T04:38:11.210047+0000","last_unstale":"2023-06-09T04:38:16.560844+0000","last_undegraded":"2023-06-09T04:38:16.560844+0000","last_fullsized":"2023-06-09T04:38:16.560844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:57.325527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066485+0000","last_change":"2023-06-09T04:38:15.616243+0000","last_active":"2023-06-09T04:38:16.066485+0000","last_peered":"2023-06-09T04:38:16.066485+0000","last_clean":"2023-06-09T04:38:16.066485+0000","last_became_active":"2023-06-09T04:38:15.615680+0000","last_became_peered":"2023-06-09T04:38:15.615680+0000","last_unstale":"2023-06-09T04:38:16.066485+0000","last_undegraded":"2023-06-09T04:38:16.066485+0000","last_fullsized":"2023-06-09T04:38:16.066485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:48.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559686+0000","last_change":"2023-06-09T04:38:11.609943+0000","last_active":"2023-06-09T04:38:16.559686+0000","last_peered":"2023-06-09T04:38:16.559686+0000","last_clean":"2023-06-09T04:38:16.559686+0000","last_became_active":"2023-06-09T04:38:11.608810+0000","last_became_peered":"2023-06-09T04:38:11.608810+0000","last_unstale":"2023-06-09T04:38:16.559686+0000","last_undegraded":"2023-06-09T04:38:16.559686+0000","last_fullsized":"2023-06-09T04:38:16.559686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:54:36.052953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560271+0000","last_change":"2023-06-09T04:38:11.173638+0000","last_active":"2023-06-09T04:38:16.560271+0000","last_peered":"2023-06-09T04:38:16.560271+0000","last_clean":"2023-06-09T04:38:16.560271+0000","last_became_active":"2023-06-09T04:38:11.173388+0000","last_became_peered":"2023-06-09T04:38:11.173388+0000","last_unstale":"2023-06-09T04:38:16.560271+0000","last_undegraded":"2023-06-09T04:38:16.560271+0000","last_fullsized":"2023-06-09T04:38:16.560271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:51:29.591833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560504+0000","last_change":"2023-06-09T04:38:15.614814+0000","last_active":"2023-06-09T04:38:16.560504+0000","last_peered":"2023-06-09T04:38:16.560504+0000","last_clean":"2023-06-09T04:38:16.560504+0000","last_became_active":"2023-06-09T04:38:15.613623+0000","last_became_peered":"2023-06-09T04:38:15.613623+0000","last_unstale":"2023-06-09T04:38:16.560504+0000","last_undegraded":"2023-06-09T04:38:16.560504+0000","last_fullsized":"2023-06-09T04:38:16.560504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:48:43.207948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116961+0000","last_change":"2023-06-09T04:38:11.596789+0000","last_active":"2023-06-09T04:38:16.116961+0000","last_peered":"2023-06-09T04:38:16.116961+0000","last_clean":"2023-06-09T04:38:16.116961+0000","last_became_active":"2023-06-09T04:38:11.596416+0000","last_became_peered":"2023-06-09T04:38:11.596416+0000","last_unstale":"2023-06-09T04:38:16.116961+0000","last_undegraded":"2023-06-09T04:38:16.116961+0000","last_fullsized":"2023-06-09T04:38:16.116961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558934+0000","last_change":"2023-06-09T04:38:11.199156+0000","last_active":"2023-06-09T04:38:16.558934+0000","last_peered":"2023-06-09T04:38:16.558934+0000","last_clean":"2023-06-09T04:38:16.558934+0000","last_became_active":"2023-06-09T04:38:11.198208+0000","last_became_peered":"2023-06-09T04:38:11.198208+0000","last_unstale":"2023-06-09T04:38:16.558934+0000","last_undegraded":"2023-06-09T04:38:16.558934+0000","last_fullsized":"2023-06-09T04:38:16.558934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:02.979372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559203+0000","last_change":"2023-06-09T04:38:15.644288+0000","last_active":"2023-06-09T04:38:16.559203+0000","last_peered":"2023-06-09T04:38:16.559203+0000","last_clean":"2023-06-09T04:38:16.559203+0000","last_became_active":"2023-06-09T04:38:15.643538+0000","last_became_peered":"2023-06-09T04:38:15.643538+0000","last_unstale":"2023-06-09T04:38:16.559203+0000","last_undegraded":"2023-06-09T04:38:16.559203+0000","last_fullsized":"2023-06-09T04:38:16.559203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:33:30.456054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560700+0000","last_change":"2023-06-09T04:38:11.596225+0000","last_active":"2023-06-09T04:38:16.560700+0000","last_peered":"2023-06-09T04:38:16.560700+0000","last_clean":"2023-06-09T04:38:16.560700+0000","last_became_active":"2023-06-09T04:38:11.595908+0000","last_became_peered":"2023-06-09T04:38:11.595908+0000","last_unstale":"2023-06-09T04:38:16.560700+0000","last_undegraded":"2023-06-09T04:38:16.560700+0000","last_fullsized":"2023-06-09T04:38:16.560700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:22:22.632206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.117460+0000","last_change":"2023-06-09T04:38:11.192489+0000","last_active":"2023-06-09T04:38:16.117460+0000","last_peered":"2023-06-09T04:38:16.117460+0000","last_clean":"2023-06-09T04:38:16.117460+0000","last_became_active":"2023-06-09T04:38:11.191911+0000","last_became_peered":"2023-06-09T04:38:11.191911+0000","last_unstale":"2023-06-09T04:38:16.117460+0000","last_undegraded":"2023-06-09T04:38:16.117460+0000","last_fullsized":"2023-06-09T04:38:16.117460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983119+0000","last_change":"2023-06-09T04:38:15.644054+0000","last_active":"2023-06-09T04:38:15.983119+0000","last_peered":"2023-06-09T04:38:15.983119+0000","last_clean":"2023-06-09T04:38:15.983119+0000","last_became_active":"2023-06-09T04:38:15.643226+0000","last_became_peered":"2023-06-09T04:38:15.643226+0000","last_unstale":"2023-06-09T04:38:15.983119+0000","last_undegraded":"2023-06-09T04:38:15.983119+0000","last_fullsized":"2023-06-09T04:38:15.983119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:08.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981525+0000","last_change":"2023-06-09T04:38:11.591783+0000","last_active":"2023-06-09T04:38:15.981525+0000","last_peered":"2023-06-09T04:38:15.981525+0000","last_clean":"2023-06-09T04:38:15.981525+0000","last_became_active":"2023-06-09T04:38:11.591359+0000","last_became_peered":"2023-06-09T04:38:11.591359+0000","last_unstale":"2023-06-09T04:38:15.981525+0000","last_undegraded":"2023-06-09T04:38:15.981525+0000","last_fullsized":"2023-06-09T04:38:15.981525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560729+0000","last_change":"2023-06-09T04:38:11.185014+0000","last_active":"2023-06-09T04:38:16.560729+0000","last_peered":"2023-06-09T04:38:16.560729+0000","last_clean":"2023-06-09T04:38:16.560729+0000","last_became_active":"2023-06-09T04:38:11.184569+0000","last_became_peered":"2023-06-09T04:38:11.184569+0000","last_unstale":"2023-06-09T04:38:16.560729+0000","last_undegraded":"2023-06-09T04:38:16.560729+0000","last_fullsized":"2023-06-09T04:38:16.560729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:02.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558082+0000","last_change":"2023-06-09T04:38:15.629791+0000","last_active":"2023-06-09T04:38:16.558082+0000","last_peered":"2023-06-09T04:38:16.558082+0000","last_clean":"2023-06-09T04:38:16.558082+0000","last_became_active":"2023-06-09T04:38:15.628267+0000","last_became_peered":"2023-06-09T04:38:15.628267+0000","last_unstale":"2023-06-09T04:38:16.558082+0000","last_undegraded":"2023-06-09T04:38:16.558082+0000","last_fullsized":"2023-06-09T04:38:16.558082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:56.733282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065867+0000","last_change":"2023-06-09T04:38:11.580119+0000","last_active":"2023-06-09T04:38:16.065867+0000","last_peered":"2023-06-09T04:38:16.065867+0000","last_clean":"2023-06-09T04:38:16.065867+0000","last_became_active":"2023-06-09T04:38:11.579683+0000","last_became_peered":"2023-06-09T04:38:11.579683+0000","last_unstale":"2023-06-09T04:38:16.065867+0000","last_undegraded":"2023-06-09T04:38:16.065867+0000","last_fullsized":"2023-06-09T04:38:16.065867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982464+0000","last_change":"2023-06-09T04:38:11.189768+0000","last_active":"2023-06-09T04:38:15.982464+0000","last_peered":"2023-06-09T04:38:15.982464+0000","last_clean":"2023-06-09T04:38:15.982464+0000","last_became_active":"2023-06-09T04:38:11.183589+0000","last_became_peered":"2023-06-09T04:38:11.183589+0000","last_unstale":"2023-06-09T04:38:15.982464+0000","last_undegraded":"2023-06-09T04:38:15.982464+0000","last_fullsized":"2023-06-09T04:38:15.982464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:44.537559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982754+0000","last_change":"2023-06-09T04:38:15.651304+0000","last_active":"2023-06-09T04:38:15.982754+0000","last_peered":"2023-06-09T04:38:15.982754+0000","last_clean":"2023-06-09T04:38:15.982754+0000","last_became_active":"2023-06-09T04:38:15.650429+0000","last_became_peered":"2023-06-09T04:38:15.650429+0000","last_unstale":"2023-06-09T04:38:15.982754+0000","last_undegraded":"2023-06-09T04:38:15.982754+0000","last_fullsized":"2023-06-09T04:38:15.982754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:35.270968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559138+0000","last_change":"2023-06-09T04:38:11.608450+0000","last_active":"2023-06-09T04:38:16.559138+0000","last_peered":"2023-06-09T04:38:16.559138+0000","last_clean":"2023-06-09T04:38:16.559138+0000","last_became_active":"2023-06-09T04:38:11.608016+0000","last_became_peered":"2023-06-09T04:38:11.608016+0000","last_unstale":"2023-06-09T04:38:16.559138+0000","last_undegraded":"2023-06-09T04:38:16.559138+0000","last_fullsized":"2023-06-09T04:38:16.559138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:47.297438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116600+0000","last_change":"2023-06-09T04:38:11.182774+0000","last_active":"2023-06-09T04:38:16.116600+0000","last_peered":"2023-06-09T04:38:16.116600+0000","last_clean":"2023-06-09T04:38:16.116600+0000","last_became_active":"2023-06-09T04:38:11.182454+0000","last_became_peered":"2023-06-09T04:38:11.182454+0000","last_unstale":"2023-06-09T04:38:16.116600+0000","last_undegraded":"2023-06-09T04:38:16.116600+0000","last_fullsized":"2023-06-09T04:38:16.116600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:20.644283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065961+0000","last_change":"2023-06-09T04:38:15.638696+0000","last_active":"2023-06-09T04:38:16.065961+0000","last_peered":"2023-06-09T04:38:16.065961+0000","last_clean":"2023-06-09T04:38:16.065961+0000","last_became_active":"2023-06-09T04:38:15.638021+0000","last_became_peered":"2023-06-09T04:38:15.638021+0000","last_unstale":"2023-06-09T04:38:16.065961+0000","last_undegraded":"2023-06-09T04:38:16.065961+0000","last_fullsized":"2023-06-09T04:38:16.065961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:56.518316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560437+0000","last_change":"2023-06-09T04:38:15.644394+0000","last_active":"2023-06-09T04:38:16.560437+0000","last_peered":"2023-06-09T04:38:16.560437+0000","last_clean":"2023-06-09T04:38:16.560437+0000","last_became_active":"2023-06-09T04:38:15.643951+0000","last_became_peered":"2023-06-09T04:38:15.643951+0000","last_unstale":"2023-06-09T04:38:16.560437+0000","last_undegraded":"2023-06-09T04:38:16.560437+0000","last_fullsized":"2023-06-09T04:38:16.560437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:51.630961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066744+0000","last_change":"2023-06-09T04:38:11.204035+0000","last_active":"2023-06-09T04:38:16.066744+0000","last_peered":"2023-06-09T04:38:16.066744+0000","last_clean":"2023-06-09T04:38:16.066744+0000","last_became_active":"2023-06-09T04:38:11.203724+0000","last_became_peered":"2023-06-09T04:38:11.203724+0000","last_unstale":"2023-06-09T04:38:16.066744+0000","last_undegraded":"2023-06-09T04:38:16.066744+0000","last_fullsized":"2023-06-09T04:38:16.066744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:23.339781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561757+0000","last_change":"2023-06-09T04:38:11.578687+0000","last_active":"2023-06-09T04:38:16.561757+0000","last_peered":"2023-06-09T04:38:16.561757+0000","last_clean":"2023-06-09T04:38:16.561757+0000","last_became_active":"2023-06-09T04:38:11.577901+0000","last_became_peered":"2023-06-09T04:38:11.577901+0000","last_unstale":"2023-06-09T04:38:16.561757+0000","last_undegraded":"2023-06-09T04:38:16.561757+0000","last_fullsized":"2023-06-09T04:38:16.561757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:44.239627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984075+0000","last_change":"2023-06-09T04:38:15.652937+0000","last_active":"2023-06-09T04:38:15.984075+0000","last_peered":"2023-06-09T04:38:15.984075+0000","last_clean":"2023-06-09T04:38:15.984075+0000","last_became_active":"2023-06-09T04:38:15.651857+0000","last_became_peered":"2023-06-09T04:38:15.651857+0000","last_unstale":"2023-06-09T04:38:15.984075+0000","last_undegraded":"2023-06-09T04:38:15.984075+0000","last_fullsized":"2023-06-09T04:38:15.984075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:57:40.466278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560952+0000","last_change":"2023-06-09T04:38:11.185987+0000","last_active":"2023-06-09T04:38:16.560952+0000","last_peered":"2023-06-09T04:38:16.560952+0000","last_clean":"2023-06-09T04:38:16.560952+0000","last_became_active":"2023-06-09T04:38:11.185132+0000","last_became_peered":"2023-06-09T04:38:11.185132+0000","last_unstale":"2023-06-09T04:38:16.560952+0000","last_undegraded":"2023-06-09T04:38:16.560952+0000","last_fullsized":"2023-06-09T04:38:16.560952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:29:24.685594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561261+0000","last_change":"2023-06-09T04:38:11.581671+0000","last_active":"2023-06-09T04:38:16.561261+0000","last_peered":"2023-06-09T04:38:16.561261+0000","last_clean":"2023-06-09T04:38:16.561261+0000","last_became_active":"2023-06-09T04:38:11.579485+0000","last_became_peered":"2023-06-09T04:38:11.579485+0000","last_unstale":"2023-06-09T04:38:16.561261+0000","last_undegraded":"2023-06-09T04:38:16.561261+0000","last_fullsized":"2023-06-09T04:38:16.561261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:26:56.275716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983528+0000","last_change":"2023-06-09T04:38:11.196724+0000","last_active":"2023-06-09T04:38:15.983528+0000","last_peered":"2023-06-09T04:38:15.983528+0000","last_clean":"2023-06-09T04:38:15.983528+0000","last_became_active":"2023-06-09T04:38:11.196068+0000","last_became_peered":"2023-06-09T04:38:11.196068+0000","last_unstale":"2023-06-09T04:38:15.983528+0000","last_undegraded":"2023-06-09T04:38:15.983528+0000","last_fullsized":"2023-06-09T04:38:15.983528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:25.012517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559819+0000","last_change":"2023-06-09T04:38:11.590465+0000","last_active":"2023-06-09T04:38:16.559819+0000","last_peered":"2023-06-09T04:38:16.559819+0000","last_clean":"2023-06-09T04:38:16.559819+0000","last_became_active":"2023-06-09T04:38:11.589834+0000","last_became_peered":"2023-06-09T04:38:11.589834+0000","last_unstale":"2023-06-09T04:38:16.559819+0000","last_undegraded":"2023-06-09T04:38:16.559819+0000","last_fullsized":"2023-06-09T04:38:16.559819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:26.501877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984273+0000","last_change":"2023-06-09T04:38:15.638948+0000","last_active":"2023-06-09T04:38:15.984273+0000","last_peered":"2023-06-09T04:38:15.984273+0000","last_clean":"2023-06-09T04:38:15.984273+0000","last_became_active":"2023-06-09T04:38:15.637442+0000","last_became_peered":"2023-06-09T04:38:15.637442+0000","last_unstale":"2023-06-09T04:38:15.984273+0000","last_undegraded":"2023-06-09T04:38:15.984273+0000","last_fullsized":"2023-06-09T04:38:15.984273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:03:02.201851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560419+0000","last_change":"2023-06-09T04:38:11.186756+0000","last_active":"2023-06-09T04:38:16.560419+0000","last_peered":"2023-06-09T04:38:16.560419+0000","last_clean":"2023-06-09T04:38:16.560419+0000","last_became_active":"2023-06-09T04:38:11.185821+0000","last_became_peered":"2023-06-09T04:38:11.185821+0000","last_unstale":"2023-06-09T04:38:16.560419+0000","last_undegraded":"2023-06-09T04:38:16.560419+0000","last_fullsized":"2023-06-09T04:38:16.560419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:55.494527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984073+0000","last_change":"2023-06-09T04:38:11.598710+0000","last_active":"2023-06-09T04:38:15.984073+0000","last_peered":"2023-06-09T04:38:15.984073+0000","last_clean":"2023-06-09T04:38:15.984073+0000","last_became_active":"2023-06-09T04:38:11.598397+0000","last_became_peered":"2023-06-09T04:38:11.598397+0000","last_unstale":"2023-06-09T04:38:15.984073+0000","last_undegraded":"2023-06-09T04:38:15.984073+0000","last_fullsized":"2023-06-09T04:38:15.984073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559520+0000","last_change":"2023-06-09T04:38:15.621608+0000","last_active":"2023-06-09T04:38:16.559520+0000","last_peered":"2023-06-09T04:38:16.559520+0000","last_clean":"2023-06-09T04:38:16.559520+0000","last_became_active":"2023-06-09T04:38:15.621042+0000","last_became_peered":"2023-06-09T04:38:15.621042+0000","last_unstale":"2023-06-09T04:38:16.559520+0000","last_undegraded":"2023-06-09T04:38:16.559520+0000","last_fullsized":"2023-06-09T04:38:16.559520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:05:03.071443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066570+0000","last_change":"2023-06-09T04:38:11.594280+0000","last_active":"2023-06-09T04:38:16.066570+0000","last_peered":"2023-06-09T04:38:16.066570+0000","last_clean":"2023-06-09T04:38:16.066570+0000","last_became_active":"2023-06-09T04:38:11.593913+0000","last_became_peered":"2023-06-09T04:38:11.593913+0000","last_unstale":"2023-06-09T04:38:16.066570+0000","last_undegraded":"2023-06-09T04:38:16.066570+0000","last_fullsized":"2023-06-09T04:38:16.066570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:04.790292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982855+0000","last_change":"2023-06-09T04:38:11.581417+0000","last_active":"2023-06-09T04:38:15.982855+0000","last_peered":"2023-06-09T04:38:15.982855+0000","last_clean":"2023-06-09T04:38:15.982855+0000","last_became_active":"2023-06-09T04:38:11.580835+0000","last_became_peered":"2023-06-09T04:38:11.580835+0000","last_unstale":"2023-06-09T04:38:15.982855+0000","last_undegraded":"2023-06-09T04:38:15.982855+0000","last_fullsized":"2023-06-09T04:38:15.982855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:33.116603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115907+0000","last_change":"2023-06-09T04:38:11.605024+0000","last_active":"2023-06-09T04:38:16.115907+0000","last_peered":"2023-06-09T04:38:16.115907+0000","last_clean":"2023-06-09T04:38:16.115907+0000","last_became_active":"2023-06-09T04:38:11.604711+0000","last_became_peered":"2023-06-09T04:38:11.604711+0000","last_unstale":"2023-06-09T04:38:16.115907+0000","last_undegraded":"2023-06-09T04:38:16.115907+0000","last_fullsized":"2023-06-09T04:38:16.115907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:05.142990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560506+0000","last_change":"2023-06-09T04:38:11.575886+0000","last_active":"2023-06-09T04:38:16.560506+0000","last_peered":"2023-06-09T04:38:16.560506+0000","last_clean":"2023-06-09T04:38:16.560506+0000","last_became_active":"2023-06-09T04:38:11.575594+0000","last_became_peered":"2023-06-09T04:38:11.575594+0000","last_unstale":"2023-06-09T04:38:16.560506+0000","last_undegraded":"2023-06-09T04:38:16.560506+0000","last_fullsized":"2023-06-09T04:38:16.560506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:51.547429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560644+0000","last_change":"2023-06-09T04:38:11.573026+0000","last_active":"2023-06-09T04:38:16.560644+0000","last_peered":"2023-06-09T04:38:16.560644+0000","last_clean":"2023-06-09T04:38:16.560644+0000","last_became_active":"2023-06-09T04:38:11.572744+0000","last_became_peered":"2023-06-09T04:38:11.572744+0000","last_unstale":"2023-06-09T04:38:16.560644+0000","last_undegraded":"2023-06-09T04:38:16.560644+0000","last_fullsized":"2023-06-09T04:38:16.560644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:04:38.824518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560873+0000","last_change":"2023-06-09T04:38:11.597829+0000","last_active":"2023-06-09T04:38:16.560873+0000","last_peered":"2023-06-09T04:38:16.560873+0000","last_clean":"2023-06-09T04:38:16.560873+0000","last_became_active":"2023-06-09T04:38:11.590175+0000","last_became_peered":"2023-06-09T04:38:11.590175+0000","last_unstale":"2023-06-09T04:38:16.560873+0000","last_undegraded":"2023-06-09T04:38:16.560873+0000","last_fullsized":"2023-06-09T04:38:16.560873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:10.046575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559401+0000","last_change":"2023-06-09T04:38:11.598947+0000","last_active":"2023-06-09T04:38:16.559401+0000","last_peered":"2023-06-09T04:38:16.559401+0000","last_clean":"2023-06-09T04:38:16.559401+0000","last_became_active":"2023-06-09T04:38:11.598503+0000","last_became_peered":"2023-06-09T04:38:11.598503+0000","last_unstale":"2023-06-09T04:38:16.559401+0000","last_undegraded":"2023-06-09T04:38:16.559401+0000","last_fullsized":"2023-06-09T04:38:16.559401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:44.845221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985260+0000","last_change":"2023-06-09T04:38:11.594511+0000","last_active":"2023-06-09T04:38:15.985260+0000","last_peered":"2023-06-09T04:38:15.985260+0000","last_clean":"2023-06-09T04:38:15.985260+0000","last_became_active":"2023-06-09T04:38:11.592278+0000","last_became_peered":"2023-06-09T04:38:11.592278+0000","last_unstale":"2023-06-09T04:38:15.985260+0000","last_undegraded":"2023-06-09T04:38:15.985260+0000","last_fullsized":"2023-06-09T04:38:15.985260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:36:26.790998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065900+0000","last_change":"2023-06-09T04:38:11.581970+0000","last_active":"2023-06-09T04:38:16.065900+0000","last_peered":"2023-06-09T04:38:16.065900+0000","last_clean":"2023-06-09T04:38:16.065900+0000","last_became_active":"2023-06-09T04:38:11.581665+0000","last_became_peered":"2023-06-09T04:38:11.581665+0000","last_unstale":"2023-06-09T04:38:16.065900+0000","last_undegraded":"2023-06-09T04:38:16.065900+0000","last_fullsized":"2023-06-09T04:38:16.065900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986039+0000","last_change":"2023-06-09T04:38:11.594155+0000","last_active":"2023-06-09T04:38:15.986039+0000","last_peered":"2023-06-09T04:38:15.986039+0000","last_clean":"2023-06-09T04:38:15.986039+0000","last_became_active":"2023-06-09T04:38:11.592402+0000","last_became_peered":"2023-06-09T04:38:11.592402+0000","last_unstale":"2023-06-09T04:38:15.986039+0000","last_undegraded":"2023-06-09T04:38:15.986039+0000","last_fullsized":"2023-06-09T04:38:15.986039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:03.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559449+0000","last_change":"2023-06-09T04:38:11.598820+0000","last_active":"2023-06-09T04:38:16.559449+0000","last_peered":"2023-06-09T04:38:16.559449+0000","last_clean":"2023-06-09T04:38:16.559449+0000","last_became_active":"2023-06-09T04:38:11.598538+0000","last_became_peered":"2023-06-09T04:38:11.598538+0000","last_unstale":"2023-06-09T04:38:16.559449+0000","last_undegraded":"2023-06-09T04:38:16.559449+0000","last_fullsized":"2023-06-09T04:38:16.559449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:32.642381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066228+0000","last_change":"2023-06-09T04:38:11.581487+0000","last_active":"2023-06-09T04:38:16.066228+0000","last_peered":"2023-06-09T04:38:16.066228+0000","last_clean":"2023-06-09T04:38:16.066228+0000","last_became_active":"2023-06-09T04:38:11.580791+0000","last_became_peered":"2023-06-09T04:38:11.580791+0000","last_unstale":"2023-06-09T04:38:16.066228+0000","last_undegraded":"2023-06-09T04:38:16.066228+0000","last_fullsized":"2023-06-09T04:38:16.066228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066270+0000","last_change":"2023-06-09T04:38:11.596924+0000","last_active":"2023-06-09T04:38:16.066270+0000","last_peered":"2023-06-09T04:38:16.066270+0000","last_clean":"2023-06-09T04:38:16.066270+0000","last_became_active":"2023-06-09T04:38:11.596514+0000","last_became_peered":"2023-06-09T04:38:11.596514+0000","last_unstale":"2023-06-09T04:38:16.066270+0000","last_undegraded":"2023-06-09T04:38:16.066270+0000","last_fullsized":"2023-06-09T04:38:16.066270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:15.244503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561345+0000","last_change":"2023-06-09T04:38:11.591842+0000","last_active":"2023-06-09T04:38:16.561345+0000","last_peered":"2023-06-09T04:38:16.561345+0000","last_clean":"2023-06-09T04:38:16.561345+0000","last_became_active":"2023-06-09T04:38:11.591348+0000","last_became_peered":"2023-06-09T04:38:11.591348+0000","last_unstale":"2023-06-09T04:38:16.561345+0000","last_undegraded":"2023-06-09T04:38:16.561345+0000","last_fullsized":"2023-06-09T04:38:16.561345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:11.837579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116228+0000","last_change":"2023-06-09T04:38:11.581598+0000","last_active":"2023-06-09T04:38:16.116228+0000","last_peered":"2023-06-09T04:38:16.116228+0000","last_clean":"2023-06-09T04:38:16.116228+0000","last_became_active":"2023-06-09T04:38:11.581079+0000","last_became_peered":"2023-06-09T04:38:11.581079+0000","last_unstale":"2023-06-09T04:38:16.116228+0000","last_undegraded":"2023-06-09T04:38:16.116228+0000","last_fullsized":"2023-06-09T04:38:16.116228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:26.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559059+0000","last_change":"2023-06-09T04:38:11.588434+0000","last_active":"2023-06-09T04:38:16.559059+0000","last_peered":"2023-06-09T04:38:16.559059+0000","last_clean":"2023-06-09T04:38:16.559059+0000","last_became_active":"2023-06-09T04:38:11.586783+0000","last_became_peered":"2023-06-09T04:38:11.586783+0000","last_unstale":"2023-06-09T04:38:16.559059+0000","last_undegraded":"2023-06-09T04:38:16.559059+0000","last_fullsized":"2023-06-09T04:38:16.559059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:30:39.956547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559051+0000","last_change":"2023-06-09T04:38:11.589256+0000","last_active":"2023-06-09T04:38:16.559051+0000","last_peered":"2023-06-09T04:38:16.559051+0000","last_clean":"2023-06-09T04:38:16.559051+0000","last_became_active":"2023-06-09T04:38:11.585253+0000","last_became_peered":"2023-06-09T04:38:11.585253+0000","last_unstale":"2023-06-09T04:38:16.559051+0000","last_undegraded":"2023-06-09T04:38:16.559051+0000","last_fullsized":"2023-06-09T04:38:16.559051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:20.593479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115686+0000","last_change":"2023-06-09T04:38:11.595137+0000","last_active":"2023-06-09T04:38:16.115686+0000","last_peered":"2023-06-09T04:38:16.115686+0000","last_clean":"2023-06-09T04:38:16.115686+0000","last_became_active":"2023-06-09T04:38:11.594879+0000","last_became_peered":"2023-06-09T04:38:11.594879+0000","last_unstale":"2023-06-09T04:38:16.115686+0000","last_undegraded":"2023-06-09T04:38:16.115686+0000","last_fullsized":"2023-06-09T04:38:16.115686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:29.708676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066144+0000","last_change":"2023-06-09T04:38:11.580088+0000","last_active":"2023-06-09T04:38:16.066144+0000","last_peered":"2023-06-09T04:38:16.066144+0000","last_clean":"2023-06-09T04:38:16.066144+0000","last_became_active":"2023-06-09T04:38:11.579839+0000","last_became_peered":"2023-06-09T04:38:11.579839+0000","last_unstale":"2023-06-09T04:38:16.066144+0000","last_undegraded":"2023-06-09T04:38:16.066144+0000","last_fullsized":"2023-06-09T04:38:16.066144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985563+0000","last_change":"2023-06-09T04:38:11.584533+0000","last_active":"2023-06-09T04:38:15.985563+0000","last_peered":"2023-06-09T04:38:15.985563+0000","last_clean":"2023-06-09T04:38:15.985563+0000","last_became_active":"2023-06-09T04:38:11.583229+0000","last_became_peered":"2023-06-09T04:38:11.583229+0000","last_unstale":"2023-06-09T04:38:15.985563+0000","last_undegraded":"2023-06-09T04:38:15.985563+0000","last_fullsized":"2023-06-09T04:38:15.985563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560605+0000","last_change":"2023-06-09T04:38:11.590402+0000","last_active":"2023-06-09T04:38:16.560605+0000","last_peered":"2023-06-09T04:38:16.560605+0000","last_clean":"2023-06-09T04:38:16.560605+0000","last_became_active":"2023-06-09T04:38:11.590128+0000","last_became_peered":"2023-06-09T04:38:11.590128+0000","last_unstale":"2023-06-09T04:38:16.560605+0000","last_undegraded":"2023-06-09T04:38:16.560605+0000","last_fullsized":"2023-06-09T04:38:16.560605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:31.691341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066715+0000","last_change":"2023-06-09T04:38:11.575532+0000","last_active":"2023-06-09T04:38:16.066715+0000","last_peered":"2023-06-09T04:38:16.066715+0000","last_clean":"2023-06-09T04:38:16.066715+0000","last_became_active":"2023-06-09T04:38:11.574743+0000","last_became_peered":"2023-06-09T04:38:11.574743+0000","last_unstale":"2023-06-09T04:38:16.066715+0000","last_undegraded":"2023-06-09T04:38:16.066715+0000","last_fullsized":"2023-06-09T04:38:16.066715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:27:44.893546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066132+0000","last_change":"2023-06-09T04:38:11.587445+0000","last_active":"2023-06-09T04:38:16.066132+0000","last_peered":"2023-06-09T04:38:16.066132+0000","last_clean":"2023-06-09T04:38:16.066132+0000","last_became_active":"2023-06-09T04:38:11.587078+0000","last_became_peered":"2023-06-09T04:38:11.587078+0000","last_unstale":"2023-06-09T04:38:16.066132+0000","last_undegraded":"2023-06-09T04:38:16.066132+0000","last_fullsized":"2023-06-09T04:38:16.066132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:57.955916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984537+0000","last_change":"2023-06-09T04:38:11.594397+0000","last_active":"2023-06-09T04:38:15.984537+0000","last_peered":"2023-06-09T04:38:15.984537+0000","last_clean":"2023-06-09T04:38:15.984537+0000","last_became_active":"2023-06-09T04:38:11.592636+0000","last_became_peered":"2023-06-09T04:38:11.592636+0000","last_unstale":"2023-06-09T04:38:15.984537+0000","last_undegraded":"2023-06-09T04:38:15.984537+0000","last_fullsized":"2023-06-09T04:38:15.984537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:00:19.960889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065734+0000","last_change":"2023-06-09T04:38:11.572712+0000","last_active":"2023-06-09T04:38:16.065734+0000","last_peered":"2023-06-09T04:38:16.065734+0000","last_clean":"2023-06-09T04:38:16.065734+0000","last_became_active":"2023-06-09T04:38:11.571728+0000","last_became_peered":"2023-06-09T04:38:11.571728+0000","last_unstale":"2023-06-09T04:38:16.065734+0000","last_undegraded":"2023-06-09T04:38:16.065734+0000","last_fullsized":"2023-06-09T04:38:16.065734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559434+0000","last_change":"2023-06-09T04:38:11.590174+0000","last_active":"2023-06-09T04:38:16.559434+0000","last_peered":"2023-06-09T04:38:16.559434+0000","last_clean":"2023-06-09T04:38:16.559434+0000","last_became_active":"2023-06-09T04:38:11.589797+0000","last_became_peered":"2023-06-09T04:38:11.589797+0000","last_unstale":"2023-06-09T04:38:16.559434+0000","last_undegraded":"2023-06-09T04:38:16.559434+0000","last_fullsized":"2023-06-09T04:38:16.559434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:50.267811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559697+0000","last_change":"2023-06-09T04:38:11.597890+0000","last_active":"2023-06-09T04:38:16.559697+0000","last_peered":"2023-06-09T04:38:16.559697+0000","last_clean":"2023-06-09T04:38:16.559697+0000","last_became_active":"2023-06-09T04:38:11.590403+0000","last_became_peered":"2023-06-09T04:38:11.590403+0000","last_unstale":"2023-06-09T04:38:16.559697+0000","last_undegraded":"2023-06-09T04:38:16.559697+0000","last_fullsized":"2023-06-09T04:38:16.559697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:31:47.357977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984691+0000","last_change":"2023-06-09T04:38:11.590981+0000","last_active":"2023-06-09T04:38:15.984691+0000","last_peered":"2023-06-09T04:38:15.984691+0000","last_clean":"2023-06-09T04:38:15.984691+0000","last_became_active":"2023-06-09T04:38:11.590680+0000","last_became_peered":"2023-06-09T04:38:11.590680+0000","last_unstale":"2023-06-09T04:38:15.984691+0000","last_undegraded":"2023-06-09T04:38:15.984691+0000","last_fullsized":"2023-06-09T04:38:15.984691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:34.676457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116447+0000","last_change":"2023-06-09T04:38:11.581610+0000","last_active":"2023-06-09T04:38:16.116447+0000","last_peered":"2023-06-09T04:38:16.116447+0000","last_clean":"2023-06-09T04:38:16.116447+0000","last_became_active":"2023-06-09T04:38:11.580238+0000","last_became_peered":"2023-06-09T04:38:11.580238+0000","last_unstale":"2023-06-09T04:38:16.116447+0000","last_undegraded":"2023-06-09T04:38:16.116447+0000","last_fullsized":"2023-06-09T04:38:16.116447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116281+0000","last_change":"2023-06-09T04:38:11.579502+0000","last_active":"2023-06-09T04:38:16.116281+0000","last_peered":"2023-06-09T04:38:16.116281+0000","last_clean":"2023-06-09T04:38:16.116281+0000","last_became_active":"2023-06-09T04:38:11.579076+0000","last_became_peered":"2023-06-09T04:38:11.579076+0000","last_unstale":"2023-06-09T04:38:16.116281+0000","last_undegraded":"2023-06-09T04:38:16.116281+0000","last_fullsized":"2023-06-09T04:38:16.116281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982195+0000","last_change":"2023-06-09T04:38:11.595714+0000","last_active":"2023-06-09T04:38:15.982195+0000","last_peered":"2023-06-09T04:38:15.982195+0000","last_clean":"2023-06-09T04:38:15.982195+0000","last_became_active":"2023-06-09T04:38:11.595346+0000","last_became_peered":"2023-06-09T04:38:11.595346+0000","last_unstale":"2023-06-09T04:38:15.982195+0000","last_undegraded":"2023-06-09T04:38:15.982195+0000","last_fullsized":"2023-06-09T04:38:15.982195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561947+0000","last_change":"2023-06-09T04:38:11.584489+0000","last_active":"2023-06-09T04:38:16.561947+0000","last_peered":"2023-06-09T04:38:16.561947+0000","last_clean":"2023-06-09T04:38:16.561947+0000","last_became_active":"2023-06-09T04:38:11.584214+0000","last_became_peered":"2023-06-09T04:38:11.584214+0000","last_unstale":"2023-06-09T04:38:16.561947+0000","last_undegraded":"2023-06-09T04:38:16.561947+0000","last_fullsized":"2023-06-09T04:38:16.561947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:06:31.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":315392,"data_stored":125663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":712808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":712716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":125559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:39.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:39.504 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facc485e640 1 Processor -- start 2023-06-09T04:38:39.504 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facc485e640 1 -- start start 2023-06-09T04:38:39.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facc485e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7facc015a3e0 0x7facc006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facc485e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc015cf10 con 0x7facc0159320 2023-06-09T04:38:39.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facc485e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc0070520 con 0x7facc00700a0 2023-06-09T04:38:39.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facc485e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc015dd90 con 0x7facc015a3e0 2023-06-09T04:38:39.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbdd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7facc015a3e0 0x7facc006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbe59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7facc0159320 0x7facc015d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43646/0 (socket says 172.21.15.18:43646) 2023-06-09T04:38:39.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbe59c640 1 -- 172.21.15.18:0/383807764 learned_addr learned my addr 172.21.15.18:0/383807764 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:39.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbdd9b640 1 -- 172.21.15.18:0/383807764 >> v1:172.21.15.81:6789/0 conn(0x7facc00700a0 legacy=0x7facc006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbdd9b640 1 -- 172.21.15.18:0/383807764 >> v1:172.21.15.18:6789/0 conn(0x7facc0159320 legacy=0x7facc015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbdd9b640 1 -- 172.21.15.18:0/383807764 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc00c81b0 con 0x7facc015a3e0 2023-06-09T04:38:39.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.502+0000 7facbd59a640 1 -- 172.21.15.18:0/383807764 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946040876 0 0) 0x7facc015cf10 con 0x7facc0159320 2023-06-09T04:38:39.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facbdd9b640 1 --2- 172.21.15.18:0/383807764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc015a3e0 0x7facc006fb60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faca80097c0 tx=0x7faca801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cffb8547d77f42 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facbd59a640 1 -- 172.21.15.18:0/383807764 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca80ab600 con 0x7facc015a3e0 2023-06-09T04:38:39.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facbd59a640 1 -- 172.21.15.18:0/383807764 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca80a7050 con 0x7facc015a3e0 2023-06-09T04:38:39.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facbd59a640 1 -- 172.21.15.18:0/383807764 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca80ab980 con 0x7facc015a3e0 2023-06-09T04:38:39.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 -- 172.21.15.18:0/383807764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc015a3e0 msgr2=0x7facc006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 --2- 172.21.15.18:0/383807764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc015a3e0 0x7facc006fb60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faca80097c0 tx=0x7faca801c380 comp rx=0 tx=0).stop 2023-06-09T04:38:39.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 -- 172.21.15.18:0/383807764 shutdown_connections 2023-06-09T04:38:39.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 --2- 172.21.15.18:0/383807764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc015a3e0 0x7facc006fb60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 -- 172.21.15.18:0/383807764 >> 172.21.15.18:0/383807764 conn(0x7facc00b0240 msgr2=0x7facc00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 -- 172.21.15.18:0/383807764 shutdown_connections 2023-06-09T04:38:39.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.506+0000 7facc485e640 1 -- 172.21.15.18:0/383807764 wait complete. 2023-06-09T04:38:39.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 Processor -- start 2023-06-09T04:38:39.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- start start 2023-06-09T04:38:39.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7facc00700a0 0x7facc00b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 0x7facc00b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0149310 0x7facc0157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc00b11b0 con 0x7facc0159320 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc00b1490 con 0x7facc0149310 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc00b1770 con 0x7facc00700a0 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 0x7facc00b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 0x7facc00b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38442/0 (socket says 172.21.15.18:38442) 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 -- 172.21.15.18:0/859312717 learned_addr learned my addr 172.21.15.18:0/859312717 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:39.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbe59c640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7facc00700a0 0x7facc00b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbed9d640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0149310 0x7facc0157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 -- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7facc00700a0 msgr2=0x7facc00b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7facc00700a0 0x7facc00b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 -- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0149310 msgr2=0x7facc0157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0149310 0x7facc0157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 -- 172.21.15.18:0/859312717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009420 con 0x7facc0159320 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbed9d640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0149310 0x7facc0157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:39.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbdd9b640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 0x7facc00b08b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faca8019fb0 tx=0x7faca801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8004230 con 0x7facc0159320 2023-06-09T04:38:39.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8004390 con 0x7facc0159320 2023-06-09T04:38:39.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8003820 con 0x7facc0159320 2023-06-09T04:38:39.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc00b1a50 con 0x7facc0159320 2023-06-09T04:38:39.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc00b0df0 con 0x7facc0159320 2023-06-09T04:38:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc00b1f00 con 0x7facc0159320 2023-06-09T04:38:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faca8003980 con 0x7facc0159320 2023-06-09T04:38:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facb6ffd640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faca0066280 0x7faca0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faca811ea80 con 0x7facc0159320 2023-06-09T04:38:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.510+0000 7facbe59c640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faca0066280 0x7faca0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.514+0000 7facbe59c640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faca0066280 0x7faca0068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7facb80012f0 tx=0x7facb8005ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.514+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faca80ebd30 con 0x7facc0159320 2023-06-09T04:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.666+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facc015d160 con 0x7faca0066280 2023-06-09T04:38:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.690+0000 7facb6ffd640 1 -- 172.21.15.18:0/859312717 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367350 (secure 0 0 0) 0x7facb8007170 con 0x7faca0066280 2023-06-09T04:38:39.697 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:39.699 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:38:39.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faca0066280 msgr2=0x7faca0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faca0066280 0x7faca0068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7facb80012f0 tx=0x7facb8005ec0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 msgr2=0x7facc00b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 0x7facc00b08b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faca8019fb0 tx=0x7faca801abc0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 shutdown_connections 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facc0149310 0x7facc0157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facc0159320 0x7facc00b08b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7faca0066280 0x7faca0068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 --2- 172.21.15.18:0/859312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7facc00700a0 0x7facc00b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 >> 172.21.15.18:0/859312717 conn(0x7facc00b0240 msgr2=0x7facc015d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.694+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 shutdown_connections 2023-06-09T04:38:39.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.698+0000 7facc485e640 1 -- 172.21.15.18:0/859312717 wait complete. 2023-06-09T04:38:39.714 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-06-09T04:38:37.704220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235528,"kb_used_data":3528,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739192,"statfs":{"total":773094113280,"available":772852932608,"internally_reserved":0,"allocated":3612672,"data_stored":2164046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005188"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985748+0000","last_change":"2023-06-09T04:38:15.615901+0000","last_active":"2023-06-09T04:38:15.985748+0000","last_peered":"2023-06-09T04:38:15.985748+0000","last_clean":"2023-06-09T04:38:15.985748+0000","last_became_active":"2023-06-09T04:38:15.614830+0000","last_became_peered":"2023-06-09T04:38:15.614830+0000","last_unstale":"2023-06-09T04:38:15.985748+0000","last_undegraded":"2023-06-09T04:38:15.985748+0000","last_fullsized":"2023-06-09T04:38:15.985748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:27:43.430602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561949+0000","last_change":"2023-06-09T04:38:11.203692+0000","last_active":"2023-06-09T04:38:16.561949+0000","last_peered":"2023-06-09T04:38:16.561949+0000","last_clean":"2023-06-09T04:38:16.561949+0000","last_became_active":"2023-06-09T04:38:11.202964+0000","last_became_peered":"2023-06-09T04:38:11.202964+0000","last_unstale":"2023-06-09T04:38:16.561949+0000","last_undegraded":"2023-06-09T04:38:16.561949+0000","last_fullsized":"2023-06-09T04:38:16.561949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:13.783096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981243+0000","last_change":"2023-06-09T04:38:11.594761+0000","last_active":"2023-06-09T04:38:15.981243+0000","last_peered":"2023-06-09T04:38:15.981243+0000","last_clean":"2023-06-09T04:38:15.981243+0000","last_became_active":"2023-06-09T04:38:11.594211+0000","last_became_peered":"2023-06-09T04:38:11.594211+0000","last_unstale":"2023-06-09T04:38:15.981243+0000","last_undegraded":"2023-06-09T04:38:15.981243+0000","last_fullsized":"2023-06-09T04:38:15.981243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065852+0000","last_change":"2023-06-09T04:38:15.632499+0000","last_active":"2023-06-09T04:38:16.065852+0000","last_peered":"2023-06-09T04:38:16.065852+0000","last_clean":"2023-06-09T04:38:16.065852+0000","last_became_active":"2023-06-09T04:38:15.632008+0000","last_became_peered":"2023-06-09T04:38:15.632008+0000","last_unstale":"2023-06-09T04:38:16.065852+0000","last_undegraded":"2023-06-09T04:38:16.065852+0000","last_fullsized":"2023-06-09T04:38:16.065852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561498+0000","last_change":"2023-06-09T04:38:11.200945+0000","last_active":"2023-06-09T04:38:16.561498+0000","last_peered":"2023-06-09T04:38:16.561498+0000","last_clean":"2023-06-09T04:38:16.561498+0000","last_became_active":"2023-06-09T04:38:11.200288+0000","last_became_peered":"2023-06-09T04:38:11.200288+0000","last_unstale":"2023-06-09T04:38:16.561498+0000","last_undegraded":"2023-06-09T04:38:16.561498+0000","last_fullsized":"2023-06-09T04:38:16.561498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:50.406974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560072+0000","last_change":"2023-06-09T04:38:11.585715+0000","last_active":"2023-06-09T04:38:16.560072+0000","last_peered":"2023-06-09T04:38:16.560072+0000","last_clean":"2023-06-09T04:38:16.560072+0000","last_became_active":"2023-06-09T04:38:11.584957+0000","last_became_peered":"2023-06-09T04:38:11.584957+0000","last_unstale":"2023-06-09T04:38:16.560072+0000","last_undegraded":"2023-06-09T04:38:16.560072+0000","last_fullsized":"2023-06-09T04:38:16.560072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:37:29.621473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981971+0000","last_change":"2023-06-09T04:38:15.637942+0000","last_active":"2023-06-09T04:38:15.981971+0000","last_peered":"2023-06-09T04:38:15.981971+0000","last_clean":"2023-06-09T04:38:15.981971+0000","last_became_active":"2023-06-09T04:38:15.637496+0000","last_became_peered":"2023-06-09T04:38:15.637496+0000","last_unstale":"2023-06-09T04:38:15.981971+0000","last_undegraded":"2023-06-09T04:38:15.981971+0000","last_fullsized":"2023-06-09T04:38:15.981971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:34.351945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559952+0000","last_change":"2023-06-09T04:38:11.185664+0000","last_active":"2023-06-09T04:38:16.559952+0000","last_peered":"2023-06-09T04:38:16.559952+0000","last_clean":"2023-06-09T04:38:16.559952+0000","last_became_active":"2023-06-09T04:38:11.185158+0000","last_became_peered":"2023-06-09T04:38:11.185158+0000","last_unstale":"2023-06-09T04:38:16.559952+0000","last_undegraded":"2023-06-09T04:38:16.559952+0000","last_fullsized":"2023-06-09T04:38:16.559952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:41.509050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981434+0000","last_change":"2023-06-09T04:38:11.585306+0000","last_active":"2023-06-09T04:38:15.981434+0000","last_peered":"2023-06-09T04:38:15.981434+0000","last_clean":"2023-06-09T04:38:15.981434+0000","last_became_active":"2023-06-09T04:38:11.584847+0000","last_became_peered":"2023-06-09T04:38:11.584847+0000","last_unstale":"2023-06-09T04:38:15.981434+0000","last_undegraded":"2023-06-09T04:38:15.981434+0000","last_fullsized":"2023-06-09T04:38:15.981434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066287+0000","last_change":"2023-06-09T04:38:15.622777+0000","last_active":"2023-06-09T04:38:16.066287+0000","last_peered":"2023-06-09T04:38:16.066287+0000","last_clean":"2023-06-09T04:38:16.066287+0000","last_became_active":"2023-06-09T04:38:15.622311+0000","last_became_peered":"2023-06-09T04:38:15.622311+0000","last_unstale":"2023-06-09T04:38:16.066287+0000","last_undegraded":"2023-06-09T04:38:16.066287+0000","last_fullsized":"2023-06-09T04:38:16.066287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:54.359850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066456+0000","last_change":"2023-06-09T04:38:11.189358+0000","last_active":"2023-06-09T04:38:16.066456+0000","last_peered":"2023-06-09T04:38:16.066456+0000","last_clean":"2023-06-09T04:38:16.066456+0000","last_became_active":"2023-06-09T04:38:11.188357+0000","last_became_peered":"2023-06-09T04:38:11.188357+0000","last_unstale":"2023-06-09T04:38:16.066456+0000","last_undegraded":"2023-06-09T04:38:16.066456+0000","last_fullsized":"2023-06-09T04:38:16.066456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:16.955337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982469+0000","last_change":"2023-06-09T04:38:11.579687+0000","last_active":"2023-06-09T04:38:15.982469+0000","last_peered":"2023-06-09T04:38:15.982469+0000","last_clean":"2023-06-09T04:38:15.982469+0000","last_became_active":"2023-06-09T04:38:11.579135+0000","last_became_peered":"2023-06-09T04:38:11.579135+0000","last_unstale":"2023-06-09T04:38:15.982469+0000","last_undegraded":"2023-06-09T04:38:15.982469+0000","last_fullsized":"2023-06-09T04:38:15.982469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:37.416450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986093+0000","last_change":"2023-06-09T04:38:15.652067+0000","last_active":"2023-06-09T04:38:15.986093+0000","last_peered":"2023-06-09T04:38:15.986093+0000","last_clean":"2023-06-09T04:38:15.986093+0000","last_became_active":"2023-06-09T04:38:15.651161+0000","last_became_peered":"2023-06-09T04:38:15.651161+0000","last_unstale":"2023-06-09T04:38:15.986093+0000","last_undegraded":"2023-06-09T04:38:15.986093+0000","last_fullsized":"2023-06-09T04:38:15.986093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:21.927575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985609+0000","last_change":"2023-06-09T04:38:11.180066+0000","last_active":"2023-06-09T04:38:15.985609+0000","last_peered":"2023-06-09T04:38:15.985609+0000","last_clean":"2023-06-09T04:38:15.985609+0000","last_became_active":"2023-06-09T04:38:11.179266+0000","last_became_peered":"2023-06-09T04:38:11.179266+0000","last_unstale":"2023-06-09T04:38:15.985609+0000","last_undegraded":"2023-06-09T04:38:15.985609+0000","last_fullsized":"2023-06-09T04:38:15.985609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:07.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986230+0000","last_change":"2023-06-09T04:38:11.594680+0000","last_active":"2023-06-09T04:38:15.986230+0000","last_peered":"2023-06-09T04:38:15.986230+0000","last_clean":"2023-06-09T04:38:15.986230+0000","last_became_active":"2023-06-09T04:38:11.594276+0000","last_became_peered":"2023-06-09T04:38:11.594276+0000","last_unstale":"2023-06-09T04:38:15.986230+0000","last_undegraded":"2023-06-09T04:38:15.986230+0000","last_fullsized":"2023-06-09T04:38:15.986230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:52.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981838+0000","last_change":"2023-06-09T04:38:15.648101+0000","last_active":"2023-06-09T04:38:15.981838+0000","last_peered":"2023-06-09T04:38:15.981838+0000","last_clean":"2023-06-09T04:38:15.981838+0000","last_became_active":"2023-06-09T04:38:15.647608+0000","last_became_peered":"2023-06-09T04:38:15.647608+0000","last_unstale":"2023-06-09T04:38:15.981838+0000","last_undegraded":"2023-06-09T04:38:15.981838+0000","last_fullsized":"2023-06-09T04:38:15.981838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066410+0000","last_change":"2023-06-09T04:38:11.201960+0000","last_active":"2023-06-09T04:38:16.066410+0000","last_peered":"2023-06-09T04:38:16.066410+0000","last_clean":"2023-06-09T04:38:16.066410+0000","last_became_active":"2023-06-09T04:38:11.201646+0000","last_became_peered":"2023-06-09T04:38:11.201646+0000","last_unstale":"2023-06-09T04:38:16.066410+0000","last_undegraded":"2023-06-09T04:38:16.066410+0000","last_fullsized":"2023-06-09T04:38:16.066410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:36.403064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559845+0000","last_change":"2023-06-09T04:38:11.594028+0000","last_active":"2023-06-09T04:38:16.559845+0000","last_peered":"2023-06-09T04:38:16.559845+0000","last_clean":"2023-06-09T04:38:16.559845+0000","last_became_active":"2023-06-09T04:38:11.593476+0000","last_became_peered":"2023-06-09T04:38:11.593476+0000","last_unstale":"2023-06-09T04:38:16.559845+0000","last_undegraded":"2023-06-09T04:38:16.559845+0000","last_fullsized":"2023-06-09T04:38:16.559845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:03:31.188379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982272+0000","last_change":"2023-06-09T04:38:15.639036+0000","last_active":"2023-06-09T04:38:15.982272+0000","last_peered":"2023-06-09T04:38:15.982272+0000","last_clean":"2023-06-09T04:38:15.982272+0000","last_became_active":"2023-06-09T04:38:15.638526+0000","last_became_peered":"2023-06-09T04:38:15.638526+0000","last_unstale":"2023-06-09T04:38:15.982272+0000","last_undegraded":"2023-06-09T04:38:15.982272+0000","last_fullsized":"2023-06-09T04:38:15.982272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:01.380927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986379+0000","last_change":"2023-06-09T04:38:11.206571+0000","last_active":"2023-06-09T04:38:15.986379+0000","last_peered":"2023-06-09T04:38:15.986379+0000","last_clean":"2023-06-09T04:38:15.986379+0000","last_became_active":"2023-06-09T04:38:11.205967+0000","last_became_peered":"2023-06-09T04:38:11.205967+0000","last_unstale":"2023-06-09T04:38:15.986379+0000","last_undegraded":"2023-06-09T04:38:15.986379+0000","last_fullsized":"2023-06-09T04:38:15.986379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.580093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984552+0000","last_change":"2023-06-09T04:38:11.591665+0000","last_active":"2023-06-09T04:38:15.984552+0000","last_peered":"2023-06-09T04:38:15.984552+0000","last_clean":"2023-06-09T04:38:15.984552+0000","last_became_active":"2023-06-09T04:38:11.591215+0000","last_became_peered":"2023-06-09T04:38:11.591215+0000","last_unstale":"2023-06-09T04:38:15.984552+0000","last_undegraded":"2023-06-09T04:38:15.984552+0000","last_fullsized":"2023-06-09T04:38:15.984552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:05.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985492+0000","last_change":"2023-06-09T04:38:15.645060+0000","last_active":"2023-06-09T04:38:15.985492+0000","last_peered":"2023-06-09T04:38:15.985492+0000","last_clean":"2023-06-09T04:38:15.985492+0000","last_became_active":"2023-06-09T04:38:15.644019+0000","last_became_peered":"2023-06-09T04:38:15.644019+0000","last_unstale":"2023-06-09T04:38:15.985492+0000","last_undegraded":"2023-06-09T04:38:15.985492+0000","last_fullsized":"2023-06-09T04:38:15.985492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:25.082679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559446+0000","last_change":"2023-06-09T04:38:11.195096+0000","last_active":"2023-06-09T04:38:16.559446+0000","last_peered":"2023-06-09T04:38:16.559446+0000","last_clean":"2023-06-09T04:38:16.559446+0000","last_became_active":"2023-06-09T04:38:11.193967+0000","last_became_peered":"2023-06-09T04:38:11.193967+0000","last_unstale":"2023-06-09T04:38:16.559446+0000","last_undegraded":"2023-06-09T04:38:16.559446+0000","last_fullsized":"2023-06-09T04:38:16.559446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:31:01.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560496+0000","last_change":"2023-06-09T04:38:11.598907+0000","last_active":"2023-06-09T04:38:16.560496+0000","last_peered":"2023-06-09T04:38:16.560496+0000","last_clean":"2023-06-09T04:38:16.560496+0000","last_became_active":"2023-06-09T04:38:11.598448+0000","last_became_peered":"2023-06-09T04:38:11.598448+0000","last_unstale":"2023-06-09T04:38:16.560496+0000","last_undegraded":"2023-06-09T04:38:16.560496+0000","last_fullsized":"2023-06-09T04:38:16.560496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:15:01.066687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559038+0000","last_change":"2023-06-09T04:38:11.584299+0000","last_active":"2023-06-09T04:38:16.559038+0000","last_peered":"2023-06-09T04:38:16.559038+0000","last_clean":"2023-06-09T04:38:16.559038+0000","last_became_active":"2023-06-09T04:38:11.584067+0000","last_became_peered":"2023-06-09T04:38:11.584067+0000","last_unstale":"2023-06-09T04:38:16.559038+0000","last_undegraded":"2023-06-09T04:38:16.559038+0000","last_fullsized":"2023-06-09T04:38:16.559038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:49:59.751085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.562107+0000","last_change":"2023-06-09T04:38:11.202669+0000","last_active":"2023-06-09T04:38:16.562107+0000","last_peered":"2023-06-09T04:38:16.562107+0000","last_clean":"2023-06-09T04:38:16.562107+0000","last_became_active":"2023-06-09T04:38:11.201665+0000","last_became_peered":"2023-06-09T04:38:11.201665+0000","last_unstale":"2023-06-09T04:38:16.562107+0000","last_undegraded":"2023-06-09T04:38:16.562107+0000","last_fullsized":"2023-06-09T04:38:16.562107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:48:40.299978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559172+0000","last_change":"2023-06-09T04:38:15.638570+0000","last_active":"2023-06-09T04:38:16.559172+0000","last_peered":"2023-06-09T04:38:16.559172+0000","last_clean":"2023-06-09T04:38:16.559172+0000","last_became_active":"2023-06-09T04:38:15.638066+0000","last_became_peered":"2023-06-09T04:38:15.638066+0000","last_unstale":"2023-06-09T04:38:16.559172+0000","last_undegraded":"2023-06-09T04:38:16.559172+0000","last_fullsized":"2023-06-09T04:38:16.559172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:55.971330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986040+0000","last_change":"2023-06-09T04:38:11.591894+0000","last_active":"2023-06-09T04:38:15.986040+0000","last_peered":"2023-06-09T04:38:15.986040+0000","last_clean":"2023-06-09T04:38:15.986040+0000","last_became_active":"2023-06-09T04:38:11.590872+0000","last_became_peered":"2023-06-09T04:38:11.590872+0000","last_unstale":"2023-06-09T04:38:15.986040+0000","last_undegraded":"2023-06-09T04:38:15.986040+0000","last_fullsized":"2023-06-09T04:38:15.986040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:13.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982353+0000","last_change":"2023-06-09T04:38:11.173622+0000","last_active":"2023-06-09T04:38:15.982353+0000","last_peered":"2023-06-09T04:38:15.982353+0000","last_clean":"2023-06-09T04:38:15.982353+0000","last_became_active":"2023-06-09T04:38:11.173296+0000","last_became_peered":"2023-06-09T04:38:11.173296+0000","last_unstale":"2023-06-09T04:38:15.982353+0000","last_undegraded":"2023-06-09T04:38:15.982353+0000","last_fullsized":"2023-06-09T04:38:15.982353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:14.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981275+0000","last_change":"2023-06-09T04:38:15.624872+0000","last_active":"2023-06-09T04:38:15.981275+0000","last_peered":"2023-06-09T04:38:15.981275+0000","last_clean":"2023-06-09T04:38:15.981275+0000","last_became_active":"2023-06-09T04:38:15.623576+0000","last_became_peered":"2023-06-09T04:38:15.623576+0000","last_unstale":"2023-06-09T04:38:15.981275+0000","last_undegraded":"2023-06-09T04:38:15.981275+0000","last_fullsized":"2023-06-09T04:38:15.981275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:29.450913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116345+0000","last_change":"2023-06-09T04:38:11.191574+0000","last_active":"2023-06-09T04:38:16.116345+0000","last_peered":"2023-06-09T04:38:16.116345+0000","last_clean":"2023-06-09T04:38:16.116345+0000","last_became_active":"2023-06-09T04:38:11.191265+0000","last_became_peered":"2023-06-09T04:38:11.191265+0000","last_unstale":"2023-06-09T04:38:16.116345+0000","last_undegraded":"2023-06-09T04:38:16.116345+0000","last_fullsized":"2023-06-09T04:38:16.116345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:36.614743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983839+0000","last_change":"2023-06-09T04:38:11.602110+0000","last_active":"2023-06-09T04:38:15.983839+0000","last_peered":"2023-06-09T04:38:15.983839+0000","last_clean":"2023-06-09T04:38:15.983839+0000","last_became_active":"2023-06-09T04:38:11.601863+0000","last_became_peered":"2023-06-09T04:38:11.601863+0000","last_unstale":"2023-06-09T04:38:15.983839+0000","last_undegraded":"2023-06-09T04:38:15.983839+0000","last_fullsized":"2023-06-09T04:38:15.983839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:33.650536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983706+0000","last_change":"2023-06-09T04:38:15.652599+0000","last_active":"2023-06-09T04:38:15.983706+0000","last_peered":"2023-06-09T04:38:15.983706+0000","last_clean":"2023-06-09T04:38:15.983706+0000","last_became_active":"2023-06-09T04:38:15.651894+0000","last_became_peered":"2023-06-09T04:38:15.651894+0000","last_unstale":"2023-06-09T04:38:15.983706+0000","last_undegraded":"2023-06-09T04:38:15.983706+0000","last_fullsized":"2023-06-09T04:38:15.983706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:39:05.473086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:21.329783+0000","last_change":"2023-06-09T04:38:11.178844+0000","last_active":"2023-06-09T04:38:21.329783+0000","last_peered":"2023-06-09T04:38:21.329783+0000","last_clean":"2023-06-09T04:38:21.329783+0000","last_became_active":"2023-06-09T04:38:11.178527+0000","last_became_peered":"2023-06-09T04:38:11.178527+0000","last_unstale":"2023-06-09T04:38:21.329783+0000","last_undegraded":"2023-06-09T04:38:21.329783+0000","last_fullsized":"2023-06-09T04:38:21.329783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:38.682351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982266+0000","last_change":"2023-06-09T04:38:11.590873+0000","last_active":"2023-06-09T04:38:15.982266+0000","last_peered":"2023-06-09T04:38:15.982266+0000","last_clean":"2023-06-09T04:38:15.982266+0000","last_became_active":"2023-06-09T04:38:11.590341+0000","last_became_peered":"2023-06-09T04:38:11.590341+0000","last_unstale":"2023-06-09T04:38:15.982266+0000","last_undegraded":"2023-06-09T04:38:15.982266+0000","last_fullsized":"2023-06-09T04:38:15.982266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982961+0000","last_change":"2023-06-09T04:38:15.641224+0000","last_active":"2023-06-09T04:38:15.982961+0000","last_peered":"2023-06-09T04:38:15.982961+0000","last_clean":"2023-06-09T04:38:15.982961+0000","last_became_active":"2023-06-09T04:38:15.630567+0000","last_became_peered":"2023-06-09T04:38:15.630567+0000","last_unstale":"2023-06-09T04:38:15.982961+0000","last_undegraded":"2023-06-09T04:38:15.982961+0000","last_fullsized":"2023-06-09T04:38:15.982961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:33.133686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981808+0000","last_change":"2023-06-09T04:38:11.591047+0000","last_active":"2023-06-09T04:38:15.981808+0000","last_peered":"2023-06-09T04:38:15.981808+0000","last_clean":"2023-06-09T04:38:15.981808+0000","last_became_active":"2023-06-09T04:38:11.590710+0000","last_became_peered":"2023-06-09T04:38:11.590710+0000","last_unstale":"2023-06-09T04:38:15.981808+0000","last_undegraded":"2023-06-09T04:38:15.981808+0000","last_fullsized":"2023-06-09T04:38:15.981808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561003+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:38:16.561003+0000","last_peered":"2023-06-09T04:38:16.561003+0000","last_clean":"2023-06-09T04:38:16.561003+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:38:16.561003+0000","last_undegraded":"2023-06-09T04:38:16.561003+0000","last_fullsized":"2023-06-09T04:38:16.561003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:56:41.217550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984485+0000","last_change":"2023-06-09T04:38:11.206839+0000","last_active":"2023-06-09T04:38:15.984485+0000","last_peered":"2023-06-09T04:38:15.984485+0000","last_clean":"2023-06-09T04:38:15.984485+0000","last_became_active":"2023-06-09T04:38:11.206136+0000","last_became_peered":"2023-06-09T04:38:11.206136+0000","last_unstale":"2023-06-09T04:38:15.984485+0000","last_undegraded":"2023-06-09T04:38:15.984485+0000","last_fullsized":"2023-06-09T04:38:15.984485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:00:59.250719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983799+0000","last_change":"2023-06-09T04:38:15.654768+0000","last_active":"2023-06-09T04:38:15.983799+0000","last_peered":"2023-06-09T04:38:15.983799+0000","last_clean":"2023-06-09T04:38:15.983799+0000","last_became_active":"2023-06-09T04:38:15.653848+0000","last_became_peered":"2023-06-09T04:38:15.653848+0000","last_unstale":"2023-06-09T04:38:15.983799+0000","last_undegraded":"2023-06-09T04:38:15.983799+0000","last_fullsized":"2023-06-09T04:38:15.983799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:35:20.247138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984327+0000","last_change":"2023-06-09T04:38:11.576946+0000","last_active":"2023-06-09T04:38:15.984327+0000","last_peered":"2023-06-09T04:38:15.984327+0000","last_clean":"2023-06-09T04:38:15.984327+0000","last_became_active":"2023-06-09T04:38:11.576234+0000","last_became_peered":"2023-06-09T04:38:11.576234+0000","last_unstale":"2023-06-09T04:38:15.984327+0000","last_undegraded":"2023-06-09T04:38:15.984327+0000","last_fullsized":"2023-06-09T04:38:15.984327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:09:39.247053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986402+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:38:15.986402+0000","last_peered":"2023-06-09T04:38:15.986402+0000","last_clean":"2023-06-09T04:38:15.986402+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:38:15.986402+0000","last_undegraded":"2023-06-09T04:38:15.986402+0000","last_fullsized":"2023-06-09T04:38:15.986402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:17.380871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985503+0000","last_change":"2023-06-09T04:38:11.207993+0000","last_active":"2023-06-09T04:38:15.985503+0000","last_peered":"2023-06-09T04:38:15.985503+0000","last_clean":"2023-06-09T04:38:15.985503+0000","last_became_active":"2023-06-09T04:38:11.207375+0000","last_became_peered":"2023-06-09T04:38:11.207375+0000","last_unstale":"2023-06-09T04:38:15.985503+0000","last_undegraded":"2023-06-09T04:38:15.985503+0000","last_fullsized":"2023-06-09T04:38:15.985503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:58.163202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559365+0000","last_change":"2023-06-09T04:38:15.629330+0000","last_active":"2023-06-09T04:38:16.559365+0000","last_peered":"2023-06-09T04:38:16.559365+0000","last_clean":"2023-06-09T04:38:16.559365+0000","last_became_active":"2023-06-09T04:38:15.628803+0000","last_became_peered":"2023-06-09T04:38:15.628803+0000","last_unstale":"2023-06-09T04:38:16.559365+0000","last_undegraded":"2023-06-09T04:38:16.559365+0000","last_fullsized":"2023-06-09T04:38:16.559365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:25.965238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985856+0000","last_change":"2023-06-09T04:38:11.582531+0000","last_active":"2023-06-09T04:38:15.985856+0000","last_peered":"2023-06-09T04:38:15.985856+0000","last_clean":"2023-06-09T04:38:15.985856+0000","last_became_active":"2023-06-09T04:38:11.581963+0000","last_became_peered":"2023-06-09T04:38:11.581963+0000","last_unstale":"2023-06-09T04:38:15.985856+0000","last_undegraded":"2023-06-09T04:38:15.985856+0000","last_fullsized":"2023-06-09T04:38:15.985856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560988+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:38:16.560988+0000","last_peered":"2023-06-09T04:38:16.560988+0000","last_clean":"2023-06-09T04:38:16.560988+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:38:16.560988+0000","last_undegraded":"2023-06-09T04:38:16.560988+0000","last_fullsized":"2023-06-09T04:38:16.560988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:49:08.570686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984867+0000","last_change":"2023-06-09T04:38:11.203569+0000","last_active":"2023-06-09T04:38:15.984867+0000","last_peered":"2023-06-09T04:38:15.984867+0000","last_clean":"2023-06-09T04:38:15.984867+0000","last_became_active":"2023-06-09T04:38:11.202787+0000","last_became_peered":"2023-06-09T04:38:11.202787+0000","last_unstale":"2023-06-09T04:38:15.984867+0000","last_undegraded":"2023-06-09T04:38:15.984867+0000","last_fullsized":"2023-06-09T04:38:15.984867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:57.391865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115733+0000","last_change":"2023-06-09T04:38:15.638680+0000","last_active":"2023-06-09T04:38:16.115733+0000","last_peered":"2023-06-09T04:38:16.115733+0000","last_clean":"2023-06-09T04:38:16.115733+0000","last_became_active":"2023-06-09T04:38:15.638219+0000","last_became_peered":"2023-06-09T04:38:15.638219+0000","last_unstale":"2023-06-09T04:38:16.115733+0000","last_undegraded":"2023-06-09T04:38:16.115733+0000","last_fullsized":"2023-06-09T04:38:16.115733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:36.541614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983149+0000","last_change":"2023-06-09T04:38:11.589753+0000","last_active":"2023-06-09T04:38:15.983149+0000","last_peered":"2023-06-09T04:38:15.983149+0000","last_clean":"2023-06-09T04:38:15.983149+0000","last_became_active":"2023-06-09T04:38:11.589289+0000","last_became_peered":"2023-06-09T04:38:11.589289+0000","last_unstale":"2023-06-09T04:38:15.983149+0000","last_undegraded":"2023-06-09T04:38:15.983149+0000","last_fullsized":"2023-06-09T04:38:15.983149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:19.797205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560927+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:38:16.560927+0000","last_peered":"2023-06-09T04:38:16.560927+0000","last_clean":"2023-06-09T04:38:16.560927+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:38:16.560927+0000","last_undegraded":"2023-06-09T04:38:16.560927+0000","last_fullsized":"2023-06-09T04:38:16.560927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:48.345845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981929+0000","last_change":"2023-06-09T04:38:11.191786+0000","last_active":"2023-06-09T04:38:15.981929+0000","last_peered":"2023-06-09T04:38:15.981929+0000","last_clean":"2023-06-09T04:38:15.981929+0000","last_became_active":"2023-06-09T04:38:11.191379+0000","last_became_peered":"2023-06-09T04:38:11.191379+0000","last_unstale":"2023-06-09T04:38:15.981929+0000","last_undegraded":"2023-06-09T04:38:15.981929+0000","last_fullsized":"2023-06-09T04:38:15.981929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984276+0000","last_change":"2023-06-09T04:38:15.652331+0000","last_active":"2023-06-09T04:38:15.984276+0000","last_peered":"2023-06-09T04:38:15.984276+0000","last_clean":"2023-06-09T04:38:15.984276+0000","last_became_active":"2023-06-09T04:38:15.651379+0000","last_became_peered":"2023-06-09T04:38:15.651379+0000","last_unstale":"2023-06-09T04:38:15.984276+0000","last_undegraded":"2023-06-09T04:38:15.984276+0000","last_fullsized":"2023-06-09T04:38:15.984276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:23.892869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984378+0000","last_change":"2023-06-09T04:38:11.581677+0000","last_active":"2023-06-09T04:38:15.984378+0000","last_peered":"2023-06-09T04:38:15.984378+0000","last_clean":"2023-06-09T04:38:15.984378+0000","last_became_active":"2023-06-09T04:38:11.580936+0000","last_became_peered":"2023-06-09T04:38:11.580936+0000","last_unstale":"2023-06-09T04:38:15.984378+0000","last_undegraded":"2023-06-09T04:38:15.984378+0000","last_fullsized":"2023-06-09T04:38:15.984378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:37.628129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115946+0000","last_change":"2023-06-09T04:38:11.182996+0000","last_active":"2023-06-09T04:38:16.115946+0000","last_peered":"2023-06-09T04:38:16.115946+0000","last_clean":"2023-06-09T04:38:16.115946+0000","last_became_active":"2023-06-09T04:38:11.182625+0000","last_became_peered":"2023-06-09T04:38:11.182625+0000","last_unstale":"2023-06-09T04:38:16.115946+0000","last_undegraded":"2023-06-09T04:38:16.115946+0000","last_fullsized":"2023-06-09T04:38:16.115946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:18.783819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560422+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:38:16.560422+0000","last_peered":"2023-06-09T04:38:16.560422+0000","last_clean":"2023-06-09T04:38:16.560422+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:38:16.560422+0000","last_undegraded":"2023-06-09T04:38:16.560422+0000","last_fullsized":"2023-06-09T04:38:16.560422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:23:30.684840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559603+0000","last_change":"2023-06-09T04:38:15.645663+0000","last_active":"2023-06-09T04:38:16.559603+0000","last_peered":"2023-06-09T04:38:16.559603+0000","last_clean":"2023-06-09T04:38:16.559603+0000","last_became_active":"2023-06-09T04:38:15.644922+0000","last_became_peered":"2023-06-09T04:38:15.644922+0000","last_unstale":"2023-06-09T04:38:16.559603+0000","last_undegraded":"2023-06-09T04:38:16.559603+0000","last_fullsized":"2023-06-09T04:38:16.559603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:58:02.310074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985956+0000","last_change":"2023-06-09T04:38:11.581442+0000","last_active":"2023-06-09T04:38:15.985956+0000","last_peered":"2023-06-09T04:38:15.985956+0000","last_clean":"2023-06-09T04:38:15.985956+0000","last_became_active":"2023-06-09T04:38:11.580940+0000","last_became_peered":"2023-06-09T04:38:11.580940+0000","last_unstale":"2023-06-09T04:38:15.985956+0000","last_undegraded":"2023-06-09T04:38:15.985956+0000","last_fullsized":"2023-06-09T04:38:15.985956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.557750+0000","last_change":"2023-06-09T04:38:11.201284+0000","last_active":"2023-06-09T04:38:16.557750+0000","last_peered":"2023-06-09T04:38:16.557750+0000","last_clean":"2023-06-09T04:38:16.557750+0000","last_became_active":"2023-06-09T04:38:11.200454+0000","last_became_peered":"2023-06-09T04:38:11.200454+0000","last_unstale":"2023-06-09T04:38:16.557750+0000","last_undegraded":"2023-06-09T04:38:16.557750+0000","last_fullsized":"2023-06-09T04:38:16.557750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:38:53.244123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559796+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:38:16.559796+0000","last_peered":"2023-06-09T04:38:16.559796+0000","last_clean":"2023-06-09T04:38:16.559796+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:38:16.559796+0000","last_undegraded":"2023-06-09T04:38:16.559796+0000","last_fullsized":"2023-06-09T04:38:16.559796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:35:18.640660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559491+0000","last_change":"2023-06-09T04:38:15.644559+0000","last_active":"2023-06-09T04:38:16.559491+0000","last_peered":"2023-06-09T04:38:16.559491+0000","last_clean":"2023-06-09T04:38:16.559491+0000","last_became_active":"2023-06-09T04:38:15.643793+0000","last_became_peered":"2023-06-09T04:38:15.643793+0000","last_unstale":"2023-06-09T04:38:16.559491+0000","last_undegraded":"2023-06-09T04:38:16.559491+0000","last_fullsized":"2023-06-09T04:38:16.559491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:27.198186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561351+0000","last_change":"2023-06-09T04:38:11.582052+0000","last_active":"2023-06-09T04:38:16.561351+0000","last_peered":"2023-06-09T04:38:16.561351+0000","last_clean":"2023-06-09T04:38:16.561351+0000","last_became_active":"2023-06-09T04:38:11.581569+0000","last_became_peered":"2023-06-09T04:38:11.581569+0000","last_unstale":"2023-06-09T04:38:16.561351+0000","last_undegraded":"2023-06-09T04:38:16.561351+0000","last_fullsized":"2023-06-09T04:38:16.561351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:27:07.420266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983212+0000","last_change":"2023-06-09T04:38:11.193727+0000","last_active":"2023-06-09T04:38:15.983212+0000","last_peered":"2023-06-09T04:38:15.983212+0000","last_clean":"2023-06-09T04:38:15.983212+0000","last_became_active":"2023-06-09T04:38:11.191671+0000","last_became_peered":"2023-06-09T04:38:11.191671+0000","last_unstale":"2023-06-09T04:38:15.983212+0000","last_undegraded":"2023-06-09T04:38:15.983212+0000","last_fullsized":"2023-06-09T04:38:15.983212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:18.631690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560388+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:38:16.560388+0000","last_peered":"2023-06-09T04:38:16.560388+0000","last_clean":"2023-06-09T04:38:16.560388+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:38:16.560388+0000","last_undegraded":"2023-06-09T04:38:16.560388+0000","last_fullsized":"2023-06-09T04:38:16.560388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:46.578064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560338+0000","last_change":"2023-06-09T04:38:15.631104+0000","last_active":"2023-06-09T04:38:16.560338+0000","last_peered":"2023-06-09T04:38:16.560338+0000","last_clean":"2023-06-09T04:38:16.560338+0000","last_became_active":"2023-06-09T04:38:15.630126+0000","last_became_peered":"2023-06-09T04:38:15.630126+0000","last_unstale":"2023-06-09T04:38:16.560338+0000","last_undegraded":"2023-06-09T04:38:16.560338+0000","last_fullsized":"2023-06-09T04:38:16.560338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:11:32.650489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560095+0000","last_change":"2023-06-09T04:38:11.609569+0000","last_active":"2023-06-09T04:38:16.560095+0000","last_peered":"2023-06-09T04:38:16.560095+0000","last_clean":"2023-06-09T04:38:16.560095+0000","last_became_active":"2023-06-09T04:38:11.608179+0000","last_became_peered":"2023-06-09T04:38:11.608179+0000","last_unstale":"2023-06-09T04:38:16.560095+0000","last_undegraded":"2023-06-09T04:38:16.560095+0000","last_fullsized":"2023-06-09T04:38:16.560095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:09:01.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984195+0000","last_change":"2023-06-09T04:38:11.180161+0000","last_active":"2023-06-09T04:38:15.984195+0000","last_peered":"2023-06-09T04:38:15.984195+0000","last_clean":"2023-06-09T04:38:15.984195+0000","last_became_active":"2023-06-09T04:38:11.179361+0000","last_became_peered":"2023-06-09T04:38:11.179361+0000","last_unstale":"2023-06-09T04:38:15.984195+0000","last_undegraded":"2023-06-09T04:38:15.984195+0000","last_fullsized":"2023-06-09T04:38:15.984195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:36:14.841594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560750+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:38:16.560750+0000","last_peered":"2023-06-09T04:38:16.560750+0000","last_clean":"2023-06-09T04:38:16.560750+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:38:16.560750+0000","last_undegraded":"2023-06-09T04:38:16.560750+0000","last_fullsized":"2023-06-09T04:38:16.560750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:05.863481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066863+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:38:16.066863+0000","last_peered":"2023-06-09T04:38:16.066863+0000","last_clean":"2023-06-09T04:38:16.066863+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:38:16.066863+0000","last_undegraded":"2023-06-09T04:38:16.066863+0000","last_fullsized":"2023-06-09T04:38:16.066863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:17.786150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116200+0000","last_change":"2023-06-09T04:38:15.648847+0000","last_active":"2023-06-09T04:38:16.116200+0000","last_peered":"2023-06-09T04:38:16.116200+0000","last_clean":"2023-06-09T04:38:16.116200+0000","last_became_active":"2023-06-09T04:38:15.648379+0000","last_became_peered":"2023-06-09T04:38:15.648379+0000","last_unstale":"2023-06-09T04:38:16.116200+0000","last_undegraded":"2023-06-09T04:38:16.116200+0000","last_fullsized":"2023-06-09T04:38:16.116200+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:42:23.070086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559158+0000","last_change":"2023-06-09T04:38:11.599288+0000","last_active":"2023-06-09T04:38:16.559158+0000","last_peered":"2023-06-09T04:38:16.559158+0000","last_clean":"2023-06-09T04:38:16.559158+0000","last_became_active":"2023-06-09T04:38:11.598737+0000","last_became_peered":"2023-06-09T04:38:11.598737+0000","last_unstale":"2023-06-09T04:38:16.559158+0000","last_undegraded":"2023-06-09T04:38:16.559158+0000","last_fullsized":"2023-06-09T04:38:16.559158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:35.326089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986583+0000","last_change":"2023-06-09T04:38:11.191838+0000","last_active":"2023-06-09T04:38:15.986583+0000","last_peered":"2023-06-09T04:38:15.986583+0000","last_clean":"2023-06-09T04:38:15.986583+0000","last_became_active":"2023-06-09T04:38:11.191075+0000","last_became_peered":"2023-06-09T04:38:11.191075+0000","last_unstale":"2023-06-09T04:38:15.986583+0000","last_undegraded":"2023-06-09T04:38:15.986583+0000","last_fullsized":"2023-06-09T04:38:15.986583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:46.284052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560839+0000","last_change":"2023-06-09T04:38:15.613910+0000","last_active":"2023-06-09T04:38:16.560839+0000","last_peered":"2023-06-09T04:38:16.560839+0000","last_clean":"2023-06-09T04:38:16.560839+0000","last_became_active":"2023-06-09T04:38:15.613324+0000","last_became_peered":"2023-06-09T04:38:15.613324+0000","last_unstale":"2023-06-09T04:38:16.560839+0000","last_undegraded":"2023-06-09T04:38:16.560839+0000","last_fullsized":"2023-06-09T04:38:16.560839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:37:53.617189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982270+0000","last_change":"2023-06-09T04:38:11.565137+0000","last_active":"2023-06-09T04:38:15.982270+0000","last_peered":"2023-06-09T04:38:15.982270+0000","last_clean":"2023-06-09T04:38:15.982270+0000","last_became_active":"2023-06-09T04:38:11.564885+0000","last_became_peered":"2023-06-09T04:38:11.564885+0000","last_unstale":"2023-06-09T04:38:15.982270+0000","last_undegraded":"2023-06-09T04:38:15.982270+0000","last_fullsized":"2023-06-09T04:38:15.982270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:50.934840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560844+0000","last_change":"2023-06-09T04:38:11.210525+0000","last_active":"2023-06-09T04:38:16.560844+0000","last_peered":"2023-06-09T04:38:16.560844+0000","last_clean":"2023-06-09T04:38:16.560844+0000","last_became_active":"2023-06-09T04:38:11.210047+0000","last_became_peered":"2023-06-09T04:38:11.210047+0000","last_unstale":"2023-06-09T04:38:16.560844+0000","last_undegraded":"2023-06-09T04:38:16.560844+0000","last_fullsized":"2023-06-09T04:38:16.560844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:44:57.325527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066485+0000","last_change":"2023-06-09T04:38:15.616243+0000","last_active":"2023-06-09T04:38:16.066485+0000","last_peered":"2023-06-09T04:38:16.066485+0000","last_clean":"2023-06-09T04:38:16.066485+0000","last_became_active":"2023-06-09T04:38:15.615680+0000","last_became_peered":"2023-06-09T04:38:15.615680+0000","last_unstale":"2023-06-09T04:38:16.066485+0000","last_undegraded":"2023-06-09T04:38:16.066485+0000","last_fullsized":"2023-06-09T04:38:16.066485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:48.975956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559686+0000","last_change":"2023-06-09T04:38:11.609943+0000","last_active":"2023-06-09T04:38:16.559686+0000","last_peered":"2023-06-09T04:38:16.559686+0000","last_clean":"2023-06-09T04:38:16.559686+0000","last_became_active":"2023-06-09T04:38:11.608810+0000","last_became_peered":"2023-06-09T04:38:11.608810+0000","last_unstale":"2023-06-09T04:38:16.559686+0000","last_undegraded":"2023-06-09T04:38:16.559686+0000","last_fullsized":"2023-06-09T04:38:16.559686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:54:36.052953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560271+0000","last_change":"2023-06-09T04:38:11.173638+0000","last_active":"2023-06-09T04:38:16.560271+0000","last_peered":"2023-06-09T04:38:16.560271+0000","last_clean":"2023-06-09T04:38:16.560271+0000","last_became_active":"2023-06-09T04:38:11.173388+0000","last_became_peered":"2023-06-09T04:38:11.173388+0000","last_unstale":"2023-06-09T04:38:16.560271+0000","last_undegraded":"2023-06-09T04:38:16.560271+0000","last_fullsized":"2023-06-09T04:38:16.560271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:51:29.591833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560504+0000","last_change":"2023-06-09T04:38:15.614814+0000","last_active":"2023-06-09T04:38:16.560504+0000","last_peered":"2023-06-09T04:38:16.560504+0000","last_clean":"2023-06-09T04:38:16.560504+0000","last_became_active":"2023-06-09T04:38:15.613623+0000","last_became_peered":"2023-06-09T04:38:15.613623+0000","last_unstale":"2023-06-09T04:38:16.560504+0000","last_undegraded":"2023-06-09T04:38:16.560504+0000","last_fullsized":"2023-06-09T04:38:16.560504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:48:43.207948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116961+0000","last_change":"2023-06-09T04:38:11.596789+0000","last_active":"2023-06-09T04:38:16.116961+0000","last_peered":"2023-06-09T04:38:16.116961+0000","last_clean":"2023-06-09T04:38:16.116961+0000","last_became_active":"2023-06-09T04:38:11.596416+0000","last_became_peered":"2023-06-09T04:38:11.596416+0000","last_unstale":"2023-06-09T04:38:16.116961+0000","last_undegraded":"2023-06-09T04:38:16.116961+0000","last_fullsized":"2023-06-09T04:38:16.116961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558934+0000","last_change":"2023-06-09T04:38:11.199156+0000","last_active":"2023-06-09T04:38:16.558934+0000","last_peered":"2023-06-09T04:38:16.558934+0000","last_clean":"2023-06-09T04:38:16.558934+0000","last_became_active":"2023-06-09T04:38:11.198208+0000","last_became_peered":"2023-06-09T04:38:11.198208+0000","last_unstale":"2023-06-09T04:38:16.558934+0000","last_undegraded":"2023-06-09T04:38:16.558934+0000","last_fullsized":"2023-06-09T04:38:16.558934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:35:02.979372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559203+0000","last_change":"2023-06-09T04:38:15.644288+0000","last_active":"2023-06-09T04:38:16.559203+0000","last_peered":"2023-06-09T04:38:16.559203+0000","last_clean":"2023-06-09T04:38:16.559203+0000","last_became_active":"2023-06-09T04:38:15.643538+0000","last_became_peered":"2023-06-09T04:38:15.643538+0000","last_unstale":"2023-06-09T04:38:16.559203+0000","last_undegraded":"2023-06-09T04:38:16.559203+0000","last_fullsized":"2023-06-09T04:38:16.559203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:33:30.456054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560700+0000","last_change":"2023-06-09T04:38:11.596225+0000","last_active":"2023-06-09T04:38:16.560700+0000","last_peered":"2023-06-09T04:38:16.560700+0000","last_clean":"2023-06-09T04:38:16.560700+0000","last_became_active":"2023-06-09T04:38:11.595908+0000","last_became_peered":"2023-06-09T04:38:11.595908+0000","last_unstale":"2023-06-09T04:38:16.560700+0000","last_undegraded":"2023-06-09T04:38:16.560700+0000","last_fullsized":"2023-06-09T04:38:16.560700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:22:22.632206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.117460+0000","last_change":"2023-06-09T04:38:11.192489+0000","last_active":"2023-06-09T04:38:16.117460+0000","last_peered":"2023-06-09T04:38:16.117460+0000","last_clean":"2023-06-09T04:38:16.117460+0000","last_became_active":"2023-06-09T04:38:11.191911+0000","last_became_peered":"2023-06-09T04:38:11.191911+0000","last_unstale":"2023-06-09T04:38:16.117460+0000","last_undegraded":"2023-06-09T04:38:16.117460+0000","last_fullsized":"2023-06-09T04:38:16.117460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:45.118419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983119+0000","last_change":"2023-06-09T04:38:15.644054+0000","last_active":"2023-06-09T04:38:15.983119+0000","last_peered":"2023-06-09T04:38:15.983119+0000","last_clean":"2023-06-09T04:38:15.983119+0000","last_became_active":"2023-06-09T04:38:15.643226+0000","last_became_peered":"2023-06-09T04:38:15.643226+0000","last_unstale":"2023-06-09T04:38:15.983119+0000","last_undegraded":"2023-06-09T04:38:15.983119+0000","last_fullsized":"2023-06-09T04:38:15.983119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:08.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.981525+0000","last_change":"2023-06-09T04:38:11.591783+0000","last_active":"2023-06-09T04:38:15.981525+0000","last_peered":"2023-06-09T04:38:15.981525+0000","last_clean":"2023-06-09T04:38:15.981525+0000","last_became_active":"2023-06-09T04:38:11.591359+0000","last_became_peered":"2023-06-09T04:38:11.591359+0000","last_unstale":"2023-06-09T04:38:15.981525+0000","last_undegraded":"2023-06-09T04:38:15.981525+0000","last_fullsized":"2023-06-09T04:38:15.981525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560729+0000","last_change":"2023-06-09T04:38:11.185014+0000","last_active":"2023-06-09T04:38:16.560729+0000","last_peered":"2023-06-09T04:38:16.560729+0000","last_clean":"2023-06-09T04:38:16.560729+0000","last_became_active":"2023-06-09T04:38:11.184569+0000","last_became_peered":"2023-06-09T04:38:11.184569+0000","last_unstale":"2023-06-09T04:38:16.560729+0000","last_undegraded":"2023-06-09T04:38:16.560729+0000","last_fullsized":"2023-06-09T04:38:16.560729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:02.939251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.558082+0000","last_change":"2023-06-09T04:38:15.629791+0000","last_active":"2023-06-09T04:38:16.558082+0000","last_peered":"2023-06-09T04:38:16.558082+0000","last_clean":"2023-06-09T04:38:16.558082+0000","last_became_active":"2023-06-09T04:38:15.628267+0000","last_became_peered":"2023-06-09T04:38:15.628267+0000","last_unstale":"2023-06-09T04:38:16.558082+0000","last_undegraded":"2023-06-09T04:38:16.558082+0000","last_fullsized":"2023-06-09T04:38:16.558082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:56.733282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065867+0000","last_change":"2023-06-09T04:38:11.580119+0000","last_active":"2023-06-09T04:38:16.065867+0000","last_peered":"2023-06-09T04:38:16.065867+0000","last_clean":"2023-06-09T04:38:16.065867+0000","last_became_active":"2023-06-09T04:38:11.579683+0000","last_became_peered":"2023-06-09T04:38:11.579683+0000","last_unstale":"2023-06-09T04:38:16.065867+0000","last_undegraded":"2023-06-09T04:38:16.065867+0000","last_fullsized":"2023-06-09T04:38:16.065867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982464+0000","last_change":"2023-06-09T04:38:11.189768+0000","last_active":"2023-06-09T04:38:15.982464+0000","last_peered":"2023-06-09T04:38:15.982464+0000","last_clean":"2023-06-09T04:38:15.982464+0000","last_became_active":"2023-06-09T04:38:11.183589+0000","last_became_peered":"2023-06-09T04:38:11.183589+0000","last_unstale":"2023-06-09T04:38:15.982464+0000","last_undegraded":"2023-06-09T04:38:15.982464+0000","last_fullsized":"2023-06-09T04:38:15.982464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:26:44.537559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982754+0000","last_change":"2023-06-09T04:38:15.651304+0000","last_active":"2023-06-09T04:38:15.982754+0000","last_peered":"2023-06-09T04:38:15.982754+0000","last_clean":"2023-06-09T04:38:15.982754+0000","last_became_active":"2023-06-09T04:38:15.650429+0000","last_became_peered":"2023-06-09T04:38:15.650429+0000","last_unstale":"2023-06-09T04:38:15.982754+0000","last_undegraded":"2023-06-09T04:38:15.982754+0000","last_fullsized":"2023-06-09T04:38:15.982754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:39:35.270968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559138+0000","last_change":"2023-06-09T04:38:11.608450+0000","last_active":"2023-06-09T04:38:16.559138+0000","last_peered":"2023-06-09T04:38:16.559138+0000","last_clean":"2023-06-09T04:38:16.559138+0000","last_became_active":"2023-06-09T04:38:11.608016+0000","last_became_peered":"2023-06-09T04:38:11.608016+0000","last_unstale":"2023-06-09T04:38:16.559138+0000","last_undegraded":"2023-06-09T04:38:16.559138+0000","last_fullsized":"2023-06-09T04:38:16.559138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:40:47.297438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116600+0000","last_change":"2023-06-09T04:38:11.182774+0000","last_active":"2023-06-09T04:38:16.116600+0000","last_peered":"2023-06-09T04:38:16.116600+0000","last_clean":"2023-06-09T04:38:16.116600+0000","last_became_active":"2023-06-09T04:38:11.182454+0000","last_became_peered":"2023-06-09T04:38:11.182454+0000","last_unstale":"2023-06-09T04:38:16.116600+0000","last_undegraded":"2023-06-09T04:38:16.116600+0000","last_fullsized":"2023-06-09T04:38:16.116600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:20.644283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065961+0000","last_change":"2023-06-09T04:38:15.638696+0000","last_active":"2023-06-09T04:38:16.065961+0000","last_peered":"2023-06-09T04:38:16.065961+0000","last_clean":"2023-06-09T04:38:16.065961+0000","last_became_active":"2023-06-09T04:38:15.638021+0000","last_became_peered":"2023-06-09T04:38:15.638021+0000","last_unstale":"2023-06-09T04:38:16.065961+0000","last_undegraded":"2023-06-09T04:38:16.065961+0000","last_fullsized":"2023-06-09T04:38:16.065961+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:56.518316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560437+0000","last_change":"2023-06-09T04:38:15.644394+0000","last_active":"2023-06-09T04:38:16.560437+0000","last_peered":"2023-06-09T04:38:16.560437+0000","last_clean":"2023-06-09T04:38:16.560437+0000","last_became_active":"2023-06-09T04:38:15.643951+0000","last_became_peered":"2023-06-09T04:38:15.643951+0000","last_unstale":"2023-06-09T04:38:16.560437+0000","last_undegraded":"2023-06-09T04:38:16.560437+0000","last_fullsized":"2023-06-09T04:38:16.560437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:51.630961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066744+0000","last_change":"2023-06-09T04:38:11.204035+0000","last_active":"2023-06-09T04:38:16.066744+0000","last_peered":"2023-06-09T04:38:16.066744+0000","last_clean":"2023-06-09T04:38:16.066744+0000","last_became_active":"2023-06-09T04:38:11.203724+0000","last_became_peered":"2023-06-09T04:38:11.203724+0000","last_unstale":"2023-06-09T04:38:16.066744+0000","last_undegraded":"2023-06-09T04:38:16.066744+0000","last_fullsized":"2023-06-09T04:38:16.066744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:29:23.339781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561757+0000","last_change":"2023-06-09T04:38:11.578687+0000","last_active":"2023-06-09T04:38:16.561757+0000","last_peered":"2023-06-09T04:38:16.561757+0000","last_clean":"2023-06-09T04:38:16.561757+0000","last_became_active":"2023-06-09T04:38:11.577901+0000","last_became_peered":"2023-06-09T04:38:11.577901+0000","last_unstale":"2023-06-09T04:38:16.561757+0000","last_undegraded":"2023-06-09T04:38:16.561757+0000","last_fullsized":"2023-06-09T04:38:16.561757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:44.239627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984075+0000","last_change":"2023-06-09T04:38:15.652937+0000","last_active":"2023-06-09T04:38:15.984075+0000","last_peered":"2023-06-09T04:38:15.984075+0000","last_clean":"2023-06-09T04:38:15.984075+0000","last_became_active":"2023-06-09T04:38:15.651857+0000","last_became_peered":"2023-06-09T04:38:15.651857+0000","last_unstale":"2023-06-09T04:38:15.984075+0000","last_undegraded":"2023-06-09T04:38:15.984075+0000","last_fullsized":"2023-06-09T04:38:15.984075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:57:40.466278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560952+0000","last_change":"2023-06-09T04:38:11.185987+0000","last_active":"2023-06-09T04:38:16.560952+0000","last_peered":"2023-06-09T04:38:16.560952+0000","last_clean":"2023-06-09T04:38:16.560952+0000","last_became_active":"2023-06-09T04:38:11.185132+0000","last_became_peered":"2023-06-09T04:38:11.185132+0000","last_unstale":"2023-06-09T04:38:16.560952+0000","last_undegraded":"2023-06-09T04:38:16.560952+0000","last_fullsized":"2023-06-09T04:38:16.560952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:29:24.685594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561261+0000","last_change":"2023-06-09T04:38:11.581671+0000","last_active":"2023-06-09T04:38:16.561261+0000","last_peered":"2023-06-09T04:38:16.561261+0000","last_clean":"2023-06-09T04:38:16.561261+0000","last_became_active":"2023-06-09T04:38:11.579485+0000","last_became_peered":"2023-06-09T04:38:11.579485+0000","last_unstale":"2023-06-09T04:38:16.561261+0000","last_undegraded":"2023-06-09T04:38:16.561261+0000","last_fullsized":"2023-06-09T04:38:16.561261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:26:56.275716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.983528+0000","last_change":"2023-06-09T04:38:11.196724+0000","last_active":"2023-06-09T04:38:15.983528+0000","last_peered":"2023-06-09T04:38:15.983528+0000","last_clean":"2023-06-09T04:38:15.983528+0000","last_became_active":"2023-06-09T04:38:11.196068+0000","last_became_peered":"2023-06-09T04:38:11.196068+0000","last_unstale":"2023-06-09T04:38:15.983528+0000","last_undegraded":"2023-06-09T04:38:15.983528+0000","last_fullsized":"2023-06-09T04:38:15.983528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:25.012517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559819+0000","last_change":"2023-06-09T04:38:11.590465+0000","last_active":"2023-06-09T04:38:16.559819+0000","last_peered":"2023-06-09T04:38:16.559819+0000","last_clean":"2023-06-09T04:38:16.559819+0000","last_became_active":"2023-06-09T04:38:11.589834+0000","last_became_peered":"2023-06-09T04:38:11.589834+0000","last_unstale":"2023-06-09T04:38:16.559819+0000","last_undegraded":"2023-06-09T04:38:16.559819+0000","last_fullsized":"2023-06-09T04:38:16.559819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:26.501877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984273+0000","last_change":"2023-06-09T04:38:15.638948+0000","last_active":"2023-06-09T04:38:15.984273+0000","last_peered":"2023-06-09T04:38:15.984273+0000","last_clean":"2023-06-09T04:38:15.984273+0000","last_became_active":"2023-06-09T04:38:15.637442+0000","last_became_peered":"2023-06-09T04:38:15.637442+0000","last_unstale":"2023-06-09T04:38:15.984273+0000","last_undegraded":"2023-06-09T04:38:15.984273+0000","last_fullsized":"2023-06-09T04:38:15.984273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:03:02.201851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560419+0000","last_change":"2023-06-09T04:38:11.186756+0000","last_active":"2023-06-09T04:38:16.560419+0000","last_peered":"2023-06-09T04:38:16.560419+0000","last_clean":"2023-06-09T04:38:16.560419+0000","last_became_active":"2023-06-09T04:38:11.185821+0000","last_became_peered":"2023-06-09T04:38:11.185821+0000","last_unstale":"2023-06-09T04:38:16.560419+0000","last_undegraded":"2023-06-09T04:38:16.560419+0000","last_fullsized":"2023-06-09T04:38:16.560419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:10.125207+0000","last_clean_scrub_stamp":"2023-06-09T04:38:10.125207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:10:55.494527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984073+0000","last_change":"2023-06-09T04:38:11.598710+0000","last_active":"2023-06-09T04:38:15.984073+0000","last_peered":"2023-06-09T04:38:15.984073+0000","last_clean":"2023-06-09T04:38:15.984073+0000","last_became_active":"2023-06-09T04:38:11.598397+0000","last_became_peered":"2023-06-09T04:38:11.598397+0000","last_unstale":"2023-06-09T04:38:15.984073+0000","last_undegraded":"2023-06-09T04:38:15.984073+0000","last_fullsized":"2023-06-09T04:38:15.984073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559520+0000","last_change":"2023-06-09T04:38:15.621608+0000","last_active":"2023-06-09T04:38:16.559520+0000","last_peered":"2023-06-09T04:38:16.559520+0000","last_clean":"2023-06-09T04:38:16.559520+0000","last_became_active":"2023-06-09T04:38:15.621042+0000","last_became_peered":"2023-06-09T04:38:15.621042+0000","last_unstale":"2023-06-09T04:38:16.559520+0000","last_undegraded":"2023-06-09T04:38:16.559520+0000","last_fullsized":"2023-06-09T04:38:16.559520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:14.563604+0000","last_clean_scrub_stamp":"2023-06-09T04:38:14.563604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:05:03.071443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066570+0000","last_change":"2023-06-09T04:38:11.594280+0000","last_active":"2023-06-09T04:38:16.066570+0000","last_peered":"2023-06-09T04:38:16.066570+0000","last_clean":"2023-06-09T04:38:16.066570+0000","last_became_active":"2023-06-09T04:38:11.593913+0000","last_became_peered":"2023-06-09T04:38:11.593913+0000","last_unstale":"2023-06-09T04:38:16.066570+0000","last_undegraded":"2023-06-09T04:38:16.066570+0000","last_fullsized":"2023-06-09T04:38:16.066570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:00:04.790292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982855+0000","last_change":"2023-06-09T04:38:11.581417+0000","last_active":"2023-06-09T04:38:15.982855+0000","last_peered":"2023-06-09T04:38:15.982855+0000","last_clean":"2023-06-09T04:38:15.982855+0000","last_became_active":"2023-06-09T04:38:11.580835+0000","last_became_peered":"2023-06-09T04:38:11.580835+0000","last_unstale":"2023-06-09T04:38:15.982855+0000","last_undegraded":"2023-06-09T04:38:15.982855+0000","last_fullsized":"2023-06-09T04:38:15.982855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:42:33.116603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115907+0000","last_change":"2023-06-09T04:38:11.605024+0000","last_active":"2023-06-09T04:38:16.115907+0000","last_peered":"2023-06-09T04:38:16.115907+0000","last_clean":"2023-06-09T04:38:16.115907+0000","last_became_active":"2023-06-09T04:38:11.604711+0000","last_became_peered":"2023-06-09T04:38:11.604711+0000","last_unstale":"2023-06-09T04:38:16.115907+0000","last_undegraded":"2023-06-09T04:38:16.115907+0000","last_fullsized":"2023-06-09T04:38:16.115907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:05.142990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560506+0000","last_change":"2023-06-09T04:38:11.575886+0000","last_active":"2023-06-09T04:38:16.560506+0000","last_peered":"2023-06-09T04:38:16.560506+0000","last_clean":"2023-06-09T04:38:16.560506+0000","last_became_active":"2023-06-09T04:38:11.575594+0000","last_became_peered":"2023-06-09T04:38:11.575594+0000","last_unstale":"2023-06-09T04:38:16.560506+0000","last_undegraded":"2023-06-09T04:38:16.560506+0000","last_fullsized":"2023-06-09T04:38:16.560506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:51.547429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560644+0000","last_change":"2023-06-09T04:38:11.573026+0000","last_active":"2023-06-09T04:38:16.560644+0000","last_peered":"2023-06-09T04:38:16.560644+0000","last_clean":"2023-06-09T04:38:16.560644+0000","last_became_active":"2023-06-09T04:38:11.572744+0000","last_became_peered":"2023-06-09T04:38:11.572744+0000","last_unstale":"2023-06-09T04:38:16.560644+0000","last_undegraded":"2023-06-09T04:38:16.560644+0000","last_fullsized":"2023-06-09T04:38:16.560644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:04:38.824518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560873+0000","last_change":"2023-06-09T04:38:11.597829+0000","last_active":"2023-06-09T04:38:16.560873+0000","last_peered":"2023-06-09T04:38:16.560873+0000","last_clean":"2023-06-09T04:38:16.560873+0000","last_became_active":"2023-06-09T04:38:11.590175+0000","last_became_peered":"2023-06-09T04:38:11.590175+0000","last_unstale":"2023-06-09T04:38:16.560873+0000","last_undegraded":"2023-06-09T04:38:16.560873+0000","last_fullsized":"2023-06-09T04:38:16.560873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:31:10.046575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559401+0000","last_change":"2023-06-09T04:38:11.598947+0000","last_active":"2023-06-09T04:38:16.559401+0000","last_peered":"2023-06-09T04:38:16.559401+0000","last_clean":"2023-06-09T04:38:16.559401+0000","last_became_active":"2023-06-09T04:38:11.598503+0000","last_became_peered":"2023-06-09T04:38:11.598503+0000","last_unstale":"2023-06-09T04:38:16.559401+0000","last_undegraded":"2023-06-09T04:38:16.559401+0000","last_fullsized":"2023-06-09T04:38:16.559401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:44.845221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985260+0000","last_change":"2023-06-09T04:38:11.594511+0000","last_active":"2023-06-09T04:38:15.985260+0000","last_peered":"2023-06-09T04:38:15.985260+0000","last_clean":"2023-06-09T04:38:15.985260+0000","last_became_active":"2023-06-09T04:38:11.592278+0000","last_became_peered":"2023-06-09T04:38:11.592278+0000","last_unstale":"2023-06-09T04:38:15.985260+0000","last_undegraded":"2023-06-09T04:38:15.985260+0000","last_fullsized":"2023-06-09T04:38:15.985260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:36:26.790998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065900+0000","last_change":"2023-06-09T04:38:11.581970+0000","last_active":"2023-06-09T04:38:16.065900+0000","last_peered":"2023-06-09T04:38:16.065900+0000","last_clean":"2023-06-09T04:38:16.065900+0000","last_became_active":"2023-06-09T04:38:11.581665+0000","last_became_peered":"2023-06-09T04:38:11.581665+0000","last_unstale":"2023-06-09T04:38:16.065900+0000","last_undegraded":"2023-06-09T04:38:16.065900+0000","last_fullsized":"2023-06-09T04:38:16.065900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:46.131805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.986039+0000","last_change":"2023-06-09T04:38:11.594155+0000","last_active":"2023-06-09T04:38:15.986039+0000","last_peered":"2023-06-09T04:38:15.986039+0000","last_clean":"2023-06-09T04:38:15.986039+0000","last_became_active":"2023-06-09T04:38:11.592402+0000","last_became_peered":"2023-06-09T04:38:11.592402+0000","last_unstale":"2023-06-09T04:38:15.986039+0000","last_undegraded":"2023-06-09T04:38:15.986039+0000","last_fullsized":"2023-06-09T04:38:15.986039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:48:03.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559449+0000","last_change":"2023-06-09T04:38:11.598820+0000","last_active":"2023-06-09T04:38:16.559449+0000","last_peered":"2023-06-09T04:38:16.559449+0000","last_clean":"2023-06-09T04:38:16.559449+0000","last_became_active":"2023-06-09T04:38:11.598538+0000","last_became_peered":"2023-06-09T04:38:11.598538+0000","last_unstale":"2023-06-09T04:38:16.559449+0000","last_undegraded":"2023-06-09T04:38:16.559449+0000","last_fullsized":"2023-06-09T04:38:16.559449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:32.642381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066228+0000","last_change":"2023-06-09T04:38:11.581487+0000","last_active":"2023-06-09T04:38:16.066228+0000","last_peered":"2023-06-09T04:38:16.066228+0000","last_clean":"2023-06-09T04:38:16.066228+0000","last_became_active":"2023-06-09T04:38:11.580791+0000","last_became_peered":"2023-06-09T04:38:11.580791+0000","last_unstale":"2023-06-09T04:38:16.066228+0000","last_undegraded":"2023-06-09T04:38:16.066228+0000","last_fullsized":"2023-06-09T04:38:16.066228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:51.608806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066270+0000","last_change":"2023-06-09T04:38:11.596924+0000","last_active":"2023-06-09T04:38:16.066270+0000","last_peered":"2023-06-09T04:38:16.066270+0000","last_clean":"2023-06-09T04:38:16.066270+0000","last_became_active":"2023-06-09T04:38:11.596514+0000","last_became_peered":"2023-06-09T04:38:11.596514+0000","last_unstale":"2023-06-09T04:38:16.066270+0000","last_undegraded":"2023-06-09T04:38:16.066270+0000","last_fullsized":"2023-06-09T04:38:16.066270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:02:15.244503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561345+0000","last_change":"2023-06-09T04:38:11.591842+0000","last_active":"2023-06-09T04:38:16.561345+0000","last_peered":"2023-06-09T04:38:16.561345+0000","last_clean":"2023-06-09T04:38:16.561345+0000","last_became_active":"2023-06-09T04:38:11.591348+0000","last_became_peered":"2023-06-09T04:38:11.591348+0000","last_unstale":"2023-06-09T04:38:16.561345+0000","last_undegraded":"2023-06-09T04:38:16.561345+0000","last_fullsized":"2023-06-09T04:38:16.561345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:11.837579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116228+0000","last_change":"2023-06-09T04:38:11.581598+0000","last_active":"2023-06-09T04:38:16.116228+0000","last_peered":"2023-06-09T04:38:16.116228+0000","last_clean":"2023-06-09T04:38:16.116228+0000","last_became_active":"2023-06-09T04:38:11.581079+0000","last_became_peered":"2023-06-09T04:38:11.581079+0000","last_unstale":"2023-06-09T04:38:16.116228+0000","last_undegraded":"2023-06-09T04:38:16.116228+0000","last_fullsized":"2023-06-09T04:38:16.116228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:26.025903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559059+0000","last_change":"2023-06-09T04:38:11.588434+0000","last_active":"2023-06-09T04:38:16.559059+0000","last_peered":"2023-06-09T04:38:16.559059+0000","last_clean":"2023-06-09T04:38:16.559059+0000","last_became_active":"2023-06-09T04:38:11.586783+0000","last_became_peered":"2023-06-09T04:38:11.586783+0000","last_unstale":"2023-06-09T04:38:16.559059+0000","last_undegraded":"2023-06-09T04:38:16.559059+0000","last_fullsized":"2023-06-09T04:38:16.559059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:30:39.956547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559051+0000","last_change":"2023-06-09T04:38:11.589256+0000","last_active":"2023-06-09T04:38:16.559051+0000","last_peered":"2023-06-09T04:38:16.559051+0000","last_clean":"2023-06-09T04:38:16.559051+0000","last_became_active":"2023-06-09T04:38:11.585253+0000","last_became_peered":"2023-06-09T04:38:11.585253+0000","last_unstale":"2023-06-09T04:38:16.559051+0000","last_undegraded":"2023-06-09T04:38:16.559051+0000","last_fullsized":"2023-06-09T04:38:16.559051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:20.593479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.115686+0000","last_change":"2023-06-09T04:38:11.595137+0000","last_active":"2023-06-09T04:38:16.115686+0000","last_peered":"2023-06-09T04:38:16.115686+0000","last_clean":"2023-06-09T04:38:16.115686+0000","last_became_active":"2023-06-09T04:38:11.594879+0000","last_became_peered":"2023-06-09T04:38:11.594879+0000","last_unstale":"2023-06-09T04:38:16.115686+0000","last_undegraded":"2023-06-09T04:38:16.115686+0000","last_fullsized":"2023-06-09T04:38:16.115686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:29.708676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066144+0000","last_change":"2023-06-09T04:38:11.580088+0000","last_active":"2023-06-09T04:38:16.066144+0000","last_peered":"2023-06-09T04:38:16.066144+0000","last_clean":"2023-06-09T04:38:16.066144+0000","last_became_active":"2023-06-09T04:38:11.579839+0000","last_became_peered":"2023-06-09T04:38:11.579839+0000","last_unstale":"2023-06-09T04:38:16.066144+0000","last_undegraded":"2023-06-09T04:38:16.066144+0000","last_fullsized":"2023-06-09T04:38:16.066144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:16:49.952306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.985563+0000","last_change":"2023-06-09T04:38:11.584533+0000","last_active":"2023-06-09T04:38:15.985563+0000","last_peered":"2023-06-09T04:38:15.985563+0000","last_clean":"2023-06-09T04:38:15.985563+0000","last_became_active":"2023-06-09T04:38:11.583229+0000","last_became_peered":"2023-06-09T04:38:11.583229+0000","last_unstale":"2023-06-09T04:38:15.985563+0000","last_undegraded":"2023-06-09T04:38:15.985563+0000","last_fullsized":"2023-06-09T04:38:15.985563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:30.926935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.560605+0000","last_change":"2023-06-09T04:38:11.590402+0000","last_active":"2023-06-09T04:38:16.560605+0000","last_peered":"2023-06-09T04:38:16.560605+0000","last_clean":"2023-06-09T04:38:16.560605+0000","last_became_active":"2023-06-09T04:38:11.590128+0000","last_became_peered":"2023-06-09T04:38:11.590128+0000","last_unstale":"2023-06-09T04:38:16.560605+0000","last_undegraded":"2023-06-09T04:38:16.560605+0000","last_fullsized":"2023-06-09T04:38:16.560605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:31.691341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066715+0000","last_change":"2023-06-09T04:38:11.575532+0000","last_active":"2023-06-09T04:38:16.066715+0000","last_peered":"2023-06-09T04:38:16.066715+0000","last_clean":"2023-06-09T04:38:16.066715+0000","last_became_active":"2023-06-09T04:38:11.574743+0000","last_became_peered":"2023-06-09T04:38:11.574743+0000","last_unstale":"2023-06-09T04:38:16.066715+0000","last_undegraded":"2023-06-09T04:38:16.066715+0000","last_fullsized":"2023-06-09T04:38:16.066715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:27:44.893546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.066132+0000","last_change":"2023-06-09T04:38:11.587445+0000","last_active":"2023-06-09T04:38:16.066132+0000","last_peered":"2023-06-09T04:38:16.066132+0000","last_clean":"2023-06-09T04:38:16.066132+0000","last_became_active":"2023-06-09T04:38:11.587078+0000","last_became_peered":"2023-06-09T04:38:11.587078+0000","last_unstale":"2023-06-09T04:38:16.066132+0000","last_undegraded":"2023-06-09T04:38:16.066132+0000","last_fullsized":"2023-06-09T04:38:16.066132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:14:57.955916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984537+0000","last_change":"2023-06-09T04:38:11.594397+0000","last_active":"2023-06-09T04:38:15.984537+0000","last_peered":"2023-06-09T04:38:15.984537+0000","last_clean":"2023-06-09T04:38:15.984537+0000","last_became_active":"2023-06-09T04:38:11.592636+0000","last_became_peered":"2023-06-09T04:38:11.592636+0000","last_unstale":"2023-06-09T04:38:15.984537+0000","last_undegraded":"2023-06-09T04:38:15.984537+0000","last_fullsized":"2023-06-09T04:38:15.984537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:00:19.960889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.065734+0000","last_change":"2023-06-09T04:38:11.572712+0000","last_active":"2023-06-09T04:38:16.065734+0000","last_peered":"2023-06-09T04:38:16.065734+0000","last_clean":"2023-06-09T04:38:16.065734+0000","last_became_active":"2023-06-09T04:38:11.571728+0000","last_became_peered":"2023-06-09T04:38:11.571728+0000","last_unstale":"2023-06-09T04:38:16.065734+0000","last_undegraded":"2023-06-09T04:38:16.065734+0000","last_fullsized":"2023-06-09T04:38:16.065734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559434+0000","last_change":"2023-06-09T04:38:11.590174+0000","last_active":"2023-06-09T04:38:16.559434+0000","last_peered":"2023-06-09T04:38:16.559434+0000","last_clean":"2023-06-09T04:38:16.559434+0000","last_became_active":"2023-06-09T04:38:11.589797+0000","last_became_peered":"2023-06-09T04:38:11.589797+0000","last_unstale":"2023-06-09T04:38:16.559434+0000","last_undegraded":"2023-06-09T04:38:16.559434+0000","last_fullsized":"2023-06-09T04:38:16.559434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:50.267811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.559697+0000","last_change":"2023-06-09T04:38:11.597890+0000","last_active":"2023-06-09T04:38:16.559697+0000","last_peered":"2023-06-09T04:38:16.559697+0000","last_clean":"2023-06-09T04:38:16.559697+0000","last_became_active":"2023-06-09T04:38:11.590403+0000","last_became_peered":"2023-06-09T04:38:11.590403+0000","last_unstale":"2023-06-09T04:38:16.559697+0000","last_undegraded":"2023-06-09T04:38:16.559697+0000","last_fullsized":"2023-06-09T04:38:16.559697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:31:47.357977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.984691+0000","last_change":"2023-06-09T04:38:11.590981+0000","last_active":"2023-06-09T04:38:15.984691+0000","last_peered":"2023-06-09T04:38:15.984691+0000","last_clean":"2023-06-09T04:38:15.984691+0000","last_became_active":"2023-06-09T04:38:11.590680+0000","last_became_peered":"2023-06-09T04:38:11.590680+0000","last_unstale":"2023-06-09T04:38:15.984691+0000","last_undegraded":"2023-06-09T04:38:15.984691+0000","last_fullsized":"2023-06-09T04:38:15.984691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:34.676457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116447+0000","last_change":"2023-06-09T04:38:11.581610+0000","last_active":"2023-06-09T04:38:16.116447+0000","last_peered":"2023-06-09T04:38:16.116447+0000","last_clean":"2023-06-09T04:38:16.116447+0000","last_became_active":"2023-06-09T04:38:11.580238+0000","last_became_peered":"2023-06-09T04:38:11.580238+0000","last_unstale":"2023-06-09T04:38:16.116447+0000","last_undegraded":"2023-06-09T04:38:16.116447+0000","last_fullsized":"2023-06-09T04:38:16.116447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:58.405251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.116281+0000","last_change":"2023-06-09T04:38:11.579502+0000","last_active":"2023-06-09T04:38:16.116281+0000","last_peered":"2023-06-09T04:38:16.116281+0000","last_clean":"2023-06-09T04:38:16.116281+0000","last_became_active":"2023-06-09T04:38:11.579076+0000","last_became_peered":"2023-06-09T04:38:11.579076+0000","last_unstale":"2023-06-09T04:38:16.116281+0000","last_undegraded":"2023-06-09T04:38:16.116281+0000","last_fullsized":"2023-06-09T04:38:16.116281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:18.591508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.982195+0000","last_change":"2023-06-09T04:38:11.595714+0000","last_active":"2023-06-09T04:38:15.982195+0000","last_peered":"2023-06-09T04:38:15.982195+0000","last_clean":"2023-06-09T04:38:15.982195+0000","last_became_active":"2023-06-09T04:38:11.595346+0000","last_became_peered":"2023-06-09T04:38:11.595346+0000","last_unstale":"2023-06-09T04:38:15.982195+0000","last_undegraded":"2023-06-09T04:38:15.982195+0000","last_fullsized":"2023-06-09T04:38:15.982195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:05:53.093306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:38:16.561947+0000","last_change":"2023-06-09T04:38:11.584489+0000","last_active":"2023-06-09T04:38:16.561947+0000","last_peered":"2023-06-09T04:38:16.561947+0000","last_clean":"2023-06-09T04:38:16.561947+0000","last_became_active":"2023-06-09T04:38:11.584214+0000","last_became_peered":"2023-06-09T04:38:11.584214+0000","last_unstale":"2023-06-09T04:38:16.561947+0000","last_undegraded":"2023-06-09T04:38:16.561947+0000","last_fullsized":"2023-06-09T04:38:16.561947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:11.138594+0000","last_clean_scrub_stamp":"2023-06-09T04:38:11.138594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:06:31.786585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":315392,"data_stored":125663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":901120,"data_stored":712808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":121912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":121856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":712716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":121766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":307200,"data_stored":125559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:39.722 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T04:38:39.722 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-09T04:38:39.722 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-09T04:38:39.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-09T04:38:39.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f099ec2e640 1 Processor -- start 2023-06-09T04:38:39.874 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f099ec2e640 1 -- start start 2023-06-09T04:38:39.875 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f099ec2e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 0x7f09980cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.875 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f099ec2e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980cc4e0 con 0x7f099815cfe0 2023-06-09T04:38:39.875 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f099ec2e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980cc200 con 0x7f099815db00 2023-06-09T04:38:39.875 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f099ec2e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099806ece0 con 0x7f09980b5370 2023-06-09T04:38:39.875 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f0997fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f099815cfe0 0x7f099815d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43648/0 (socket says 172.21.15.18:43648) 2023-06-09T04:38:39.875 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.870+0000 7f0997fff640 1 -- 172.21.15.18:0/2584264201 learned_addr learned my addr 172.21.15.18:0/2584264201 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:39.877 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 0x7f09980cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.877 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226499438 0 0) 0x7f09980cc4e0 con 0x7f099815cfe0 2023-06-09T04:38:39.877 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0980003530 con 0x7f099815cfe0 2023-06-09T04:38:39.877 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202389095 0 0) 0x7f0980003530 con 0x7f099815cfe0 2023-06-09T04:38:39.877 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 msgr2=0x7f09980cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 0x7f09980cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 >> v1:172.21.15.81:6789/0 conn(0x7f099815db00 legacy=0x7f09980cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980ca430 con 0x7f099815cfe0 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f098c001680 con 0x7f099815cfe0 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 >> v1:172.21.15.18:6789/0 conn(0x7f099815cfe0 legacy=0x7f099815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f0980003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09800047d0 0x7f0980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 0x7f0980005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099806ece0 con 0x7f0980003a20 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098000bb20 con 0x7f09800047d0 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098000bce0 con 0x7f09980b5370 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f0980003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f0997fff640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09800047d0 0x7f0980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 -- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 msgr2=0x7f0980005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980b5370 0x7f0980005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.880 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 -- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09800047d0 msgr2=0x7f0980004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:39.880 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09800047d0 0x7f0980004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.880 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 -- 172.21.15.18:0/2584264201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980003530 con 0x7f0980003a20 2023-06-09T04:38:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099c9ca640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f0980003e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0988009ae0 tx=0x7f098801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465f4c461b952d04 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880a5650 con 0x7f0980003a20 2023-06-09T04:38:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09880a57b0 con 0x7f0980003a20 2023-06-09T04:38:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f09977fe640 1 -- 172.21.15.18:0/2584264201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880a5b60 con 0x7f0980003a20 2023-06-09T04:38:39.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099ec2e640 1 -- 172.21.15.18:0/2584264201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 msgr2=0x7f0980003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099ec2e640 1 --2- 172.21.15.18:0/2584264201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f0980003e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0988009ae0 tx=0x7f098801ca60 comp rx=0 tx=0).stop 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099d1cb640 1 -- 172.21.15.18:0/2584264201 reap_dead start 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099ec2e640 1 -- 172.21.15.18:0/2584264201 shutdown_connections 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099ec2e640 1 -- 172.21.15.18:0/2584264201 >> 172.21.15.18:0/2584264201 conn(0x7f099806f970 msgr2=0x7f099806fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099ec2e640 1 -- 172.21.15.18:0/2584264201 shutdown_connections 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.874+0000 7f099ec2e640 1 -- 172.21.15.18:0/2584264201 wait complete. 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 Processor -- start 2023-06-09T04:38:39.883 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- start start 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f09980c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980c3ca0 0x7f099806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09980c4180 0x7f09980c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c66b0 con 0x7f0980003a20 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c4b30 con 0x7f09980c4180 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980c63d0 con 0x7f09980c3ca0 2023-06-09T04:38:39.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f09980c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f09980c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38466/0 (socket says 172.21.15.18:38466) 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 -- 172.21.15.18:0/1407075522 learned_addr learned my addr 172.21.15.18:0/1407075522 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f0997fff640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980c3ca0 0x7f099806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099d1cb640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09980c4180 0x7f09980c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 -- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980c3ca0 msgr2=0x7f099806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980c3ca0 0x7f099806c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 -- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09980c4180 msgr2=0x7f09980c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:39.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09980c4180 0x7f09980c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 -- 172.21.15.18:0/1407075522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09981e5c30 con 0x7f0980003a20 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099d1cb640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09980c4180 0x7f09980c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099c9ca640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f09980c2ac0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f09880b0040 tx=0x7f0980005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880be070 con 0x7f0980003a20 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09981e5f10 con 0x7f0980003a20 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800f000 con 0x7f0980003a20 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880a5650 con 0x7f0980003a20 2023-06-09T04:38:39.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09981e6710 con 0x7f0980003a20 2023-06-09T04:38:39.887 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09981e5a90 con 0x7f0980003a20 2023-06-09T04:38:39.887 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.878+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09880b4040 con 0x7f0980003a20 2023-06-09T04:38:39.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.882+0000 7f09957fa640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0984066280 0x7f0984068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:39.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.882+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f098811d910 con 0x7f0980003a20 2023-06-09T04:38:39.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.882+0000 7f0997fff640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0984066280 0x7f0984068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:39.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.882+0000 7f0997fff640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0984066280 0x7f0984068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09980af5b0 tx=0x7f098c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:39.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:39.886+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09981e5a90 con 0x7f0980003a20 2023-06-09T04:38:40.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.062+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f09981e5a90 con 0x7f0980003a20 2023-06-09T04:38:40.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.062+0000 7f09957fa640 1 -- 172.21.15.18:0/1407075522 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f09981e5a90 con 0x7f0980003a20 2023-06-09T04:38:40.067 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:40.067 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-09T04:38:40.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0984066280 msgr2=0x7f0984068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0984066280 0x7f0984068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09980af5b0 tx=0x7f098c007040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 msgr2=0x7f09980c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f09980c2ac0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f09880b0040 tx=0x7f0980005800 comp rx=0 tx=0).stop 2023-06-09T04:38:40.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 shutdown_connections 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09980c4180 0x7f09980c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0984066280 0x7f0984068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f09980c3ca0 0x7f099806c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 --2- 172.21.15.18:0/1407075522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0980003a20 0x7f09980c2ac0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 >> 172.21.15.18:0/1407075522 conn(0x7f099806f970 msgr2=0x7f09980aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 shutdown_connections 2023-06-09T04:38:40.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.066+0000 7f099ec2e640 1 -- 172.21.15.18:0/1407075522 wait complete. 2023-06-09T04:38:40.084 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-09T04:38:40.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.202+0000 7f7308499640 1 Processor -- start 2023-06-09T04:38:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.202+0000 7f7308499640 1 -- start start 2023-06-09T04:38:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7300069440 0x7f7300069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73000ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73000c8ab0 0x7f7300159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7300159b50 con 0x7f73000c8ab0 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730015d4d0 con 0x7f7300069440 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730015d7b0 con 0x7f730015cfa0 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73000c8ab0 0x7f7300159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73000c8ab0 0x7f7300159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38482/0 (socket says 172.21.15.18:38482) 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 -- 172.21.15.18:0/46080968 learned_addr learned my addr 172.21.15.18:0/46080968 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7305a34640 1 --2- 172.21.15.18:0/46080968 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73000ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306235640 1 --2- 172.21.15.18:0/46080968 >> v2:172.21.15.81:3300/0 conn(0x7f7300069440 0x7f7300069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 -- 172.21.15.18:0/46080968 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 msgr2=0x7f73000ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 --2- 172.21.15.18:0/46080968 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73000ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 -- 172.21.15.18:0/46080968 >> v2:172.21.15.81:3300/0 conn(0x7f7300069440 msgr2=0x7f7300069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 --2- 172.21.15.18:0/46080968 >> v2:172.21.15.81:3300/0 conn(0x7f7300069440 0x7f7300069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 -- 172.21.15.18:0/46080968 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730015da90 con 0x7f73000c8ab0 2023-06-09T04:38:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306235640 1 --2- 172.21.15.18:0/46080968 >> v2:172.21.15.81:3300/0 conn(0x7f7300069440 0x7f7300069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7306a36640 1 --2- 172.21.15.18:0/46080968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f7300159fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009e50 tx=0x7f72f801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d6dbcd3a971cdc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7305233640 1 -- 172.21.15.18:0/46080968 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80a5690 con 0x7f73000c8ab0 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7305233640 1 -- 172.21.15.18:0/46080968 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f80a57f0 con 0x7f73000c8ab0 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7305233640 1 -- 172.21.15.18:0/46080968 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80a5b80 con 0x7f73000c8ab0 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.206+0000 7f7308499640 1 -- 172.21.15.18:0/46080968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 msgr2=0x7f7300159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- 172.21.15.18:0/46080968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f7300159fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009e50 tx=0x7f72f801c8b0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/46080968 shutdown_connections 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- 172.21.15.18:0/46080968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f7300159fe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- 172.21.15.18:0/46080968 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73000ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- 172.21.15.18:0/46080968 >> v2:172.21.15.81:3300/0 conn(0x7f7300069440 0x7f7300069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/46080968 >> 172.21.15.18:0/46080968 conn(0x7f73000cb960 msgr2=0x7f73000ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/46080968 shutdown_connections 2023-06-09T04:38:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/46080968 wait complete. 2023-06-09T04:38:40.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 Processor -- start 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- start start 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7300069440 0x7f730013f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f730014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73001509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300157540 con 0x7f73000c8ab0 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730013faa0 con 0x7f7300069440 2023-06-09T04:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730014fc40 con 0x7f730015cfa0 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f730014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f730014f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38494/0 (socket says 172.21.15.18:38494) 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 -- 172.21.15.18:0/1921294373 learned_addr learned my addr 172.21.15.18:0/1921294373 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7306235640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7300069440 0x7f730013f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7306a36640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73001509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 -- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 msgr2=0x7f73001509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73001509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 -- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7300069440 msgr2=0x7f730013f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7300069440 0x7f730013f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 -- 172.21.15.18:0/1921294373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009b30 con 0x7f73000c8ab0 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7305a34640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f730014f260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c7f0 tx=0x7f72fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0077c0 con 0x7f73000c8ab0 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc007920 con 0x7f73000c8ab0 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730014ff20 con 0x7f73000c8ab0 2023-06-09T04:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc007cd0 con 0x7f73000c8ab0 2023-06-09T04:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73001504e0 con 0x7f73000c8ab0 2023-06-09T04:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.210+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73001576b0 con 0x7f73000c8ab0 2023-06-09T04:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.214+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72fc024480 con 0x7f73000c8ab0 2023-06-09T04:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.214+0000 7f72f6ffd640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72e4066280 0x7f72e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.214+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f72fc0844f0 con 0x7f73000c8ab0 2023-06-09T04:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.214+0000 7f7306235640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72e4066280 0x7f72e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.214+0000 7f7306235640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72e4066280 0x7f72e4068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f72f000a9a0 tx=0x7f72f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.218+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72fc0516f0 con 0x7f73000c8ab0 2023-06-09T04:38:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.370+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7300157680 con 0x7f73000c8ab0 2023-06-09T04:38:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f72f6ffd640 1 -- 172.21.15.18:0/1921294373 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f72fc054d10 con 0x7f73000c8ab0 2023-06-09T04:38:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:40.377 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72e4066280 msgr2=0x7f72e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72e4066280 0x7f72e4068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f72f000a9a0 tx=0x7f72f0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 msgr2=0x7f730014f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f730014f260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00c7f0 tx=0x7f72fc00ccb0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 shutdown_connections 2023-06-09T04:38:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f72e4066280 0x7f72e4068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f730015cfa0 0x7f73001509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73000c8ab0 0x7f730014f260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 --2- 172.21.15.18:0/1921294373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7300069440 0x7f730013f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 >> 172.21.15.18:0/1921294373 conn(0x7f73000cb960 msgr2=0x7f7300069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 shutdown_connections 2023-06-09T04:38:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.374+0000 7f7308499640 1 -- 172.21.15.18:0/1921294373 wait complete. 2023-06-09T04:38:40.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:38:40.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd3bbf640 1 Processor -- start 2023-06-09T04:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd3bbf640 1 -- start start 2023-06-09T04:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd3bbf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 0x7f1bcc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd3bbf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc0ca590 con 0x7f1bcc0cba70 2023-06-09T04:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd3bbf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc0cbef0 con 0x7f1bcc15b730 2023-06-09T04:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd3bbf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15f2f0 con 0x7f1bcc0cc8b0 2023-06-09T04:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd215c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1bcc0cba70 0x7f1bcc0cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43654/0 (socket says 172.21.15.18:43654) 2023-06-09T04:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd215c640 1 -- 172.21.15.18:0/4035898111 learned_addr learned my addr 172.21.15.18:0/4035898111 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd115a640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 0x7f1bcc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627657593 0 0) 0x7f1bcc0ca590 con 0x7f1bcc0cba70 2023-06-09T04:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb8003530 con 0x7f1bcc0cba70 2023-06-09T04:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529056661 0 0) 0x7f1bb8003530 con 0x7f1bcc0cba70 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 msgr2=0x7f1bcc0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 0x7f1bcc0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 >> v1:172.21.15.81:6789/0 conn(0x7f1bcc15b730 legacy=0x7f1bcc0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc15f5d0 con 0x7f1bcc0cba70 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f1bc8001680 con 0x7f1bcc0cba70 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 >> v1:172.21.15.18:6789/0 conn(0x7f1bcc0cba70 legacy=0x7f1bcc0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 0x7f1bb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15f2f0 con 0x7f1bb8004d10 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb800ba40 con 0x7f1bb80039b0 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb800bc00 con 0x7f1bcc0cc8b0 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.518+0000 7f1bd215c640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd195b640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd115a640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 0x7f1bb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 -- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 msgr2=0x7f1bb80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0cc8b0 0x7f1bb80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 -- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb80039b0 msgr2=0x7f1bb8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 -- 172.21.15.18:0/4035898111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8003530 con 0x7f1bb8004d10 2023-06-09T04:38:40.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bb8005180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c240 tx=0x7f1bc801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9927151345177ac7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80a5b40 con 0x7f1bb8004d10 2023-06-09T04:38:40.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80a5ca0 con 0x7f1bb8004d10 2023-06-09T04:38:40.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd0959640 1 -- 172.21.15.18:0/4035898111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8005b20 con 0x7f1bb8004d10 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/4035898111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 msgr2=0x7f1bb8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/4035898111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bb8005180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c240 tx=0x7f1bc801cc40 comp rx=0 tx=0).stop 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd215c640 1 -- 172.21.15.18:0/4035898111 reap_dead start 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/4035898111 shutdown_connections 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/4035898111 >> 172.21.15.18:0/4035898111 conn(0x7f1bcc06cdd0 msgr2=0x7f1bcc06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/4035898111 shutdown_connections 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.522+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/4035898111 wait complete. 2023-06-09T04:38:40.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 Processor -- start 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- start start 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bcc1f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0c3c50 0x7f1bcc152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc0c43d0 0x7f1bcc0c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1f51d0 con 0x7f1bb8004d10 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0c4d80 con 0x7f1bcc0c43d0 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc152f60 con 0x7f1bcc0c3c50 2023-06-09T04:38:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bcc1f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bcc1f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38508/0 (socket says 172.21.15.18:38508) 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 -- 172.21.15.18:0/1043805242 learned_addr learned my addr 172.21.15.18:0/1043805242 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd115a640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0c3c50 0x7f1bcc152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 -- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0c3c50 msgr2=0x7f1bcc152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0c3c50 0x7f1bcc152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 -- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc0c43d0 msgr2=0x7f1bcc0c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc0c43d0 0x7f1bcc0c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 -- 172.21.15.18:0/1043805242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0c40a0 con 0x7f1bb8004d10 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd195b640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bcc1f4230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400e8f0 tx=0x7f1bc400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4003b90 con 0x7f1bb8004d10 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4003cf0 con 0x7f1bb8004d10 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc1f4930 con 0x7f1bb8004d10 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40052f0 con 0x7f1bb8004d10 2023-06-09T04:38:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc1f4ef0 con 0x7f1bb8004d10 2023-06-09T04:38:40.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc0c5a40 con 0x7f1bb8004d10 2023-06-09T04:38:40.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bc4005450 con 0x7f1bb8004d10 2023-06-09T04:38:40.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bc27fc640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1bb00662b0 0x7f1bb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1bc4084080 con 0x7f1bb8004d10 2023-06-09T04:38:40.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.526+0000 7f1bd115a640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1bb00662b0 0x7f1bb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.530+0000 7f1bd115a640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1bb00662b0 0x7f1bb0068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0ce6f0 tx=0x7f1bbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.530+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bc40512a0 con 0x7f1bb8004d10 2023-06-09T04:38:40.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.678+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bcc0b4b80 con 0x7f1bb8004d10 2023-06-09T04:38:40.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.678+0000 7f1bc27fc640 1 -- 172.21.15.18:0/1043805242 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bc4003e60 con 0x7f1bb8004d10 2023-06-09T04:38:40.683 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:40.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1bb00662b0 msgr2=0x7f1bb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1bb00662b0 0x7f1bb0068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0ce6f0 tx=0x7f1bbc008040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 msgr2=0x7f1bcc1f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bcc1f4230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400e8f0 tx=0x7f1bc400edb0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 shutdown_connections 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bcc0c43d0 0x7f1bcc0c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1bb00662b0 0x7f1bb0068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1bcc0c3c50 0x7f1bcc152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 --2- 172.21.15.18:0/1043805242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bb8004d10 0x7f1bcc1f4230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 >> 172.21.15.18:0/1043805242 conn(0x7f1bcc06cdd0 msgr2=0x7f1bcc069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 shutdown_connections 2023-06-09T04:38:40.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.682+0000 7f1bd3bbf640 1 -- 172.21.15.18:0/1043805242 wait complete. 2023-06-09T04:38:40.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:40.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 Processor -- start 2023-06-09T04:38:40.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 -- start start 2023-06-09T04:38:40.828 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f89b01595b0 0x7f89b00b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f89b00ccb70 0x7f89b015d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0159980 con 0x7f89b00cf890 2023-06-09T04:38:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b00cbfc0 con 0x7f89b00ccb70 2023-06-09T04:38:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b643e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b00ce710 con 0x7f89b01595b0 2023-06-09T04:38:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b49db640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f89b00ccb70 0x7f89b015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.829 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89a7fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f89b00cf890 0x7f89b00cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43662/0 (socket says 172.21.15.18:43662) 2023-06-09T04:38:40.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b49db640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f89b00ccb70 0x7f89b015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38522/0 (socket says 172.21.15.18:38522) 2023-06-09T04:38:40.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89a7fff640 1 -- 172.21.15.18:0/832513849 learned_addr learned my addr 172.21.15.18:0/832513849 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:40.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89affff640 1 --2- 172.21.15.18:0/832513849 >> v2:172.21.15.81:3300/0 conn(0x7f89b01595b0 0x7f89b00b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b49db640 1 -- 172.21.15.18:0/832513849 >> v2:172.21.15.81:3300/0 conn(0x7f89b01595b0 msgr2=0x7f89b00b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:40.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b49db640 1 --2- 172.21.15.18:0/832513849 >> v2:172.21.15.81:3300/0 conn(0x7f89b01595b0 0x7f89b00b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b49db640 1 -- 172.21.15.18:0/832513849 >> v1:172.21.15.18:6789/0 conn(0x7f89b00cf890 legacy=0x7f89b00cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.826+0000 7f89b49db640 1 -- 172.21.15.18:0/832513849 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00cabb0 con 0x7f89b00ccb70 2023-06-09T04:38:40.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b49db640 1 --2- 172.21.15.18:0/832513849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b015d030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89b006db50 tx=0x7f89a801c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00cada64088d558 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89af7fe640 1 -- 172.21.15.18:0/832513849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a5800 con 0x7f89b00ccb70 2023-06-09T04:38:40.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89af7fe640 1 -- 172.21.15.18:0/832513849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80a5960 con 0x7f89b00ccb70 2023-06-09T04:38:40.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89af7fe640 1 -- 172.21.15.18:0/832513849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a5cf0 con 0x7f89b00ccb70 2023-06-09T04:38:40.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- 172.21.15.18:0/832513849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 msgr2=0x7f89b015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 --2- 172.21.15.18:0/832513849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b015d030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89b006db50 tx=0x7f89a801c7a0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- 172.21.15.18:0/832513849 shutdown_connections 2023-06-09T04:38:40.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 --2- 172.21.15.18:0/832513849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b015d030 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 --2- 172.21.15.18:0/832513849 >> v2:172.21.15.81:3300/0 conn(0x7f89b01595b0 0x7f89b00b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- 172.21.15.18:0/832513849 >> 172.21.15.18:0/832513849 conn(0x7f89b006ce60 msgr2=0x7f89b006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- 172.21.15.18:0/832513849 shutdown_connections 2023-06-09T04:38:40.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- 172.21.15.18:0/832513849 wait complete. 2023-06-09T04:38:40.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 Processor -- start 2023-06-09T04:38:40.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- start start 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89b00cf890 0x7f89b014ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b01595b0 0x7f89b00b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01efc00 con 0x7f89b00ccb70 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b014dc40 con 0x7f89b01595b0 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b643e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b014df20 con 0x7f89b00cf890 2023-06-09T04:38:40.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b014c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38530/0 (socket says 172.21.15.18:38530) 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 -- 172.21.15.18:0/1228017711 learned_addr learned my addr 172.21.15.18:0/1228017711 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89a7fff640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89b00cf890 0x7f89b014ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89b49db640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b01595b0 0x7f89b00b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 -- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89b00cf890 msgr2=0x7f89b014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89b00cf890 0x7f89b014ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 -- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b01595b0 msgr2=0x7f89b00b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b01595b0 0x7f89b00b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 -- 172.21.15.18:0/1228017711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009a70 con 0x7f89b00ccb70 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.830+0000 7f89affff640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b014c250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89a000d5f0 tx=0x7f89a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00125f0 con 0x7f89b00ccb70 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a0012750 con 0x7f89b00ccb70 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0012ae0 con 0x7f89b00ccb70 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b00ce9f0 con 0x7f89b00ccb70 2023-06-09T04:38:40.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b014e4e0 con 0x7f89b00ccb70 2023-06-09T04:38:40.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b0073380 con 0x7f89b00ccb70 2023-06-09T04:38:40.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89a0012c40 con 0x7f89b00ccb70 2023-06-09T04:38:40.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89ad7fa640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8990066280 0x7f8990068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:40.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89a00844d0 con 0x7f89b00ccb70 2023-06-09T04:38:40.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89a7fff640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8990066280 0x7f8990068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:40.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.834+0000 7f89a7fff640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8990066280 0x7f8990068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8998001ec0 tx=0x7f899800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:40.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.838+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89a00516d0 con 0x7f89b00ccb70 2023-06-09T04:38:40.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.990+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89b00ca840 con 0x7f89b00ccb70 2023-06-09T04:38:40.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.990+0000 7f89ad7fa640 1 -- 172.21.15.18:0/1228017711 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89a0007380 con 0x7f89b00ccb70 2023-06-09T04:38:40.995 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8990066280 msgr2=0x7f8990068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8990066280 0x7f8990068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8998001ec0 tx=0x7f899800b040 comp rx=0 tx=0).stop 2023-06-09T04:38:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 msgr2=0x7f89b014c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b014c250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89a000d5f0 tx=0x7f89a000dab0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 shutdown_connections 2023-06-09T04:38:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89b01595b0 0x7f89b00b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8990066280 0x7f8990068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f89b00cf890 0x7f89b014ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 --2- 172.21.15.18:0/1228017711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89b00ccb70 0x7f89b014c250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 >> 172.21.15.18:0/1228017711 conn(0x7f89b006ce60 msgr2=0x7f89b01542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 shutdown_connections 2023-06-09T04:38:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:40.994+0000 7f89b643e640 1 -- 172.21.15.18:0/1228017711 wait complete. 2023-06-09T04:38:41.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:41.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.138+0000 7ff942dbe640 1 Processor -- start 2023-06-09T04:38:41.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.138+0000 7ff942dbe640 1 -- start start 2023-06-09T04:38:41.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff942dbe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c15b7e0 0x7ff93c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff942dbe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff93c0cce90 0x7ff93c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff942dbe640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c15bbb0 con 0x7ff93c15f800 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff942dbe640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0ca3c0 con 0x7ff93c0cce90 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff942dbe640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c15fd80 con 0x7ff93c15b7e0 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff93c0cce90 0x7ff93c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff93c0cce90 0x7ff93c0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38544/0 (socket says 172.21.15.18:38544) 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 -- 172.21.15.18:0/3981051298 learned_addr learned my addr 172.21.15.18:0/3981051298 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff940b5a640 1 --2- 172.21.15.18:0/3981051298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c15b7e0 0x7ff93c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 -- 172.21.15.18:0/3981051298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c15b7e0 msgr2=0x7ff93c15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 --2- 172.21.15.18:0/3981051298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c15b7e0 0x7ff93c15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 -- 172.21.15.18:0/3981051298 >> v1:172.21.15.81:6789/0 conn(0x7ff93c15f800 legacy=0x7ff93c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 -- 172.21.15.18:0/3981051298 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c160060 con 0x7ff93c0cce90 2023-06-09T04:38:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff94135b640 1 --2- 172.21.15.18:0/3981051298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c0cce90 0x7ff93c0cadd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff934009870 tx=0x7ff93401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d2fc249a076064 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.142+0000 7ff93b7fe640 1 -- 172.21.15.18:0/3981051298 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340ab600 con 0x7ff93c0cce90 2023-06-09T04:38:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff93b7fe640 1 -- 172.21.15.18:0/3981051298 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9340ab760 con 0x7ff93c0cce90 2023-06-09T04:38:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff93b7fe640 1 -- 172.21.15.18:0/3981051298 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340abaf0 con 0x7ff93c0cce90 2023-06-09T04:38:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3981051298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c0cce90 msgr2=0x7ff93c0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3981051298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c0cce90 0x7ff93c0cadd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff934009870 tx=0x7ff93401c440 comp rx=0 tx=0).stop 2023-06-09T04:38:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3981051298 shutdown_connections 2023-06-09T04:38:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3981051298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c0cce90 0x7ff93c0cadd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3981051298 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c15b7e0 0x7ff93c15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3981051298 >> 172.21.15.18:0/3981051298 conn(0x7ff93c06ce60 msgr2=0x7ff93c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3981051298 shutdown_connections 2023-06-09T04:38:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3981051298 wait complete. 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 Processor -- start 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- start start 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c0cce90 0x7ff93c14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff93c15b7e0 0x7ff93c0b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 0x7ff93c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b4700 con 0x7ff93c15f800 2023-06-09T04:38:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0c7690 con 0x7ff93c15b7e0 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0c73b0 con 0x7ff93c0cce90 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 0x7ff93c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 0x7ff93c0c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38550/0 (socket says 172.21.15.18:38550) 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 -- 172.21.15.18:0/3458651449 learned_addr learned my addr 172.21.15.18:0/3458651449 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff93bfff640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff93c15b7e0 0x7ff93c0b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff940b5a640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c0cce90 0x7ff93c14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 -- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c0cce90 msgr2=0x7ff93c14a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c0cce90 0x7ff93c14a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 -- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff93c15b7e0 msgr2=0x7ff93c0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff93c15b7e0 0x7ff93c0b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 -- 172.21.15.18:0/3458651449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340094d0 con 0x7ff93c15f800 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff940b5a640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c0cce90 0x7ff93c14a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff94135b640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 0x7ff93c0c95a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9340ad040 tx=0x7ff93401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340b4800 con 0x7ff93c15f800 2023-06-09T04:38:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9340b4980 con 0x7ff93c15f800 2023-06-09T04:38:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0b4930 con 0x7ff93c15f800 2023-06-09T04:38:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340b4d30 con 0x7ff93c15f800 2023-06-09T04:38:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.146+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0b4ef0 con 0x7ff93c15f800 2023-06-09T04:38:41.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.150+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c0b50e0 con 0x7ff93c15f800 2023-06-09T04:38:41.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.150+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9340c7440 con 0x7ff93c15f800 2023-06-09T04:38:41.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.150+0000 7ff9397fa640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff91c0662b0 0x7ff91c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.150+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff93411e900 con 0x7ff93c15f800 2023-06-09T04:38:41.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.150+0000 7ff940b5a640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff91c0662b0 0x7ff91c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.150+0000 7ff940b5a640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff91c0662b0 0x7ff91c068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007a70 tx=0x7ff92c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.154+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9340ebbd0 con 0x7ff93c15f800 2023-06-09T04:38:41.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.302+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff93c073380 con 0x7ff93c15f800 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff9397fa640 1 -- 172.21.15.18:0/3458651449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9340ef1f0 con 0x7ff93c15f800 2023-06-09T04:38:41.308 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff91c0662b0 msgr2=0x7ff91c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff91c0662b0 0x7ff91c068760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007a70 tx=0x7ff92c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:41.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 msgr2=0x7ff93c0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 0x7ff93c0c95a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9340ad040 tx=0x7ff93401ac80 comp rx=0 tx=0).stop 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 shutdown_connections 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff93c15f800 0x7ff93c0c95a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff93c15b7e0 0x7ff93c0b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff91c0662b0 0x7ff91c068760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 --2- 172.21.15.18:0/3458651449 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff93c0cce90 0x7ff93c14a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 >> 172.21.15.18:0/3458651449 conn(0x7ff93c06ce60 msgr2=0x7ff93c06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 shutdown_connections 2023-06-09T04:38:41.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.306+0000 7ff942dbe640 1 -- 172.21.15.18:0/3458651449 wait complete. 2023-06-09T04:38:41.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:41.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 Processor -- start 2023-06-09T04:38:41.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 -- start start 2023-06-09T04:38:41.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c1595d0 0x7f122c06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f122c06c310 0x7f122c0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c15c620 con 0x7f122c155d20 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c15ce40 con 0x7f122c06c310 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f12344c6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0cc450 con 0x7f122c1595d0 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232a63640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f122c06c310 0x7f122c0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232262640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f122c155d20 0x7f122c15bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43664/0 (socket says 172.21.15.18:43664) 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232262640 1 -- 172.21.15.18:0/2008269650 learned_addr learned my addr 172.21.15.18:0/2008269650 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232a63640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f122c06c310 0x7f122c0c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38564/0 (socket says 172.21.15.18:38564) 2023-06-09T04:38:41.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1231a61640 1 --2- 172.21.15.18:0/2008269650 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c1595d0 0x7f122c06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232a63640 1 -- 172.21.15.18:0/2008269650 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c1595d0 msgr2=0x7f122c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:41.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232a63640 1 --2- 172.21.15.18:0/2008269650 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c1595d0 0x7f122c06bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232a63640 1 -- 172.21.15.18:0/2008269650 >> v1:172.21.15.18:6789/0 conn(0x7f122c155d20 legacy=0x7f122c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1232a63640 1 -- 172.21.15.18:0/2008269650 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c15c880 con 0x7f122c06c310 2023-06-09T04:38:41.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.438+0000 7f1231260640 1 -- 172.21.15.18:0/2008269650 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436885512 0 0) 0x7f122c15c620 con 0x7f122c155d20 2023-06-09T04:38:41.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1232a63640 1 --2- 172.21.15.18:0/2008269650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c06c310 0x7f122c0c3940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f122400bfa0 tx=0x7f122401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15803864d419b7b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231260640 1 -- 172.21.15.18:0/2008269650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400b2d0 con 0x7f122c06c310 2023-06-09T04:38:41.444 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231260640 1 -- 172.21.15.18:0/2008269650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12240a7900 con 0x7f122c06c310 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231260640 1 -- 172.21.15.18:0/2008269650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240a7c90 con 0x7f122c06c310 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/2008269650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c06c310 msgr2=0x7f122c0c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 --2- 172.21.15.18:0/2008269650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c06c310 0x7f122c0c3940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f122400bfa0 tx=0x7f122401eb20 comp rx=0 tx=0).stop 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/2008269650 shutdown_connections 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 --2- 172.21.15.18:0/2008269650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c06c310 0x7f122c0c3940 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 --2- 172.21.15.18:0/2008269650 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c1595d0 0x7f122c06bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/2008269650 >> 172.21.15.18:0/2008269650 conn(0x7f122c0afa90 msgr2=0x7f122c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/2008269650 shutdown_connections 2023-06-09T04:38:41.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/2008269650 wait complete. 2023-06-09T04:38:41.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 Processor -- start 2023-06-09T04:38:41.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- start start 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c06c310 0x7f122c150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 0x7f122c0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c1595d0 0x7f122c0ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c150e70 con 0x7f122c155d20 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0adc80 con 0x7f122c1595d0 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0ad070 con 0x7f122c06c310 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 0x7f122c0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 0x7f122c0ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38576/0 (socket says 172.21.15.18:38576) 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 -- 172.21.15.18:0/3607414608 learned_addr learned my addr 172.21.15.18:0/3607414608 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1232262640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c06c310 0x7f122c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1232a63640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c1595d0 0x7f122c0ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 -- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c06c310 msgr2=0x7f122c150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c06c310 0x7f122c150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 -- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c1595d0 msgr2=0x7f122c0ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c1595d0 0x7f122c0ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 -- 172.21.15.18:0/3607414608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122400bc80 con 0x7f122c155d20 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1232a63640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c1595d0 0x7f122c0ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1231a61640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 0x7f122c0ae110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f122800d5d0 tx=0x7f122800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228004240 con 0x7f122c155d20 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12280043a0 con 0x7f122c155d20 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c0ad350 con 0x7f122c155d20 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228003840 con 0x7f122c155d20 2023-06-09T04:38:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.442+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c0ad910 con 0x7f122c155d20 2023-06-09T04:38:41.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.446+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c0adad0 con 0x7f122c155d20 2023-06-09T04:38:41.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.446+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12280039a0 con 0x7f122c155d20 2023-06-09T04:38:41.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.446+0000 7f1222ffd640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1210066280 0x7f1210068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.446+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12280842a0 con 0x7f122c155d20 2023-06-09T04:38:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.446+0000 7f1232262640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1210066280 0x7f1210068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.446+0000 7f1232262640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1210066280 0x7f1210068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f121c007fd0 tx=0x7f121c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.450+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12280513a0 con 0x7f122c155d20 2023-06-09T04:38:41.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f122c073380 con 0x7f122c155d20 2023-06-09T04:38:41.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f1222ffd640 1 -- 172.21.15.18:0/3607414608 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12280549c0 con 0x7f122c155d20 2023-06-09T04:38:41.604 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:38:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1210066280 msgr2=0x7f1210068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1210066280 0x7f1210068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f121c007fd0 tx=0x7f121c009040 comp rx=0 tx=0).stop 2023-06-09T04:38:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 msgr2=0x7f122c0ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 0x7f122c0ae110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f122800d5d0 tx=0x7f122800da90 comp rx=0 tx=0).stop 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 shutdown_connections 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f122c1595d0 0x7f122c0ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f122c155d20 0x7f122c0ae110 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1210066280 0x7f1210068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 --2- 172.21.15.18:0/3607414608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f122c06c310 0x7f122c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 >> 172.21.15.18:0/3607414608 conn(0x7f122c0afa90 msgr2=0x7f122c151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 shutdown_connections 2023-06-09T04:38:41.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.602+0000 7f12344c6640 1 -- 172.21.15.18:0/3607414608 wait complete. 2023-06-09T04:38:41.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:38:41.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 Processor -- start 2023-06-09T04:38:41.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 -- start start 2023-06-09T04:38:41.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f352015b670 0x7f35200b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f352015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35200ce050 con 0x7f35200d1980 2023-06-09T04:38:41.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352015ba40 con 0x7f352015b670 2023-06-09T04:38:41.751 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f3527357640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35200ce2b0 con 0x7f352006b710 2023-06-09T04:38:41.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f35250f3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f352015b670 0x7f35200b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f35248f2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f35200d1980 0x7f352006b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43678/0 (socket says 172.21.15.18:43678) 2023-06-09T04:38:41.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.746+0000 7f35248f2640 1 -- 172.21.15.18:0/1596642754 learned_addr learned my addr 172.21.15.18:0/1596642754 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:41.752 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f35258f4640 1 --2- 172.21.15.18:0/1596642754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f352015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f35250f3640 1 -- 172.21.15.18:0/1596642754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 msgr2=0x7f352015fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:41.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f35250f3640 1 --2- 172.21.15.18:0/1596642754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f352015fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f35250f3640 1 -- 172.21.15.18:0/1596642754 >> v1:172.21.15.18:6789/0 conn(0x7f35200d1980 legacy=0x7f352006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f35250f3640 1 -- 172.21.15.18:0/1596642754 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200ce590 con 0x7f352015b670 2023-06-09T04:38:41.753 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f351ffff640 1 -- 172.21.15.18:0/1596642754 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931602596 0 0) 0x7f35200ce050 con 0x7f35200d1980 2023-06-09T04:38:41.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f35250f3640 1 --2- 172.21.15.18:0/1596642754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352015b670 0x7f35200b4d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3518009d90 tx=0x7f351801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d52cd92d9220539 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f351ffff640 1 -- 172.21.15.18:0/1596642754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35180a58c0 con 0x7f352015b670 2023-06-09T04:38:41.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f351ffff640 1 -- 172.21.15.18:0/1596642754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35180a5a20 con 0x7f352015b670 2023-06-09T04:38:41.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.750+0000 7f351ffff640 1 -- 172.21.15.18:0/1596642754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35180a5db0 con 0x7f352015b670 2023-06-09T04:38:41.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/1596642754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352015b670 msgr2=0x7f35200b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 --2- 172.21.15.18:0/1596642754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352015b670 0x7f35200b4d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3518009d90 tx=0x7f351801c800 comp rx=0 tx=0).stop 2023-06-09T04:38:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/1596642754 shutdown_connections 2023-06-09T04:38:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 --2- 172.21.15.18:0/1596642754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f352015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 --2- 172.21.15.18:0/1596642754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f352015b670 0x7f35200b4d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/1596642754 >> 172.21.15.18:0/1596642754 conn(0x7f35200b46a0 msgr2=0x7f35200d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/1596642754 shutdown_connections 2023-06-09T04:38:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/1596642754 wait complete. 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 Processor -- start 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- start start 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f3520150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 0x7f352014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352015b670 0x7f352014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352014c8c0 con 0x7f35200d1980 2023-06-09T04:38:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352014b9d0 con 0x7f352015b670 2023-06-09T04:38:41.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352014bcb0 con 0x7f352006b710 2023-06-09T04:38:41.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 0x7f352014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 0x7f352014df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38586/0 (socket says 172.21.15.18:38586) 2023-06-09T04:38:41.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 -- 172.21.15.18:0/22509841 learned_addr learned my addr 172.21.15.18:0/22509841 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:41.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35250f3640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f3520150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35258f4640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352015b670 0x7f352014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 -- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 msgr2=0x7f3520150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f3520150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 -- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352015b670 msgr2=0x7f352014ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352015b670 0x7f352014ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 -- 172.21.15.18:0/22509841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518009a70 con 0x7f35200d1980 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f35248f2640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 0x7f352014df80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f35140011f0 tx=0x7f351400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35140074e0 con 0x7f35200d1980 2023-06-09T04:38:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514007640 con 0x7f35200d1980 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352014bf90 con 0x7f35200d1980 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514004a10 con 0x7f35200d1980 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.754+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352014c550 con 0x7f35200d1980 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.758+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352014ca70 con 0x7f35200d1980 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.758+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3514004b70 con 0x7f35200d1980 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.758+0000 7f351dffb640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f350c0662b0 0x7f350c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.758+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3514083280 con 0x7f35200d1980 2023-06-09T04:38:41.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.758+0000 7f35250f3640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f350c0662b0 0x7f350c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:41.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.758+0000 7f35250f3640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f350c0662b0 0x7f350c068760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f35180af000 tx=0x7f35180a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:41.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.762+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f352014ca70 con 0x7f35200d1980 2023-06-09T04:38:41.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3520073380 con 0x7f35200d1980 2023-06-09T04:38:41.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f351dffb640 1 -- 172.21.15.18:0/22509841 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3514050370 con 0x7f35200d1980 2023-06-09T04:38:41.912 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f350c0662b0 msgr2=0x7f350c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f350c0662b0 0x7f350c068760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f35180af000 tx=0x7f35180a7070 comp rx=0 tx=0).stop 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 msgr2=0x7f352014df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 0x7f352014df80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f35140011f0 tx=0x7f351400c9b0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 shutdown_connections 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f352015b670 0x7f352014ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35200d1980 0x7f352014df80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f350c0662b0 0x7f350c068760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 --2- 172.21.15.18:0/22509841 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f352006b710 0x7f3520150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 >> 172.21.15.18:0/22509841 conn(0x7f35200b46a0 msgr2=0x7f35200692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 shutdown_connections 2023-06-09T04:38:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:41.910+0000 7f3527357640 1 -- 172.21.15.18:0/22509841 wait complete. 2023-06-09T04:38:41.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e79a37640 1 Processor -- start 2023-06-09T04:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e79a37640 1 -- start start 2023-06-09T04:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e79a37640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e74158310 0x7f8e740ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e79a37640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7406a900 con 0x7f8e7406c3c0 2023-06-09T04:38:42.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e79a37640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7415ceb0 con 0x7f8e741586e0 2023-06-09T04:38:42.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e79a37640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e740cd0f0 con 0x7f8e74158310 2023-06-09T04:38:42.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e737fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8e7406c3c0 0x7f8e7415bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43684/0 (socket says 172.21.15.18:43684) 2023-06-09T04:38:42.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e737fe640 1 -- 172.21.15.18:0/777195790 learned_addr learned my addr 172.21.15.18:0/777195790 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e72ffd640 1 --2- 172.21.15.18:0/777195790 >> v2:172.21.15.81:3300/0 conn(0x7f8e74158310 0x7f8e740ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717787633 0 0) 0x7f8e7406a900 con 0x7f8e7406c3c0 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e60003530 con 0x7f8e7406c3c0 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370512076 0 0) 0x7f8e60003530 con 0x7f8e7406c3c0 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 >> v2:172.21.15.81:3300/0 conn(0x7f8e74158310 msgr2=0x7f8e740ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 --2- 172.21.15.18:0/777195790 >> v2:172.21.15.81:3300/0 conn(0x7f8e74158310 0x7f8e740ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 >> v1:172.21.15.81:6789/0 conn(0x7f8e741586e0 legacy=0x7f8e7406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7415cbd0 con 0x7f8e7406c3c0 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f8e6c001680 con 0x7f8e7406c3c0 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 >> v1:172.21.15.18:6789/0 conn(0x7f8e7406c3c0 legacy=0x7f8e7415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e60003980 0x7f8e60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e60005180 0x7f8e6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740cd0f0 con 0x7f8e600047d0 2023-06-09T04:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6000c000 con 0x7f8e60005180 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6000c1c0 con 0x7f8e60003980 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e727fc640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e72ffd640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e60003980 0x7f8e60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e737fe640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e60005180 0x7f8e6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e727fc640 1 -- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e60003980 msgr2=0x7f8e60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e727fc640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e60003980 0x7f8e60003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e727fc640 1 -- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e60005180 msgr2=0x7f8e6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e727fc640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e60005180 0x7f8e6000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e727fc640 1 -- 172.21.15.18:0/777195790 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60003530 con 0x7f8e600047d0 2023-06-09T04:38:42.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.038+0000 7f8e737fe640 1 -- 172.21.15.18:0/777195790 reap_dead start 2023-06-09T04:38:42.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e727fc640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e60004c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c001780 tx=0x7f8e5c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe28633c22a28b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0052d0 con 0x7f8e600047d0 2023-06-09T04:38:42.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c0a7050 con 0x7f8e600047d0 2023-06-09T04:38:42.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e71ffb640 1 -- 172.21.15.18:0/777195790 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c003600 con 0x7f8e600047d0 2023-06-09T04:38:42.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- 172.21.15.18:0/777195790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 msgr2=0x7f8e60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e60004c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c001780 tx=0x7f8e5c01c3e0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- 172.21.15.18:0/777195790 shutdown_connections 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 --2- 172.21.15.18:0/777195790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e60004c40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- 172.21.15.18:0/777195790 >> 172.21.15.18:0/777195790 conn(0x7f8e740b0240 msgr2=0x7f8e740cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- 172.21.15.18:0/777195790 shutdown_connections 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- 172.21.15.18:0/777195790 wait complete. 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 Processor -- start 2023-06-09T04:38:42.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- start start 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e740c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e74153030 0x7f8e74156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e74156780 0x7f8e741f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740c6e70 con 0x7f8e600047d0 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74156c00 con 0x7f8e74153030 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e79a37640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e740c5150 con 0x7f8e74156780 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e740c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e740c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38610/0 (socket says 172.21.15.18:38610) 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 -- 172.21.15.18:0/3769950853 learned_addr learned my addr 172.21.15.18:0/3769950853 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e737fe640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e74156780 0x7f8e741f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e727fc640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e74153030 0x7f8e74156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 -- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e74156780 msgr2=0x7f8e741f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e74156780 0x7f8e741f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 -- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e74153030 msgr2=0x7f8e74156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e74153030 0x7f8e74156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 -- 172.21.15.18:0/3769950853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740c7080 con 0x7f8e600047d0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.042+0000 7f8e72ffd640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e740c7b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8e64007f30 tx=0x7f8e64011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6400e030 con 0x7f8e600047d0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64016470 con 0x7f8e600047d0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e740c4e70 con 0x7f8e600047d0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64016820 con 0x7f8e600047d0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e740c7600 con 0x7f8e600047d0 2023-06-09T04:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7406a390 con 0x7f8e600047d0 2023-06-09T04:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e64016980 con 0x7f8e600047d0 2023-06-09T04:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e6bfff640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8e54066280 0x7f8e54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e6400f070 con 0x7f8e600047d0 2023-06-09T04:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e727fc640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8e54066280 0x7f8e54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.046+0000 7f8e727fc640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8e54066280 0x7f8e54068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c001750 tx=0x7f8e5c0011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.050+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e64052190 con 0x7f8e600047d0 2023-06-09T04:38:42.235 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.230+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e740cc0a0 con 0x7f8e600047d0 2023-06-09T04:38:42.236 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e6bfff640 1 -- 172.21.15.18:0/3769950853 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f8e640557b0 con 0x7f8e600047d0 2023-06-09T04:38:42.236 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:42.236 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:42.237 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:38:42.238 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8e54066280 msgr2=0x7f8e54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8e54066280 0x7f8e54068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c001750 tx=0x7f8e5c0011a0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 msgr2=0x7f8e740c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e740c7b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8e64007f30 tx=0x7f8e64011660 comp rx=0 tx=0).stop 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 shutdown_connections 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8e54066280 0x7f8e54068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e74156780 0x7f8e741f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e74153030 0x7f8e74156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 --2- 172.21.15.18:0/3769950853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e600047d0 0x7f8e740c7b20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 >> 172.21.15.18:0/3769950853 conn(0x7f8e740b0240 msgr2=0x7f8e7415bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 shutdown_connections 2023-06-09T04:38:42.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.234+0000 7f8e79a37640 1 -- 172.21.15.18:0/3769950853 wait complete. 2023-06-09T04:38:42.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:42.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:42.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:42.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 Processor -- start 2023-06-09T04:38:42.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 -- start start 2023-06-09T04:38:42.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6198159320 0x7f619815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f619815d680 0x7f619806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f61980700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619815a920 con 0x7f619815d680 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619815cf10 con 0x7f6198159320 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f619d83f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980c81b0 con 0x7f619815dad0 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f619815d680 0x7f619806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f619815d680 0x7f619806fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38620/0 (socket says 172.21.15.18:38620) 2023-06-09T04:38:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 -- 172.21.15.18:0/4185238294 learned_addr learned my addr 172.21.15.18:0/4185238294 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:42.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61977fe640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f61980700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f6196ffd640 1 --2- 172.21.15.18:0/4185238294 >> v2:172.21.15.81:3300/0 conn(0x7f6198159320 0x7f619815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 -- 172.21.15.18:0/4185238294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 msgr2=0x7f61980700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f61980700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 -- 172.21.15.18:0/4185238294 >> v2:172.21.15.81:3300/0 conn(0x7f6198159320 msgr2=0x7f619815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 --2- 172.21.15.18:0/4185238294 >> v2:172.21.15.81:3300/0 conn(0x7f6198159320 0x7f619815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61967fc640 1 -- 172.21.15.18:0/4185238294 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980c8490 con 0x7f619815d680 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f61977fe640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f61980700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:42.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.370+0000 7f6196ffd640 1 --2- 172.21.15.18:0/4185238294 >> v2:172.21.15.81:3300/0 conn(0x7f6198159320 0x7f619815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:42.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f61967fc640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f619806fb60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f619806f610 tx=0x7f618c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b924806d330d27 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f6195ffb640 1 -- 172.21.15.18:0/4185238294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0a7070 con 0x7f619815d680 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f6195ffb640 1 -- 172.21.15.18:0/4185238294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c0ab430 con 0x7f619815d680 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f6195ffb640 1 -- 172.21.15.18:0/4185238294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0ab7c0 con 0x7f619815d680 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 -- 172.21.15.18:0/4185238294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 msgr2=0x7f619806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f619806fb60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f619806f610 tx=0x7f618c01c470 comp rx=0 tx=0).stop 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 -- 172.21.15.18:0/4185238294 shutdown_connections 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f61980700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 --2- 172.21.15.18:0/4185238294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f619806fb60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 --2- 172.21.15.18:0/4185238294 >> v2:172.21.15.81:3300/0 conn(0x7f6198159320 0x7f619815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 -- 172.21.15.18:0/4185238294 >> 172.21.15.18:0/4185238294 conn(0x7f61980b0240 msgr2=0x7f61980cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 -- 172.21.15.18:0/4185238294 shutdown_connections 2023-06-09T04:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 -- 172.21.15.18:0/4185238294 wait complete. 2023-06-09T04:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 Processor -- start 2023-06-09T04:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.374+0000 7f619d83f640 1 -- start start 2023-06-09T04:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198159320 0x7f61981561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f6198145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f6198147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6198156710 con 0x7f619815d680 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61981468c0 con 0x7f6198159320 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6198146ba0 con 0x7f619815dad0 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f6198145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f6198145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38626/0 (socket says 172.21.15.18:38626) 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 -- 172.21.15.18:0/4178059305 learned_addr learned my addr 172.21.15.18:0/4178059305 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61977fe640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f6198147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 -- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 msgr2=0x7f6198147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f6198147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 -- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198159320 msgr2=0x7f61981561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f6196ffd640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198159320 0x7f61981561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198159320 0x7f61981561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 -- 172.21.15.18:0/4178059305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0094d0 con 0x7f619815d680 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61977fe640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f6198147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f61967fc640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f6198145f60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f618c01ab20 tx=0x7f618c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0b4830 con 0x7f619815d680 2023-06-09T04:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c0b4990 con 0x7f619815d680 2023-06-09T04:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198146e80 con 0x7f619815d680 2023-06-09T04:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0b4d40 con 0x7f619815d680 2023-06-09T04:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6198147440 con 0x7f619815d680 2023-06-09T04:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6198073380 con 0x7f619815d680 2023-06-09T04:38:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f618c0bd3b0 con 0x7f619815d680 2023-06-09T04:38:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f617ffff640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6184066280 0x7f6184068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f618c11e420 con 0x7f619815d680 2023-06-09T04:38:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.378+0000 7f6196ffd640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6184066280 0x7f6184068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.382+0000 7f6196ffd640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6184066280 0x7f6184068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6188006fd0 tx=0x7f6188008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.382+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f618c0eb640 con 0x7f619815d680 2023-06-09T04:38:42.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.538+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f619806a0a0 con 0x7f619815d680 2023-06-09T04:38:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.538+0000 7f617ffff640 1 -- 172.21.15.18:0/4178059305 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f618c0eec60 con 0x7f619815d680 2023-06-09T04:38:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:42.543 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6184066280 msgr2=0x7f6184068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6184066280 0x7f6184068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6188006fd0 tx=0x7f6188008040 comp rx=0 tx=0).stop 2023-06-09T04:38:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 msgr2=0x7f6198145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f6198145f60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f618c01ab20 tx=0x7f618c019210 comp rx=0 tx=0).stop 2023-06-09T04:38:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 shutdown_connections 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6184066280 0x7f6184068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f619815dad0 0x7f6198147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f619815d680 0x7f6198145f60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 --2- 172.21.15.18:0/4178059305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198159320 0x7f61981561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 >> 172.21.15.18:0/4178059305 conn(0x7f61980b0240 msgr2=0x7f619815c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 shutdown_connections 2023-06-09T04:38:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.542+0000 7f619d83f640 1 -- 172.21.15.18:0/4178059305 wait complete. 2023-06-09T04:38:42.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:38:42.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:42.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 Processor -- start 2023-06-09T04:38:42.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 -- start start 2023-06-09T04:38:42.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe37c1591c0 0x7fe37c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe37c0acdf0 0x7fe37c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c15de50 con 0x7fe37c159590 2023-06-09T04:38:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c15d2d0 con 0x7fe37c0acdf0 2023-06-09T04:38:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe3831ff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c15d5b0 con 0x7fe37c1591c0 2023-06-09T04:38:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe37bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe37c159590 0x7fe37c06bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43700/0 (socket says 172.21.15.18:43700) 2023-06-09T04:38:42.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe37bfff640 1 -- 172.21.15.18:0/3310733868 learned_addr learned my addr 172.21.15.18:0/3310733868 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe38179c640 1 --2- 172.21.15.18:0/3310733868 >> v2:172.21.15.18:3300/0 conn(0x7fe37c0acdf0 0x7fe37c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe380f9b640 1 --2- 172.21.15.18:0/3310733868 >> v2:172.21.15.81:3300/0 conn(0x7fe37c1591c0 0x7fe37c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe37b7fe640 1 -- 172.21.15.18:0/3310733868 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099115021 0 0) 0x7fe37c15de50 con 0x7fe37c159590 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe37b7fe640 1 -- 172.21.15.18:0/3310733868 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe368003530 con 0x7fe37c159590 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe38179c640 1 -- 172.21.15.18:0/3310733868 >> v2:172.21.15.81:3300/0 conn(0x7fe37c1591c0 msgr2=0x7fe37c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe38179c640 1 --2- 172.21.15.18:0/3310733868 >> v2:172.21.15.81:3300/0 conn(0x7fe37c1591c0 0x7fe37c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe38179c640 1 -- 172.21.15.18:0/3310733868 >> v1:172.21.15.18:6789/0 conn(0x7fe37c159590 legacy=0x7fe37c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.722+0000 7fe38179c640 1 -- 172.21.15.18:0/3310733868 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c15d890 con 0x7fe37c0acdf0 2023-06-09T04:38:42.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 --2- 172.21.15.18:0/3310733868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c0acdf0 0x7fe37c0cbb70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3740097c0 tx=0x7fe37401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6710f976fa91b35d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe37b7fe640 1 -- 172.21.15.18:0/3310733868 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740ab600 con 0x7fe37c0acdf0 2023-06-09T04:38:42.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe37b7fe640 1 -- 172.21.15.18:0/3310733868 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3740a7050 con 0x7fe37c0acdf0 2023-06-09T04:38:42.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe37b7fe640 1 -- 172.21.15.18:0/3310733868 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740ab980 con 0x7fe37c0acdf0 2023-06-09T04:38:42.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- 172.21.15.18:0/3310733868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c0acdf0 msgr2=0x7fe37c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 --2- 172.21.15.18:0/3310733868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c0acdf0 0x7fe37c0cbb70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3740097c0 tx=0x7fe37401c410 comp rx=0 tx=0).stop 2023-06-09T04:38:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- 172.21.15.18:0/3310733868 shutdown_connections 2023-06-09T04:38:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 --2- 172.21.15.18:0/3310733868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c0acdf0 0x7fe37c0cbb70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 --2- 172.21.15.18:0/3310733868 >> v2:172.21.15.81:3300/0 conn(0x7fe37c1591c0 0x7fe37c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- 172.21.15.18:0/3310733868 >> 172.21.15.18:0/3310733868 conn(0x7fe37c0afa90 msgr2=0x7fe37c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- 172.21.15.18:0/3310733868 shutdown_connections 2023-06-09T04:38:42.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- 172.21.15.18:0/3310733868 wait complete. 2023-06-09T04:38:42.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 Processor -- start 2023-06-09T04:38:42.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- start start 2023-06-09T04:38:42.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37c0acdf0 0x7fe37c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe37c1591c0 0x7fe37c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 0x7fe37c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0b2360 con 0x7fe37c159590 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0cc650 con 0x7fe37c0acdf0 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe3831ff640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c15c8b0 con 0x7fe37c1591c0 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 0x7fe37c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 0x7fe37c1544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38648/0 (socket says 172.21.15.18:38648) 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 -- 172.21.15.18:0/2072074212 learned_addr learned my addr 172.21.15.18:0/2072074212 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe37bfff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe37c1591c0 0x7fe37c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe380f9b640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37c0acdf0 0x7fe37c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 -- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe37c1591c0 msgr2=0x7fe37c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe37c1591c0 0x7fe37c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 -- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37c0acdf0 msgr2=0x7fe37c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37c0acdf0 0x7fe37c15bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe38179c640 1 -- 172.21.15.18:0/2072074212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009420 con 0x7fe37c159590 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.726+0000 7fe37bfff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe37c1591c0 0x7fe37c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:42.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe38179c640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 0x7fe37c1544f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe3740ae040 tx=0x7fe3740191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740b4410 con 0x7fe37c159590 2023-06-09T04:38:42.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3740b4570 con 0x7fe37c159590 2023-06-09T04:38:42.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c0b2570 con 0x7fe37c159590 2023-06-09T04:38:42.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740b4900 con 0x7fe37c159590 2023-06-09T04:38:42.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c15c2f0 con 0x7fe37c159590 2023-06-09T04:38:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c073380 con 0x7fe37c159590 2023-06-09T04:38:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3740b2040 con 0x7fe37c159590 2023-06-09T04:38:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3797fa640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe35c066280 0x7fe35c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe37411df00 con 0x7fe37c159590 2023-06-09T04:38:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe380f9b640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe35c066280 0x7fe35c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:42.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.730+0000 7fe380f9b640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe35c066280 0x7fe35c068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009f80 tx=0x7fe36c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:42.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.734+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3740eb090 con 0x7fe37c159590 2023-06-09T04:38:42.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.882+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe37c0652b0 con 0x7fe37c159590 2023-06-09T04:38:42.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.882+0000 7fe3797fa640 1 -- 172.21.15.18:0/2072074212 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3740ee6b0 con 0x7fe37c159590 2023-06-09T04:38:42.886 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:42.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe35c066280 msgr2=0x7fe35c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe35c066280 0x7fe35c068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009f80 tx=0x7fe36c00b040 comp rx=0 tx=0).stop 2023-06-09T04:38:42.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 msgr2=0x7fe37c1544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:42.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 0x7fe37c1544f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe3740ae040 tx=0x7fe3740191b0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 shutdown_connections 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe37c159590 0x7fe37c1544f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe35c066280 0x7fe35c068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe37c1591c0 0x7fe37c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 --2- 172.21.15.18:0/2072074212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe37c0acdf0 0x7fe37c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 >> 172.21.15.18:0/2072074212 conn(0x7fe37c0afa90 msgr2=0x7fe37c0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 shutdown_connections 2023-06-09T04:38:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:42.886+0000 7fe3831ff640 1 -- 172.21.15.18:0/2072074212 wait complete. 2023-06-09T04:38:42.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:43.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 Processor -- start 2023-06-09T04:38:43.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 -- start start 2023-06-09T04:38:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff664153800 0x7ff6641599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153bd0 0x7ff6640b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff664159ee0 0x7ff6640b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66415a4b0 con 0x7ff664153800 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66415a790 con 0x7ff664159ee0 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff6690cb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66415ad70 con 0x7ff664153bd0 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff664153800 0x7ff6641599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff664153800 0x7ff6641599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38660/0 (socket says 172.21.15.18:38660) 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 -- 172.21.15.18:0/3965697343 learned_addr learned my addr 172.21.15.18:0/3965697343 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff66259c640 1 --2- 172.21.15.18:0/3965697343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153bd0 0x7ff6640b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff66359e640 1 --2- 172.21.15.18:0/3965697343 >> v2:172.21.15.81:3300/0 conn(0x7ff664159ee0 0x7ff6640b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 -- 172.21.15.18:0/3965697343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153bd0 msgr2=0x7ff6640b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 --2- 172.21.15.18:0/3965697343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153bd0 0x7ff6640b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 -- 172.21.15.18:0/3965697343 >> v2:172.21.15.81:3300/0 conn(0x7ff664159ee0 msgr2=0x7ff6640b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 --2- 172.21.15.18:0/3965697343 >> v2:172.21.15.81:3300/0 conn(0x7ff664159ee0 0x7ff6640b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.014+0000 7ff662d9d640 1 -- 172.21.15.18:0/3965697343 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66415b050 con 0x7ff664153800 2023-06-09T04:38:43.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff662d9d640 1 --2- 172.21.15.18:0/3965697343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153800 0x7ff6641599a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff6640cc160 tx=0x7ff65401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78e2cf2d01ca41 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff661d9b640 1 -- 172.21.15.18:0/3965697343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540ab600 con 0x7ff664153800 2023-06-09T04:38:43.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff661d9b640 1 -- 172.21.15.18:0/3965697343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540a7050 con 0x7ff664153800 2023-06-09T04:38:43.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff661d9b640 1 -- 172.21.15.18:0/3965697343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540ab980 con 0x7ff664153800 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- 172.21.15.18:0/3965697343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153800 msgr2=0x7ff6641599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- 172.21.15.18:0/3965697343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153800 0x7ff6641599a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff6640cc160 tx=0x7ff65401c500 comp rx=0 tx=0).stop 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- 172.21.15.18:0/3965697343 shutdown_connections 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- 172.21.15.18:0/3965697343 >> v2:172.21.15.81:3300/0 conn(0x7ff664159ee0 0x7ff6640b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- 172.21.15.18:0/3965697343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153bd0 0x7ff6640b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- 172.21.15.18:0/3965697343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153800 0x7ff6641599a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- 172.21.15.18:0/3965697343 >> 172.21.15.18:0/3965697343 conn(0x7ff66406cdd0 msgr2=0x7ff66406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- 172.21.15.18:0/3965697343 shutdown_connections 2023-06-09T04:38:43.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- 172.21.15.18:0/3965697343 wait complete. 2023-06-09T04:38:43.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 Processor -- start 2023-06-09T04:38:43.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- start start 2023-06-09T04:38:43.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153800 0x7ff664140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 0x7ff664152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664159ee0 0x7ff66415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640c5470 con 0x7ff664153bd0 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff664157190 con 0x7ff664159ee0 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff6690cb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff664157470 con 0x7ff664153800 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff66259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 0x7ff664152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff66259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 0x7ff664152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38676/0 (socket says 172.21.15.18:38676) 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff66259c640 1 -- 172.21.15.18:0/2735558423 learned_addr learned my addr 172.21.15.18:0/2735558423 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff662d9d640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153800 0x7ff664140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff66359e640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664159ee0 0x7ff66415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff66259c640 1 -- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153800 msgr2=0x7ff664140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.018+0000 7ff66259c640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153800 0x7ff664140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff66259c640 1 -- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664159ee0 msgr2=0x7ff66415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff66259c640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664159ee0 0x7ff66415e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff66259c640 1 -- 172.21.15.18:0/2735558423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540094d0 con 0x7ff664153bd0 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff66359e640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664159ee0 0x7ff66415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff66259c640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 0x7ff664152360 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff65800d800 tx=0x7ff65800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580096a0 con 0x7ff664153bd0 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658009800 con 0x7ff664153bd0 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658009b70 con 0x7ff664153bd0 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff664157750 con 0x7ff664153bd0 2023-06-09T04:38:43.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff664157d10 con 0x7ff664153bd0 2023-06-09T04:38:43.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff664073380 con 0x7ff664153bd0 2023-06-09T04:38:43.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff658009cd0 con 0x7ff664153bd0 2023-06-09T04:38:43.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff64b7fe640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff650066280 0x7ff650068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff658084780 con 0x7ff664153bd0 2023-06-09T04:38:43.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff662d9d640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff650066280 0x7ff650068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.022+0000 7ff662d9d640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff650066280 0x7ff650068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff6540ad000 tx=0x7ff654008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.026+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6580553a0 con 0x7ff664153bd0 2023-06-09T04:38:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.174+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff66406aeb0 con 0x7ff664153bd0 2023-06-09T04:38:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.174+0000 7ff64b7fe640 1 -- 172.21.15.18:0/2735558423 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff65800b420 con 0x7ff664153bd0 2023-06-09T04:38:43.178 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff650066280 msgr2=0x7ff650068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff650066280 0x7ff650068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff6540ad000 tx=0x7ff654008040 comp rx=0 tx=0).stop 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 msgr2=0x7ff664152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 0x7ff664152360 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff65800d800 tx=0x7ff65800dcc0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 shutdown_connections 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664159ee0 0x7ff66415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff664153bd0 0x7ff664152360 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff650066280 0x7ff650068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 --2- 172.21.15.18:0/2735558423 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff664153800 0x7ff664140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 >> 172.21.15.18:0/2735558423 conn(0x7ff66406cdd0 msgr2=0x7ff6640b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 shutdown_connections 2023-06-09T04:38:43.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.178+0000 7ff6690cb640 1 -- 172.21.15.18:0/2735558423 wait complete. 2023-06-09T04:38:43.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.306+0000 7f0da8f36640 1 Processor -- start 2023-06-09T04:38:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.306+0000 7f0da8f36640 1 -- start start 2023-06-09T04:38:43.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da8f36640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0da40cbd40 0x7f0da4069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da8f36640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0da4159590 0x7f0da4069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da8f36640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da415de50 con 0x7f0da41591c0 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da8f36640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da415d2d0 con 0x7f0da4159590 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da8f36640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da415d5b0 con 0x7f0da40cbd40 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0da4159590 0x7f0da4069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0da4159590 0x7f0da4069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38684/0 (socket says 172.21.15.18:38684) 2023-06-09T04:38:43.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 -- 172.21.15.18:0/3874913855 learned_addr learned my addr 172.21.15.18:0/3874913855 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0d9bfff640 1 --2- 172.21.15.18:0/3874913855 >> v2:172.21.15.81:3300/0 conn(0x7f0da40cbd40 0x7f0da4069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 -- 172.21.15.18:0/3874913855 >> v2:172.21.15.81:3300/0 conn(0x7f0da40cbd40 msgr2=0x7f0da4069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 --2- 172.21.15.18:0/3874913855 >> v2:172.21.15.81:3300/0 conn(0x7f0da40cbd40 0x7f0da4069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 -- 172.21.15.18:0/3874913855 >> v1:172.21.15.81:6789/0 conn(0x7f0da41591c0 legacy=0x7f0da40cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 -- 172.21.15.18:0/3874913855 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da415d890 con 0x7f0da4159590 2023-06-09T04:38:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da2d9d640 1 --2- 172.21.15.18:0/3874913855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da4159590 0x7f0da4069b40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0da40692b0 tx=0x7f0d9c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3683a9daa1faa3e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da1d9b640 1 -- 172.21.15.18:0/3874913855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5780 con 0x7f0da4159590 2023-06-09T04:38:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da1d9b640 1 -- 172.21.15.18:0/3874913855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0a58e0 con 0x7f0da4159590 2023-06-09T04:38:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.310+0000 7f0da1d9b640 1 -- 172.21.15.18:0/3874913855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5c70 con 0x7f0da4159590 2023-06-09T04:38:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- 172.21.15.18:0/3874913855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da4159590 msgr2=0x7f0da4069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3874913855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da4159590 0x7f0da4069b40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0da40692b0 tx=0x7f0d9c01c960 comp rx=0 tx=0).stop 2023-06-09T04:38:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- 172.21.15.18:0/3874913855 shutdown_connections 2023-06-09T04:38:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3874913855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da4159590 0x7f0da4069b40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3874913855 >> v2:172.21.15.81:3300/0 conn(0x7f0da40cbd40 0x7f0da4069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- 172.21.15.18:0/3874913855 >> 172.21.15.18:0/3874913855 conn(0x7f0da40afa90 msgr2=0x7f0da40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- 172.21.15.18:0/3874913855 shutdown_connections 2023-06-09T04:38:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- 172.21.15.18:0/3874913855 wait complete. 2023-06-09T04:38:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 Processor -- start 2023-06-09T04:38:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- start start 2023-06-09T04:38:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da40cbd40 0x7f0da41f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 0x7f0da415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0da4159590 0x7f0da415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40b3300 con 0x7f0da41591c0 2023-06-09T04:38:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4153f40 con 0x7f0da40cbd40 2023-06-09T04:38:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da8f36640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da41f4cc0 con 0x7f0da4159590 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 0x7f0da415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 0x7f0da415e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38692/0 (socket says 172.21.15.18:38692) 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 -- 172.21.15.18:0/3952294818 learned_addr learned my addr 172.21.15.18:0/3952294818 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da40cbd40 0x7f0da41f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0da2d9d640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0da4159590 0x7f0da415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 -- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0da4159590 msgr2=0x7f0da415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0da4159590 0x7f0da415e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 -- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da40cbd40 msgr2=0x7f0da41f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da40cbd40 0x7f0da41f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 -- 172.21.15.18:0/3952294818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009b30 con 0x7f0da41591c0 2023-06-09T04:38:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9bfff640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 0x7f0da415e070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c820 tx=0x7f0d8c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.314+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c004230 con 0x7f0da41591c0 2023-06-09T04:38:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c004390 con 0x7f0da41591c0 2023-06-09T04:38:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c007a70 con 0x7f0da41591c0 2023-06-09T04:38:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da40b26f0 con 0x7f0da41591c0 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da40b2cb0 con 0x7f0da41591c0 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da40b34b0 con 0x7f0da41591c0 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d8c007bd0 con 0x7f0da41591c0 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0d9affd640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0d84066280 0x7f0d84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d8c083f00 con 0x7f0da41591c0 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0da259c640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0d84066280 0x7f0d84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.318+0000 7f0da259c640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0d84066280 0x7f0d84068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d94001850 tx=0x7f0d94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.322+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d8c0510a0 con 0x7f0da41591c0 2023-06-09T04:38:43.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.466+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0da4073380 con 0x7f0da41591c0 2023-06-09T04:38:43.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0d9affd640 1 -- 172.21.15.18:0/3952294818 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d8c01e020 con 0x7f0da41591c0 2023-06-09T04:38:43.472 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:43.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0d84066280 msgr2=0x7f0d84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0d84066280 0x7f0d84068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d94001850 tx=0x7f0d94009040 comp rx=0 tx=0).stop 2023-06-09T04:38:43.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 msgr2=0x7f0da415e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 0x7f0da415e070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c820 tx=0x7f0d8c00cce0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 shutdown_connections 2023-06-09T04:38:43.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0d84066280 0x7f0d84068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0da4159590 0x7f0da415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da41591c0 0x7f0da415e070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 --2- 172.21.15.18:0/3952294818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da40cbd40 0x7f0da41f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 >> 172.21.15.18:0/3952294818 conn(0x7f0da40afa90 msgr2=0x7f0da4156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 shutdown_connections 2023-06-09T04:38:43.475 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.470+0000 7f0da8f36640 1 -- 172.21.15.18:0/3952294818 wait complete. 2023-06-09T04:38:43.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 Processor -- start 2023-06-09T04:38:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 -- start start 2023-06-09T04:38:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f87c015b670 0x7f87c00b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c00d1980 0x7f87c015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00ce050 con 0x7f87c006b000 2023-06-09T04:38:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c015ba40 con 0x7f87c015b670 2023-06-09T04:38:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c643c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00ce2b0 con 0x7f87c00d1980 2023-06-09T04:38:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87bffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f87c015b670 0x7f87c00b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c49d9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f87c006b000 0x7f87c00cfd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43702/0 (socket says 172.21.15.18:43702) 2023-06-09T04:38:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87c49d9640 1 -- 172.21.15.18:0/942377869 learned_addr learned my addr 172.21.15.18:0/942377869 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87b77fe640 1 --2- 172.21.15.18:0/942377869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c00d1980 0x7f87c015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87bffff640 1 -- 172.21.15.18:0/942377869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c00d1980 msgr2=0x7f87c015fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87bf7fe640 1 -- 172.21.15.18:0/942377869 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655734644 0 0) 0x7f87c00ce050 con 0x7f87c006b000 2023-06-09T04:38:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87bffff640 1 --2- 172.21.15.18:0/942377869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c00d1980 0x7f87c015fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87bffff640 1 -- 172.21.15.18:0/942377869 >> v1:172.21.15.18:6789/0 conn(0x7f87c006b000 legacy=0x7f87c00cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.602+0000 7f87bffff640 1 -- 172.21.15.18:0/942377869 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00ce590 con 0x7f87c015b670 2023-06-09T04:38:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87bffff640 1 --2- 172.21.15.18:0/942377869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c015b670 0x7f87c00b4d10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87b00097c0 tx=0x7f87b001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e6e07c91a063c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87bf7fe640 1 -- 172.21.15.18:0/942377869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00a4ea0 con 0x7f87c015b670 2023-06-09T04:38:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87bf7fe640 1 -- 172.21.15.18:0/942377869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b00a7050 con 0x7f87c015b670 2023-06-09T04:38:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87bf7fe640 1 -- 172.21.15.18:0/942377869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00ab820 con 0x7f87c015b670 2023-06-09T04:38:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 -- 172.21.15.18:0/942377869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c015b670 msgr2=0x7f87c00b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 --2- 172.21.15.18:0/942377869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c015b670 0x7f87c00b4d10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87b00097c0 tx=0x7f87b001c330 comp rx=0 tx=0).stop 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 -- 172.21.15.18:0/942377869 shutdown_connections 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 --2- 172.21.15.18:0/942377869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c00d1980 0x7f87c015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 --2- 172.21.15.18:0/942377869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c015b670 0x7f87c00b4d10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 -- 172.21.15.18:0/942377869 >> 172.21.15.18:0/942377869 conn(0x7f87c00b46a0 msgr2=0x7f87c00d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 -- 172.21.15.18:0/942377869 shutdown_connections 2023-06-09T04:38:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 -- 172.21.15.18:0/942377869 wait complete. 2023-06-09T04:38:43.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 Processor -- start 2023-06-09T04:38:43.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.606+0000 7f87c643c640 1 -- start start 2023-06-09T04:38:43.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c006b000 0x7f87c015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 0x7f87c015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c015b670 0x7f87c015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0150730 con 0x7f87c00d1980 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c015af20 con 0x7f87c006b000 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c015eb20 con 0x7f87c015b670 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 0x7f87c015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 0x7f87c015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38712/0 (socket says 172.21.15.18:38712) 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 -- 172.21.15.18:0/517445135 learned_addr learned my addr 172.21.15.18:0/517445135 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c49d9640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c015b670 0x7f87c015dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bffff640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c006b000 0x7f87c015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 -- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c015b670 msgr2=0x7f87c015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c015b670 0x7f87c015dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 -- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c006b000 msgr2=0x7f87c015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c006b000 0x7f87c015a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 -- 172.21.15.18:0/517445135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b0009420 con 0x7f87c00d1980 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c49d9640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c015b670 0x7f87c015dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87b77fe640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 0x7f87c015d570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f87a800e930 tx=0x7f87a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8009690 con 0x7f87c00d1980 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800c9a0 con 0x7f87c00d1980 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800cd10 con 0x7f87c00d1980 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c014fbb0 con 0x7f87c00d1980 2023-06-09T04:38:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c0150170 con 0x7f87c00d1980 2023-06-09T04:38:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c0073380 con 0x7f87c00d1980 2023-06-09T04:38:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87a8013470 con 0x7f87c00d1980 2023-06-09T04:38:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bd7fa640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f87a0066280 0x7f87a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87a8084170 con 0x7f87c00d1980 2023-06-09T04:38:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.610+0000 7f87bffff640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f87a0066280 0x7f87a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.614+0000 7f87bffff640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f87a0066280 0x7f87a0068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f87b00ad000 tx=0x7f87b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.614+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87a8051450 con 0x7f87c00d1980 2023-06-09T04:38:43.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.766+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87c00c59d0 con 0x7f87c00d1980 2023-06-09T04:38:43.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87bd7fa640 1 -- 172.21.15.18:0/517445135 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87a8054a70 con 0x7f87c00d1980 2023-06-09T04:38:43.772 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:38:43.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f87a0066280 msgr2=0x7f87a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f87a0066280 0x7f87a0068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f87b00ad000 tx=0x7f87b0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:43.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 msgr2=0x7f87c015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 0x7f87c015d570 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f87a800e930 tx=0x7f87a800edf0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 shutdown_connections 2023-06-09T04:38:43.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f87a0066280 0x7f87a0068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f87c015b670 0x7f87c015dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c00d1980 0x7f87c015d570 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 --2- 172.21.15.18:0/517445135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87c006b000 0x7f87c015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 >> 172.21.15.18:0/517445135 conn(0x7f87c00b46a0 msgr2=0x7f87c00b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 shutdown_connections 2023-06-09T04:38:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.770+0000 7f87c643c640 1 -- 172.21.15.18:0/517445135 wait complete. 2023-06-09T04:38:43.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:38:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.902+0000 7f07571bf640 1 Processor -- start 2023-06-09T04:38:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.902+0000 7f07571bf640 1 -- start start 2023-06-09T04:38:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f07571bf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f075015b600 0x7f07500b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f07571bf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07500b40e0 0x7f075015f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f07571bf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075015fd40 con 0x7f075015f280 2023-06-09T04:38:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f07571bf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500cfce0 con 0x7f07500b40e0 2023-06-09T04:38:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f07571bf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0750160020 con 0x7f075015b600 2023-06-09T04:38:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f075575c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07500b40e0 0x7f075015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f074ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f075015f280 0x7f07500b39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43718/0 (socket says 172.21.15.18:43718) 2023-06-09T04:38:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f074ffff640 1 -- 172.21.15.18:0/1867925696 learned_addr learned my addr 172.21.15.18:0/1867925696 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f0754f5b640 1 --2- 172.21.15.18:0/1867925696 >> v2:172.21.15.81:3300/0 conn(0x7f075015b600 0x7f07500b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f075575c640 1 -- 172.21.15.18:0/1867925696 >> v2:172.21.15.81:3300/0 conn(0x7f075015b600 msgr2=0x7f07500b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f075575c640 1 --2- 172.21.15.18:0/1867925696 >> v2:172.21.15.81:3300/0 conn(0x7f075015b600 0x7f07500b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f075575c640 1 -- 172.21.15.18:0/1867925696 >> v1:172.21.15.18:6789/0 conn(0x7f075015f280 legacy=0x7f07500b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f075575c640 1 -- 172.21.15.18:0/1867925696 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500cfef0 con 0x7f07500b40e0 2023-06-09T04:38:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f075575c640 1 --2- 172.21.15.18:0/1867925696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500b40e0 0x7f075015f700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f07500ce900 tx=0x7f074801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bf667d46c952e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f074f7fe640 1 -- 172.21.15.18:0/1867925696 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480a59c0 con 0x7f07500b40e0 2023-06-09T04:38:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f074f7fe640 1 -- 172.21.15.18:0/1867925696 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480a5b20 con 0x7f07500b40e0 2023-06-09T04:38:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.906+0000 7f074f7fe640 1 -- 172.21.15.18:0/1867925696 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480ad440 con 0x7f07500b40e0 2023-06-09T04:38:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/1867925696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500b40e0 msgr2=0x7f075015f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 --2- 172.21.15.18:0/1867925696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500b40e0 0x7f075015f700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f07500ce900 tx=0x7f074801c8e0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/1867925696 shutdown_connections 2023-06-09T04:38:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 --2- 172.21.15.18:0/1867925696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07500b40e0 0x7f075015f700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 --2- 172.21.15.18:0/1867925696 >> v2:172.21.15.81:3300/0 conn(0x7f075015b600 0x7f07500b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/1867925696 >> 172.21.15.18:0/1867925696 conn(0x7f07500d2120 msgr2=0x7f07500d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/1867925696 shutdown_connections 2023-06-09T04:38:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/1867925696 wait complete. 2023-06-09T04:38:43.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 Processor -- start 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- start start 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07500b40e0 0x7f075015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075015b600 0x7f07500c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 0x7f07500c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075015c3c0 con 0x7f075015f280 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500ca1f0 con 0x7f075015b600 2023-06-09T04:38:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500ca4d0 con 0x7f07500b40e0 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 0x7f07500c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 0x7f07500c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38724/0 (socket says 172.21.15.18:38724) 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 -- 172.21.15.18:0/2304731934 learned_addr learned my addr 172.21.15.18:0/2304731934 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f0754f5b640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07500b40e0 0x7f075015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f074ffff640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075015b600 0x7f07500c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 -- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07500b40e0 msgr2=0x7f075015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07500b40e0 0x7f075015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 -- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075015b600 msgr2=0x7f07500c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075015b600 0x7f07500c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 -- 172.21.15.18:0/2304731934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009a70 con 0x7f075015f280 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f075575c640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 0x7f07500c7bd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07480194f0 tx=0x7f0748019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480ade20 con 0x7f075015f280 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480b9450 con 0x7f075015f280 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075015bd00 con 0x7f075015f280 2023-06-09T04:38:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480b9800 con 0x7f075015f280 2023-06-09T04:38:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07500c9ea0 con 0x7f075015f280 2023-06-09T04:38:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.910+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075015c500 con 0x7f075015f280 2023-06-09T04:38:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.914+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07480b9960 con 0x7f075015f280 2023-06-09T04:38:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.914+0000 7f074d7fa640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f073c0662b0 0x7f073c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.914+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f074811f930 con 0x7f075015f280 2023-06-09T04:38:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.914+0000 7f0754f5b640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f073c0662b0 0x7f073c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.914+0000 7f0754f5b640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f073c0662b0 0x7f073c068760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f074000a970 tx=0x7f0740008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:43.918+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f075015c500 con 0x7f075015f280 2023-06-09T04:38:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f075015c500 con 0x7f075015f280 2023-06-09T04:38:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f074d7fa640 1 -- 172.21.15.18:0/2304731934 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f075015c500 con 0x7f075015f280 2023-06-09T04:38:44.073 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:44.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f073c0662b0 msgr2=0x7f073c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f073c0662b0 0x7f073c068760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f074000a970 tx=0x7f0740008040 comp rx=0 tx=0).stop 2023-06-09T04:38:44.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 msgr2=0x7f07500c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 0x7f07500c7bd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07480194f0 tx=0x7f0748019680 comp rx=0 tx=0).stop 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 shutdown_connections 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f075015f280 0x7f07500c7bd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.070+0000 7f07571bf640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075015b600 0x7f07500c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.074+0000 7f07571bf640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f073c0662b0 0x7f073c068760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.074+0000 7f07571bf640 1 --2- 172.21.15.18:0/2304731934 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f07500b40e0 0x7f075015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.074+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 >> 172.21.15.18:0/2304731934 conn(0x7f07500d2120 msgr2=0x7f07501581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.074+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 shutdown_connections 2023-06-09T04:38:44.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.074+0000 7f07571bf640 1 -- 172.21.15.18:0/2304731934 wait complete. 2023-06-09T04:38:44.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.202+0000 7ff5f978c640 1 Processor -- start 2023-06-09T04:38:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.202+0000 7ff5f978c640 1 -- start start 2023-06-09T04:38:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f978c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5f40cc9b0 0x7ff5f415f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f978c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f415c950 con 0x7ff5f40b7480 2023-06-09T04:38:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f978c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f40ce320 con 0x7ff5f40b3fe0 2023-06-09T04:38:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f978c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f40cc4b0 con 0x7ff5f40cc9b0 2023-06-09T04:38:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff5f40b7480 0x7ff5f40b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43730/0 (socket says 172.21.15.18:43730) 2023-06-09T04:38:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 -- 172.21.15.18:0/1317843707 learned_addr learned my addr 172.21.15.18:0/1317843707 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5ebfff640 1 --2- 172.21.15.18:0/1317843707 >> v2:172.21.15.81:3300/0 conn(0x7ff5f40cc9b0 0x7ff5f415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755390895 0 0) 0x7ff5f415c950 con 0x7ff5f40b7480 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e0003530 con 0x7ff5f40b7480 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2798553334 0 0) 0x7ff5e0003530 con 0x7ff5f40b7480 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 >> v2:172.21.15.81:3300/0 conn(0x7ff5f40cc9b0 msgr2=0x7ff5f415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 --2- 172.21.15.18:0/1317843707 >> v2:172.21.15.81:3300/0 conn(0x7ff5f40cc9b0 0x7ff5f415f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 >> v1:172.21.15.81:6789/0 conn(0x7ff5f40b3fe0 legacy=0x7ff5f415f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40ce010 con 0x7ff5f40b7480 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7ff5e4001680 con 0x7ff5f40b7480 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 >> v1:172.21.15.18:6789/0 conn(0x7ff5f40b7480 legacy=0x7ff5f40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e0003980 0x7ff5e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e00047d0 0x7ff5e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0005180 0x7ff5e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40cc4b0 con 0x7ff5e0003980 2023-06-09T04:38:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e000c000 con 0x7ff5e0005180 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e000c1c0 con 0x7ff5e00047d0 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e0003980 0x7ff5e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5ebfff640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e00047d0 0x7ff5e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f37fe640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0005180 0x7ff5e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 -- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e00047d0 msgr2=0x7ff5e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5e00047d0 0x7ff5e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 -- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0005180 msgr2=0x7ff5e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0005180 0x7ff5e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 -- 172.21.15.18:0/1317843707 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0003530 con 0x7ff5e0003980 2023-06-09T04:38:44.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f37fe640 1 -- 172.21.15.18:0/1317843707 reap_dead start 2023-06-09T04:38:44.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e0003980 0x7ff5e0003d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c240 tx=0x7ff5e401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb0a178c1b30ce4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4005ae0 con 0x7ff5e0003980 2023-06-09T04:38:44.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4005c40 con 0x7ff5e0003980 2023-06-09T04:38:44.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.206+0000 7ff5f27fc640 1 -- 172.21.15.18:0/1317843707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40a5aa0 con 0x7ff5e0003980 2023-06-09T04:38:44.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1317843707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e0003980 msgr2=0x7ff5e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e0003980 0x7ff5e0003d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c240 tx=0x7ff5e401cc40 comp rx=0 tx=0).stop 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1317843707 shutdown_connections 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1317843707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5e0003980 0x7ff5e0003d90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1317843707 >> 172.21.15.18:0/1317843707 conn(0x7ff5f40d2ae0 msgr2=0x7ff5f40ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1317843707 shutdown_connections 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1317843707 wait complete. 2023-06-09T04:38:44.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 Processor -- start 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- start start 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0003980 0x7ff5f41f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 0x7ff5f40ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5f40c9ee0 0x7ff5f40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40ab9f0 con 0x7ff5f40ab040 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40cac10 con 0x7ff5e0003980 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40caef0 con 0x7ff5f40c9ee0 2023-06-09T04:38:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 0x7ff5f40ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 0x7ff5f40ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38738/0 (socket says 172.21.15.18:38738) 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 -- 172.21.15.18:0/1162206792 learned_addr learned my addr 172.21.15.18:0/1162206792 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0003980 0x7ff5f41f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f37fe640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5f40c9ee0 0x7ff5f40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 -- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5f40c9ee0 msgr2=0x7ff5f40ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5f40c9ee0 0x7ff5f40ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 -- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0003980 msgr2=0x7ff5f41f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0003980 0x7ff5f41f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 -- 172.21.15.18:0/1162206792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40cb1d0 con 0x7ff5f40ab040 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5ebfff640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 0x7ff5f40ab4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0115e0 tx=0x7ff5dc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc004440 con 0x7ff5f40ab040 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc003620 con 0x7ff5f40ab040 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0039d0 con 0x7ff5f40ab040 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f40cb4b0 con 0x7ff5f40ab040 2023-06-09T04:38:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.210+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f40ca8c0 con 0x7ff5f40ab040 2023-06-09T04:38:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.214+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f40ceaf0 con 0x7ff5f40ab040 2023-06-09T04:38:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.214+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5dc003b30 con 0x7ff5f40ab040 2023-06-09T04:38:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.214+0000 7ff5eb7fe640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5d40662b0 0x7ff5d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.214+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5dc0842d0 con 0x7ff5f40ab040 2023-06-09T04:38:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.214+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5d40662b0 0x7ff5d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.214+0000 7ff5f2ffd640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5d40662b0 0x7ff5d4068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40ab000 tx=0x7ff5e40b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.218+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5dc0513c0 con 0x7ff5f40ab040 2023-06-09T04:38:44.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.398+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5f40ce810 con 0x7ff5f40ab040 2023-06-09T04:38:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.398+0000 7ff5eb7fe640 1 -- 172.21.15.18:0/1162206792 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7ff5dc006c40 con 0x7ff5f40ab040 2023-06-09T04:38:44.403 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:44.403 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:44.403 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5d40662b0 msgr2=0x7ff5d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5d40662b0 0x7ff5d4068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40ab000 tx=0x7ff5e40b1040 comp rx=0 tx=0).stop 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 msgr2=0x7ff5f40ab4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 0x7ff5f40ab4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0115e0 tx=0x7ff5dc011aa0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 shutdown_connections 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff5d40662b0 0x7ff5d4068760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5f40c9ee0 0x7ff5f40ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f40ab040 0x7ff5f40ab4b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 --2- 172.21.15.18:0/1162206792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e0003980 0x7ff5f41f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 >> 172.21.15.18:0/1162206792 conn(0x7ff5f40d2ae0 msgr2=0x7ff5f40cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 shutdown_connections 2023-06-09T04:38:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.402+0000 7ff5f978c640 1 -- 172.21.15.18:0/1162206792 wait complete. 2023-06-09T04:38:44.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:44.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.526+0000 7f5881864640 1 Processor -- start 2023-06-09T04:38:44.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.526+0000 7f5881864640 1 -- start start 2023-06-09T04:38:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f5881864640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c8dc0 0x7f587c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f5881864640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f587c0c9190 0x7f587c15f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f5881864640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c15c2d0 con 0x7f587c15f760 2023-06-09T04:38:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f5881864640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c15fce0 con 0x7f587c0c9190 2023-06-09T04:38:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f5881864640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c15ffc0 con 0x7f587c0c8dc0 2023-06-09T04:38:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587affd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c8dc0 0x7f587c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f587c0c9190 0x7f587c15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f587c15f760 0x7f587c06c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:38300/0 (socket says 172.21.15.18:38300) 2023-06-09T04:38:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587b7fe640 1 -- 172.21.15.18:0/2281562093 learned_addr learned my addr 172.21.15.18:0/2281562093 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587affd640 1 -- 172.21.15.18:0/2281562093 >> v2:172.21.15.81:3300/0 conn(0x7f587c0c9190 msgr2=0x7f587c15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587affd640 1 --2- 172.21.15.18:0/2281562093 >> v2:172.21.15.81:3300/0 conn(0x7f587c0c9190 0x7f587c15f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587affd640 1 -- 172.21.15.18:0/2281562093 >> v1:172.21.15.81:6789/0 conn(0x7f587c15f760 legacy=0x7f587c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587affd640 1 -- 172.21.15.18:0/2281562093 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c15bf60 con 0x7f587c0c8dc0 2023-06-09T04:38:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.530+0000 7f587a7fc640 1 --2- 172.21.15.18:0/2281562093 >> v2:172.21.15.81:3300/0 conn(0x7f587c0c9190 0x7f587c15f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f587affd640 1 --2- 172.21.15.18:0/2281562093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c8dc0 0x7f587c15c760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5874009d90 tx=0x7f587401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274af44d36aeb0dc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5879ffb640 1 -- 172.21.15.18:0/2281562093 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58740a59b0 con 0x7f587c0c8dc0 2023-06-09T04:38:44.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5879ffb640 1 -- 172.21.15.18:0/2281562093 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58740a5b10 con 0x7f587c0c8dc0 2023-06-09T04:38:44.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5879ffb640 1 -- 172.21.15.18:0/2281562093 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58740a5ea0 con 0x7f587c0c8dc0 2023-06-09T04:38:44.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- 172.21.15.18:0/2281562093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c8dc0 msgr2=0x7f587c15c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 --2- 172.21.15.18:0/2281562093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c8dc0 0x7f587c15c760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5874009d90 tx=0x7f587401c950 comp rx=0 tx=0).stop 2023-06-09T04:38:44.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- 172.21.15.18:0/2281562093 shutdown_connections 2023-06-09T04:38:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 --2- 172.21.15.18:0/2281562093 >> v2:172.21.15.81:3300/0 conn(0x7f587c0c9190 0x7f587c15f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 --2- 172.21.15.18:0/2281562093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c8dc0 0x7f587c15c760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- 172.21.15.18:0/2281562093 >> 172.21.15.18:0/2281562093 conn(0x7f587c0cb960 msgr2=0x7f587c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- 172.21.15.18:0/2281562093 shutdown_connections 2023-06-09T04:38:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- 172.21.15.18:0/2281562093 wait complete. 2023-06-09T04:38:44.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 Processor -- start 2023-06-09T04:38:44.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- start start 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f587c0c8dc0 0x7f587c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c9190 0x7f587c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 0x7f587c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c150b30 con 0x7f587c15f760 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c15e5b0 con 0x7f587c0c8dc0 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f5881864640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c15dc80 con 0x7f587c0c9190 2023-06-09T04:38:44.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f587b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 0x7f587c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f587b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 0x7f587c150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38750/0 (socket says 172.21.15.18:38750) 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f587b7fe640 1 -- 172.21.15.18:0/443245432 learned_addr learned my addr 172.21.15.18:0/443245432 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f587a7fc640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c9190 0x7f587c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.534+0000 7f587affd640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f587c0c8dc0 0x7f587c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587b7fe640 1 -- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c9190 msgr2=0x7f587c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587b7fe640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c9190 0x7f587c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587b7fe640 1 -- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f587c0c8dc0 msgr2=0x7f587c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587b7fe640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f587c0c8dc0 0x7f587c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587b7fe640 1 -- 172.21.15.18:0/443245432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009420 con 0x7f587c15f760 2023-06-09T04:38:44.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587b7fe640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 0x7f587c150150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c3c0 tx=0x7f586c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c005cf0 con 0x7f587c15f760 2023-06-09T04:38:44.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c005e50 con 0x7f587c15f760 2023-06-09T04:38:44.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5874009a70 con 0x7f587c15f760 2023-06-09T04:38:44.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0072f0 con 0x7f587c15f760 2023-06-09T04:38:44.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c15e240 con 0x7f587c15f760 2023-06-09T04:38:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c15e720 con 0x7f587c15f760 2023-06-09T04:38:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f586c007450 con 0x7f587c15f760 2023-06-09T04:38:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5873fff640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5864066280 0x7f5864068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f586c083520 con 0x7f587c15f760 2023-06-09T04:38:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587affd640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5864066280 0x7f5864068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.538+0000 7f587affd640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5864066280 0x7f5864068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58740af000 tx=0x7f5874004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.542+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f586c0506b0 con 0x7f587c15f760 2023-06-09T04:38:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.690+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f587c073380 con 0x7f587c15f760 2023-06-09T04:38:44.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.690+0000 7f5873fff640 1 -- 172.21.15.18:0/443245432 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f586c053cd0 con 0x7f587c15f760 2023-06-09T04:38:44.695 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:44.695 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5864066280 msgr2=0x7f5864068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5864066280 0x7f5864068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f58740af000 tx=0x7f5874004ac0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 msgr2=0x7f587c150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 0x7f587c150150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c3c0 tx=0x7f586c00c880 comp rx=0 tx=0).stop 2023-06-09T04:38:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 shutdown_connections 2023-06-09T04:38:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f587c15f760 0x7f587c150150 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5864066280 0x7f5864068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f587c0c9190 0x7f587c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 --2- 172.21.15.18:0/443245432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f587c0c8dc0 0x7f587c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 >> 172.21.15.18:0/443245432 conn(0x7f587c0cb960 msgr2=0x7f587c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 shutdown_connections 2023-06-09T04:38:44.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.694+0000 7f5881864640 1 -- 172.21.15.18:0/443245432 wait complete. 2023-06-09T04:38:44.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:44.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.826+0000 7f324a2eb640 1 Processor -- start 2023-06-09T04:38:44.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.826+0000 7f324a2eb640 1 -- start start 2023-06-09T04:38:44.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f324a2eb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3244070270 0x7f32441642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f324a2eb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324415cf10 con 0x7f3244159320 2023-06-09T04:38:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f324a2eb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324415dd90 con 0x7f324415a3e0 2023-06-09T04:38:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f324a2eb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32440c81b0 con 0x7f3244070270 2023-06-09T04:38:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3248888640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3244070270 0x7f32441642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3243fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3244159320 0x7f324415d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43746/0 (socket says 172.21.15.18:43746) 2023-06-09T04:38:44.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3243fff640 1 -- 172.21.15.18:0/2071120129 learned_addr learned my addr 172.21.15.18:0/2071120129 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:44.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3248888640 1 -- 172.21.15.18:0/2071120129 >> v1:172.21.15.81:6789/0 conn(0x7f324415a3e0 legacy=0x7f324406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:44.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3248888640 1 -- 172.21.15.18:0/2071120129 >> v1:172.21.15.18:6789/0 conn(0x7f3244159320 legacy=0x7f324415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3248888640 1 -- 172.21.15.18:0/2071120129 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32440c8490 con 0x7f3244070270 2023-06-09T04:38:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f3248888640 1 --2- 172.21.15.18:0/2071120129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f32441642a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f323c009d90 tx=0x7f323c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c71c4caf2184f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f32437fe640 1 -- 172.21.15.18:0/2071120129 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0a5910 con 0x7f3244070270 2023-06-09T04:38:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f32437fe640 1 -- 172.21.15.18:0/2071120129 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c0a5a70 con 0x7f3244070270 2023-06-09T04:38:44.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.830+0000 7f32437fe640 1 -- 172.21.15.18:0/2071120129 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c0a5e00 con 0x7f3244070270 2023-06-09T04:38:44.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/2071120129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 msgr2=0x7f32441642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 --2- 172.21.15.18:0/2071120129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f32441642a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f323c009d90 tx=0x7f323c01c850 comp rx=0 tx=0).stop 2023-06-09T04:38:44.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/2071120129 shutdown_connections 2023-06-09T04:38:44.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 --2- 172.21.15.18:0/2071120129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f32441642a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/2071120129 >> 172.21.15.18:0/2071120129 conn(0x7f32440b0240 msgr2=0x7f32440cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:44.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/2071120129 shutdown_connections 2023-06-09T04:38:44.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/2071120129 wait complete. 2023-06-09T04:38:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 Processor -- start 2023-06-09T04:38:44.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- start start 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f3244143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3244159320 0x7f324415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f324415a3e0 0x7f3244159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324415cc70 con 0x7f3244070270 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324415c6b0 con 0x7f3244159320 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324415c990 con 0x7f324415a3e0 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f3244143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f3244143d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38760/0 (socket says 172.21.15.18:38760) 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 -- 172.21.15.18:0/1603515052 learned_addr learned my addr 172.21.15.18:0/1603515052 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f323bfff640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3244159320 0x7f324415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3248888640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f324415a3e0 0x7f3244159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 -- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f324415a3e0 msgr2=0x7f3244159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f324415a3e0 0x7f3244159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 -- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3244159320 msgr2=0x7f324415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:44.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3244159320 0x7f324415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:44.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 -- 172.21.15.18:0/1603515052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c009a70 con 0x7f3244070270 2023-06-09T04:38:44.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f3243fff640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f3244143d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f323400c500 tx=0x7f323400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234005cf0 con 0x7f3244070270 2023-06-09T04:38:44.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234005e50 con 0x7f3244070270 2023-06-09T04:38:44.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32440c4c30 con 0x7f3244070270 2023-06-09T04:38:44.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340072f0 con 0x7f3244070270 2023-06-09T04:38:44.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.834+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32440c12d0 con 0x7f3244070270 2023-06-09T04:38:44.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.838+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324415a810 con 0x7f3244070270 2023-06-09T04:38:44.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.838+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3234007450 con 0x7f3244070270 2023-06-09T04:38:44.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.838+0000 7f32417fa640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f32240662b0 0x7f3224068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:44.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.838+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3234083460 con 0x7f3244070270 2023-06-09T04:38:44.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.838+0000 7f323bfff640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f32240662b0 0x7f3224068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:44.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.838+0000 7f323bfff640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f32240662b0 0x7f3224068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f322c00b810 tx=0x7f322c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:44.844 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:44.842+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f324415a810 con 0x7f3244070270 2023-06-09T04:38:45.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32440c5150 con 0x7f3244070270 2023-06-09T04:38:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f32417fa640 1 -- 172.21.15.18:0/1603515052 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f32440c5150 con 0x7f3244070270 2023-06-09T04:38:45.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:45.025 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:38:45.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f32240662b0 msgr2=0x7f3224068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f32240662b0 0x7f3224068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f322c00b810 tx=0x7f322c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:45.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 msgr2=0x7f3244143d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f3244143d90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f323400c500 tx=0x7f323400c9c0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 shutdown_connections 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f32240662b0 0x7f3224068760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f324415a3e0 0x7f3244159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3244159320 0x7f324415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 --2- 172.21.15.18:0/1603515052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3244070270 0x7f3244143d90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 >> 172.21.15.18:0/1603515052 conn(0x7f32440b0240 msgr2=0x7f324414deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 shutdown_connections 2023-06-09T04:38:45.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.022+0000 7f324a2eb640 1 -- 172.21.15.18:0/1603515052 wait complete. 2023-06-09T04:38:45.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:38:11.545685+0000', 'modified': '2023-06-09T04:38:34.028935+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/1214100469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 1214100469}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 1214100469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:38:45.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:38:45.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-09T04:38:45.578 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.574+0000 7f82f18e1640 1 Processor -- start 2023-06-09T04:38:45.578 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.574+0000 7f82f18e1640 1 -- start start 2023-06-09T04:38:45.579 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82ec159300 0x7f82ec15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82ec0cbe00 0x7f82ec0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ec0cd820 con 0x7f82ec0ccba0 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec0ca2a0 con 0x7f82ec159300 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec15dee0 con 0x7f82ec0cbe00 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82ec159300 0x7f82ec15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82ec159300 0x7f82ec15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38764/0 (socket says 172.21.15.18:38764) 2023-06-09T04:38:45.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 -- 172.21.15.18:0/3261827835 learned_addr learned my addr 172.21.15.18:0/3261827835 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:45.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82e27fc640 1 --2- 172.21.15.18:0/3261827835 >> v2:172.21.15.81:3300/0 conn(0x7f82ec0cbe00 0x7f82ec0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 -- 172.21.15.18:0/3261827835 >> v2:172.21.15.81:3300/0 conn(0x7f82ec0cbe00 msgr2=0x7f82ec0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 --2- 172.21.15.18:0/3261827835 >> v2:172.21.15.81:3300/0 conn(0x7f82ec0cbe00 0x7f82ec0cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 -- 172.21.15.18:0/3261827835 >> v1:172.21.15.81:6789/0 conn(0x7f82ec0ccba0 legacy=0x7f82ec0b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 -- 172.21.15.18:0/3261827835 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0cd000 con 0x7f82ec159300 2023-06-09T04:38:45.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82eaffd640 1 --2- 172.21.15.18:0/3261827835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec159300 0x7f82ec15d9a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f82ec071b10 tx=0x7f82dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6000f4f03dc914d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82ea7fc640 1 -- 172.21.15.18:0/3261827835 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0ab600 con 0x7f82ec159300 2023-06-09T04:38:45.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82ea7fc640 1 -- 172.21.15.18:0/3261827835 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0a7050 con 0x7f82ec159300 2023-06-09T04:38:45.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82ea7fc640 1 -- 172.21.15.18:0/3261827835 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0ab980 con 0x7f82ec159300 2023-06-09T04:38:45.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 -- 172.21.15.18:0/3261827835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec159300 msgr2=0x7f82ec15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.578+0000 7f82f18e1640 1 --2- 172.21.15.18:0/3261827835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec159300 0x7f82ec15d9a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f82ec071b10 tx=0x7f82dc01c470 comp rx=0 tx=0).stop 2023-06-09T04:38:45.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- 172.21.15.18:0/3261827835 shutdown_connections 2023-06-09T04:38:45.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 --2- 172.21.15.18:0/3261827835 >> v2:172.21.15.81:3300/0 conn(0x7f82ec0cbe00 0x7f82ec0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 --2- 172.21.15.18:0/3261827835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec159300 0x7f82ec15d9a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- 172.21.15.18:0/3261827835 >> 172.21.15.18:0/3261827835 conn(0x7f82ec06f850 msgr2=0x7f82ec06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- 172.21.15.18:0/3261827835 shutdown_connections 2023-06-09T04:38:45.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- 172.21.15.18:0/3261827835 wait complete. 2023-06-09T04:38:45.586 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 Processor -- start 2023-06-09T04:38:45.586 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- start start 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 0x7f82ec14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec0ccba0 0x7f82ec0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82ec159300 0x7f82ec0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec14fbf0 con 0x7f82ec0cbe00 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0b56a0 con 0x7f82ec0ccba0 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0b4600 con 0x7f82ec159300 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 0x7f82ec14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 0x7f82ec14f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38770/0 (socket says 172.21.15.18:38770) 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 -- 172.21.15.18:0/2544461072 learned_addr learned my addr 172.21.15.18:0/2544461072 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82ec159300 0x7f82ec0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec0ccba0 0x7f82ec0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 -- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82ec159300 msgr2=0x7f82ec0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82ec159300 0x7f82ec0b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 -- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec0ccba0 msgr2=0x7f82ec0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec0ccba0 0x7f82ec0b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 -- 172.21.15.18:0/2544461072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0094d0 con 0x7f82ec0cbe00 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec0ccba0 0x7f82ec0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82eaffd640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 0x7f82ec14f6b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0ae040 tx=0x7f82dc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82e8ff9640 1 -- 172.21.15.18:0/2544461072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0b6620 con 0x7f82ec0cbe00 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82e8ff9640 1 -- 172.21.15.18:0/2544461072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0b67a0 con 0x7f82ec0cbe00 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec0b48e0 con 0x7f82ec0cbe00 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82e8ff9640 1 -- 172.21.15.18:0/2544461072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0b6b50 con 0x7f82ec0cbe00 2023-06-09T04:38:45.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.582+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec0b4ea0 con 0x7f82ec0cbe00 2023-06-09T04:38:45.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e8ff9640 1 -- 172.21.15.18:0/2544461072 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82dc0b2040 con 0x7f82ec0cbe00 2023-06-09T04:38:45.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e8ff9640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82cc066280 0x7f82cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e8ff9640 1 -- 172.21.15.18:0/2544461072 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82dc11e430 con 0x7f82ec0cbe00 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82cc066280 0x7f82cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 Processor -- start 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 -- start start 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82cc066280 0x7f82cc068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0b5960 tx=0x7f82d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604e150 0x558a5604e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a560043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a56004920 0x558a56004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55ecc540 con 0x558a5604ea60 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55e05840 con 0x558a56004920 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a55e58e60 con 0x558a5604e150 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a560043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a560043e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38784/0 (socket says 172.21.15.18:38784) 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 -- 172.21.15.18:0/167148805 learned_addr learned my addr 172.21.15.18:0/167148805 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a56004920 0x558a56004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82eaffd640 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604e150 0x558a5604e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 -- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604e150 msgr2=0x558a5604e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604e150 0x558a5604e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 -- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a56004920 msgr2=0x558a56004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a56004920 0x558a56004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 -- 172.21.15.18:0/167148805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a55b4e890 con 0x558a5604ea60 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82eaffd640 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604e150 0x558a5604e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:45.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e27fc640 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a560043e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82d4004380 tx=0x7f82d4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69141328259cb597 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e17fa640 1 -- 172.21.15.18:0/167148805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d401d070 con 0x558a5604ea60 2023-06-09T04:38:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e17fa640 1 -- 172.21.15.18:0/167148805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4004470 con 0x558a5604ea60 2023-06-09T04:38:45.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.586+0000 7f82e17fa640 1 -- 172.21.15.18:0/167148805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4003820 con 0x558a5604ea60 2023-06-09T04:38:45.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/167148805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 msgr2=0x558a560043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a560043e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82d4004380 tx=0x7f82d4011000 comp rx=0 tx=0).stop 2023-06-09T04:38:45.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/167148805 shutdown_connections 2023-06-09T04:38:45.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a56004920 0x558a56004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a560043e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- 172.21.15.18:0/167148805 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604e150 0x558a5604e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/167148805 >> 172.21.15.18:0/167148805 conn(0x558a55eaa370 msgr2=0x558a56002cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/167148805 shutdown_connections 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/167148805 wait complete. 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- start start 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 Processor -- start 2023-06-09T04:38:45.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a560099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 0x558a5600f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604ea60 0x558a5600fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55e51f00 con 0x558a5604e150 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55e0eae0 con 0x558a5604ea60 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a55e0e780 con 0x558a56004920 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 10 client.0 _ll_register_callbacks cb 0x558a55ff0060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 0x558a5600f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 0x558a5600f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38800/0 (socket says 172.21.15.18:38800) 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 -- 172.21.15.18:0/312091946 learned_addr learned my addr 172.21.15.18:0/312091946 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82eaffd640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a560099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604ea60 0x558a5600fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 -- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 msgr2=0x558a560099a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a560099a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 -- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604ea60 msgr2=0x558a5600fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604ea60 0x558a5600fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 -- 172.21.15.18:0/312091946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d4004030 con 0x558a5604e150 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604ea60 0x558a5600fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82e27fc640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 0x558a5600f530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f82d4003d00 tx=0x7f82d4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f185a33736cc38 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82ca7fc640 1 -- 172.21.15.18:0/312091946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d402a640 con 0x558a5604e150 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82ca7fc640 1 -- 172.21.15.18:0/312091946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82d402a7a0 con 0x558a5604e150 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a55e0b2d0 con 0x558a5604e150 2023-06-09T04:38:45.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82ca7fc640 1 -- 172.21.15.18:0/312091946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82d4003e60 con 0x558a5604e150 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 10 client.4914 fetch_fsmap learned FSMap version 8 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558a55e16d10 con 0x558a5604e150 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82ca7fc640 1 -- 172.21.15.18:0/312091946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a55e0b2d0 con 0x558a5604e150 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82ca7fc640 1 -- 172.21.15.18:0/312091946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f82d402a960 con 0x558a5604e150 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 10 client.4914 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 10 client.4914 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 20 client.4914 populate_metadata read hostname 'smithi018' 2023-06-09T04:38:45.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56054770 0x558a56054b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 4 client.4914 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 --> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a55e50850 con 0x558a56054770 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.590+0000 7f82eaffd640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56054770 0x558a56054b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82eaffd640 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56054770 0x558a56054b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1638de7f8682455 server_cookie=44173dad1348a773 in_seq=0 out_seq=0 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82ca7fc640 10 client.4914 ms_handle_connect on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82ca7fc640 1 -- 172.21.15.18:0/312091946 <== mds.0 v2:172.21.15.81:6835/1214100469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558a55e50850 con 0x558a56054770 2023-06-09T04:38:45.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82ca7fc640 10 client.4914 handle_command_reply: tid=0 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 client.4914 shutdown 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 msgr2=0x558a5600f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 0x558a5600f530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f82d4003d00 tx=0x7f82d4004740 comp rx=0 tx=0).stop 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 shutdown_connections 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604ea60 0x558a5600fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604e150 0x558a5600f530 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56054770 0x558a56054b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 --2- 172.21.15.18:0/312091946 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a560099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82ca7fc640 0 client.4914 ms_handle_reset on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 >> 172.21.15.18:0/312091946 conn(0x558a55eaa370 msgr2=0x558a560033c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 shutdown_connections 2023-06-09T04:38:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 1 -- 172.21.15.18:0/312091946 wait complete. 2023-06-09T04:38:45.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.594+0000 7f82f49fd000 20 client.4914 trim_cache size 0 max 16384 2023-06-09T04:38:45.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 Processor -- start 2023-06-09T04:38:45.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- start start 2023-06-09T04:38:45.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a5604d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a5604da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a5604ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55b0f940 con 0x558a5604ea60 2023-06-09T04:38:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55e20e10 con 0x558a5604e150 2023-06-09T04:38:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a55dff130 con 0x558a56004920 2023-06-09T04:38:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a5604ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a5604ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38806/0 (socket says 172.21.15.18:38806) 2023-06-09T04:38:45.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 -- 172.21.15.18:0/4081495120 learned_addr learned my addr 172.21.15.18:0/4081495120 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:45.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 -- 172.21.15.18:0/4081495120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 msgr2=0x558a5604d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a5604d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 -- 172.21.15.18:0/4081495120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 msgr2=0x558a5604da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a5604da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 -- 172.21.15.18:0/4081495120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a55dfcfa0 con 0x558a5604ea60 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82eb7fe640 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a5604ee30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f82e4003f40 tx=0x7f82e40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb08b65ae5d90a87 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82e1ffb640 1 -- 172.21.15.18:0/4081495120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e401a070 con 0x558a5604ea60 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82e1ffb640 1 -- 172.21.15.18:0/4081495120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e4006b60 con 0x558a5604ea60 2023-06-09T04:38:45.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82e1ffb640 1 -- 172.21.15.18:0/4081495120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4001770 con 0x558a5604ea60 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- 172.21.15.18:0/4081495120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 msgr2=0x558a5604ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a5604ee30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f82e4003f40 tx=0x7f82e40054e0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- 172.21.15.18:0/4081495120 shutdown_connections 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a5604ea60 0x558a5604ee30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a5604da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 --2- 172.21.15.18:0/4081495120 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a56004920 0x558a5604d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- 172.21.15.18:0/4081495120 >> 172.21.15.18:0/4081495120 conn(0x558a55eaa370 msgr2=0x558a56008a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- 172.21.15.18:0/4081495120 shutdown_connections 2023-06-09T04:38:45.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- 172.21.15.18:0/4081495120 wait complete. 2023-06-09T04:38:45.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 -- start start 2023-06-09T04:38:45.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.610+0000 7f82f49fd000 1 Processor -- start 2023-06-09T04:38:45.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 0x558a560abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a560ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604ea60 0x558a56052140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55dfa450 con 0x558a56004920 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a55e51710 con 0x558a5604e150 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a5600a2c0 con 0x558a5604ea60 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 10 client.0 _ll_register_callbacks cb 0x558a55df12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 0x558a560abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 0x558a560abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38820/0 (socket says 172.21.15.18:38820) 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 -- 172.21.15.18:0/2400439923 learned_addr learned my addr 172.21.15.18:0/2400439923 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a560ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 -- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604ea60 msgr2=0x558a56052140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604ea60 0x558a56052140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 -- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 msgr2=0x558a560ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:45.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a560ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 -- 172.21.15.18:0/2400439923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec0cd820 con 0x558a56004920 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82eaffd640 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 0x558a560abe50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0ef200 tx=0x7f82dc0eb5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21eab5f5e8f5df8d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 1 -- 172.21.15.18:0/2400439923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc0ed6d0 con 0x558a56004920 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 1 -- 172.21.15.18:0/2400439923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82dc0ee760 con 0x558a56004920 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a55dd9a80 con 0x558a56004920 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 1 -- 172.21.15.18:0/2400439923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82dc0ee920 con 0x558a56004920 2023-06-09T04:38:45.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 10 client.4920 fetch_fsmap learned FSMap version 8 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558a55b4ecc0 con 0x558a56004920 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 1 -- 172.21.15.18:0/2400439923 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a55dd9a80 con 0x558a56004920 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 1 -- 172.21.15.18:0/2400439923 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f82dc0f7130 con 0x558a56004920 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 10 client.4920 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 10 client.4920 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 20 client.4920 populate_metadata read hostname 'smithi018' 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56052b00 0x558a56052ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:45.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 4 client.4920 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 --> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558a55e4aee0 con 0x558a56052b00 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56052b00 0x558a56052ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 10 client.4920 ms_handle_connect on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82e27fc640 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56052b00 0x558a56052ed0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fbfd94699a5eecf server_cookie=c0b100c1469050ee in_seq=0 out_seq=0 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 1 -- 172.21.15.18:0/2400439923 <== mds.0 v2:172.21.15.81:6835/1214100469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558a55e4aee0 con 0x558a56052b00 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 10 client.4920 handle_command_reply: tid=0 2023-06-09T04:38:45.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 client.4920 shutdown 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 msgr2=0x558a560abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 0x558a560abe50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0ef200 tx=0x7f82dc0eb5b0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 shutdown_connections 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:6835/1214100469,v1:172.21.15.81:6837/1214100469] conn(0x558a56052b00 0x558a56052ed0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x558a5604ea60 0x558a56052140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558a5604e150 0x558a560ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82ca7fc640 0 client.4920 ms_handle_reset on v2:172.21.15.81:6835/1214100469 2023-06-09T04:38:45.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 --2- 172.21.15.18:0/2400439923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558a56004920 0x558a560abe50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 >> 172.21.15.18:0/2400439923 conn(0x558a55eaa370 msgr2=0x558a56008a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 shutdown_connections 2023-06-09T04:38:45.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 1 -- 172.21.15.18:0/2400439923 wait complete. 2023-06-09T04:38:45.627 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.614+0000 7f82f49fd000 20 client.4920 trim_cache size 0 max 16384 2023-06-09T04:38:45.627 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "eb85c981-43c8-4596-9c30-77e5bafdb8a3", 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4294, 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2023-06-09T04:38:45.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 34.066865071000002, 2023-06-09T04:38:45.629 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 8, 2023-06-09T04:38:45.629 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 28, 2023-06-09T04:38:45.629 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 28, 2023-06-09T04:38:45.629 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 38.506029052999999 2023-06-09T04:38:45.629 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:38:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82cc066280 msgr2=0x7f82cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82cc066280 0x7f82cc068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0b5960 tx=0x7f82d4008040 comp rx=0 tx=0).stop 2023-06-09T04:38:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 msgr2=0x7f82ec14f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 0x7f82ec14f6b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0ae040 tx=0x7f82dc01acb0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 shutdown_connections 2023-06-09T04:38:45.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f82cc066280 0x7f82cc068730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f82ec159300 0x7f82ec0b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82ec0ccba0 0x7f82ec0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 --2- 172.21.15.18:0/2544461072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec0cbe00 0x7f82ec14f6b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 >> 172.21.15.18:0/2544461072 conn(0x7f82ec06f850 msgr2=0x7f82ec0d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 shutdown_connections 2023-06-09T04:38:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:45.618+0000 7f82f18e1640 1 -- 172.21.15.18:0/2544461072 wait complete. 2023-06-09T04:38:45.635 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-06-09T04:38:45.645 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-06-09T04:38:45.646 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-09T04:38:45.646 INFO:tasks.ceph_fuse:client.0 config is {} 2023-06-09T04:38:45.646 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:45.646 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:45.646 INFO:tasks.ceph_fuse:client.2 config is {} 2023-06-09T04:38:45.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:45.647 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:45.647 INFO:tasks.ceph_fuse:client.1 config is {} 2023-06-09T04:38:45.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:45.647 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:45.648 INFO:tasks.ceph_fuse:client.3 config is {} 2023-06-09T04:38:45.648 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:38:45.648 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:45.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:45.648 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-06-09T04:38:45.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:45.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-06-09T04:38:45.712 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-06-09T04:38:45.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:38:45.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:45.715 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2023-06-09T04:38:45.721 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-09T04:38:45.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:45.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-09T04:38:45.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:45.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2023-06-09T04:38:45.977 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-06-09T04:38:45.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:46.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 Processor -- start 2023-06-09T04:38:46.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 -- start start 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc8c0157dc0 0x7fc8c00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8c00acd10 0x7fc8c00cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00ce0d0 0x7fc8c006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00cbdc0 con 0x7fc8c00acd10 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00c9010 con 0x7fc8c0157dc0 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8c5c56640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c8460 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8c00acd10 0x7fc8c00cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8c00acd10 0x7fc8c00cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38822/0 (socket says 172.21.15.18:38822) 2023-06-09T04:38:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/177741115 learned_addr learned my addr 172.21.15.18:0/177741115 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/177741115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00ce0d0 msgr2=0x7fc8c006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 --2- 172.21.15.18:0/177741115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00ce0d0 0x7fc8c006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/177741115 >> v2:172.21.15.81:3300/0 conn(0x7fc8c0157dc0 msgr2=0x7fc8c00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 --2- 172.21.15.18:0/177741115 >> v2:172.21.15.81:3300/0 conn(0x7fc8c0157dc0 0x7fc8c00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/177741115 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00ad160 con 0x7fc8c00acd10 2023-06-09T04:38:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.106+0000 7fc8b6ffd640 1 --2- 172.21.15.18:0/177741115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00acd10 0x7fc8c00cb880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00ce9e0 tx=0x7fc8a801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb2be8ad92e9005 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8beffd640 1 -- 172.21.15.18:0/177741115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80a89b0 con 0x7fc8c00acd10 2023-06-09T04:38:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8beffd640 1 -- 172.21.15.18:0/177741115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a80a8b10 con 0x7fc8c00acd10 2023-06-09T04:38:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8beffd640 1 -- 172.21.15.18:0/177741115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80a8ea0 con 0x7fc8c00acd10 2023-06-09T04:38:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- 172.21.15.18:0/177741115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00acd10 msgr2=0x7fc8c00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/177741115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00acd10 0x7fc8c00cb880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00ce9e0 tx=0x7fc8a801ecf0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- 172.21.15.18:0/177741115 shutdown_connections 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/177741115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00ce0d0 0x7fc8c006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/177741115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00acd10 0x7fc8c00cb880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/177741115 >> v2:172.21.15.81:3300/0 conn(0x7fc8c0157dc0 0x7fc8c00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- 172.21.15.18:0/177741115 >> 172.21.15.18:0/177741115 conn(0x7fc8c00b0240 msgr2=0x7fc8c00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:46.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- 172.21.15.18:0/177741115 shutdown_connections 2023-06-09T04:38:46.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- 172.21.15.18:0/177741115 wait complete. 2023-06-09T04:38:46.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 Processor -- start 2023-06-09T04:38:46.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- start start 2023-06-09T04:38:46.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00acd10 0x7fc8c01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 0x7fc8c00aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c0157dc0 0x7fc8c01609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c6ef0 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c01545f0 con 0x7fc8c0157dc0 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8c5c56640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c6000 con 0x7fc8c00acd10 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8b6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 0x7fc8c00aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8b6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 0x7fc8c00aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38836/0 (socket says 172.21.15.18:38836) 2023-06-09T04:38:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.110+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/1383001522 learned_addr learned my addr 172.21.15.18:0/1383001522 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bf7fe640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00acd10 0x7fc8c01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00acd10 msgr2=0x7fc8c01540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8b6ffd640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00acd10 0x7fc8c01540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c0157dc0 msgr2=0x7fc8c01609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bffff640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c0157dc0 0x7fc8c01609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8b6ffd640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c0157dc0 0x7fc8c01609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8b6ffd640 1 -- 172.21.15.18:0/1383001522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80094d0 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bffff640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c0157dc0 0x7fc8c01609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8b6ffd640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 0x7fc8c00aec20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc8a801f590 tx=0x7fc8a801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80b0e00 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a80b9440 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c00c62e0 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80b97f0 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c00c68a0 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c00af160 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.119 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8a80b7070 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bcff9640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc8a0066280 0x7fc8a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8a8121da0 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bf7fe640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc8a0066280 0x7fc8a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.114+0000 7fc8bf7fe640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc8a0066280 0x7fc8a0068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000a830 tx=0x7fc8b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:46.122 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.118+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8a80eee90 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.306 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.302+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8c00af160 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.302+0000 7fc8bcff9640 1 -- 172.21.15.18:0/1383001522 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc8a80b5070 con 0x7fc8c00ce0d0 2023-06-09T04:38:46.307 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:38:46.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc8a0066280 msgr2=0x7fc8a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc8a0066280 0x7fc8a0068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000a830 tx=0x7fc8b0008040 comp rx=0 tx=0).stop 2023-06-09T04:38:46.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 msgr2=0x7fc8c00aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:46.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 0x7fc8c00aec20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc8a801f590 tx=0x7fc8a801ba90 comp rx=0 tx=0).stop 2023-06-09T04:38:46.309 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 shutdown_connections 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c0157dc0 0x7fc8c01609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8c00ce0d0 0x7fc8c00aec20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc8a0066280 0x7fc8a0068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 --2- 172.21.15.18:0/1383001522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc8c00acd10 0x7fc8c01540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 >> 172.21.15.18:0/1383001522 conn(0x7fc8c00b0240 msgr2=0x7fc8c00692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 shutdown_connections 2023-06-09T04:38:46.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:46.306+0000 7fc8c5c56640 1 -- 172.21.15.18:0/1383001522 wait complete. 2023-06-09T04:38:46.324 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:46.324 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:46.324 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2023-06-09T04:38:46.325 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:38:46.325 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:46.325 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:46.325 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:46.325 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:46.325 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:46.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.326 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2023-06-09T04:38:46.331 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42463sec preferred_lft 42463sec 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2023-06-09T04:38:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:12:fb:92:ca brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:38:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:46.335 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:38:46.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.335 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:46.335 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:46.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:38:46.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2023-06-09T04:38:46.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2023-06-09T04:38:46.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:38:46.336 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:46.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.406 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:46.455 INFO:teuthology.orchestra.run.smithi018.stdout:1 2023-06-09T04:38:46.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.457 DEBUG:teuthology.orchestra.run.smithi018:> route 2023-06-09T04:38:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2023-06-09T04:38:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-09T04:38:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:38:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-09T04:38:46.504 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:46.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.505 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:46.505 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:46.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:38:46.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:38:46.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:38:46.506 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:46.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.580 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2023-06-09T04:38:46.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.628 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2023-06-09T04:38:46.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.676 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:46.676 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:46.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:38:46.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-09T04:38:46.677 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:46.746 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-09T04:38:46.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.747 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:46.747 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:46.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-09T04:38:46.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:46.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-09T04:38:46.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-09T04:38:46.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-09T04:38:46.748 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:46.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:46.840 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:46.840 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:46.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2023-06-09T04:38:46.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:38:46.841 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:46.859 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-09T04:38:46.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:46.860 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:46.911 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:46.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:46.911 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:46.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:47.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:47.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:47.065 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:47.066 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:47.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:47.067 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:47.112 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:38:47.112 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-09T04:38:47.156 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:47.171 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:47.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:47.229 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:47.230 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:47.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:47.231 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:47.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:2023-06-09T04:38:47.238+0000 7f62d41cc580 -1 init, newargv = 0x55bceca695d0 newargc=15 2023-06-09T04:38:47.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[45336]: starting ceph client 2023-06-09T04:38:47.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[45336]: starting fuse 2023-06-09T04:38:48.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:48.365 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:48.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:48.419 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:48.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:48.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:48.422 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:48.467 INFO:teuthology.orchestra.run.smithi018.stdout:45 2023-06-09T04:38:48.468 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-09T04:38:48.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:48.468 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2023-06-09T04:38:48.469 DEBUG:teuthology.orchestra.run.smithi018:> import re 2023-06-09T04:38:48.469 DEBUG:teuthology.orchestra.run.smithi018:> import os 2023-06-09T04:38:48.469 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2023-06-09T04:38:48.469 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:48.470 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2023-06-09T04:38:48.470 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-09T04:38:48.470 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2023-06-09T04:38:48.470 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-09T04:38:48.470 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:48.471 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2023-06-09T04:38:48.471 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2023-06-09T04:38:48.471 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2023-06-09T04:38:48.471 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2023-06-09T04:38:48.472 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:48.472 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2023-06-09T04:38:48.472 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:48.472 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:48.472 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:48.473 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2023-06-09T04:38:48.473 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2023-06-09T04:38:48.473 DEBUG:teuthology.orchestra.run.smithi018:> return f 2023-06-09T04:38:48.473 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:48.474 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:48.474 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.0")) 2023-06-09T04:38:48.474 DEBUG:teuthology.orchestra.run.smithi018:> ' 2023-06-09T04:38:48.592 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.0.45336.asok 2023-06-09T04:38:48.773 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45336.asok 2023-06-09T04:38:48.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:48.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45336.asok status 2023-06-09T04:38:48.932 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "0", 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-09T04:38:48.933 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "45336", 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4932, 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2023-06-09T04:38:48.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4932 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 854189921 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:38:48.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 854189921 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4932 192.168.0.1:0/854189921", 2023-06-09T04:38:48.936 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/854189921", 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 8, 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 28, 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2023-06-09T04:38:48.937 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:38:48.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.066+0000 7f79128df640 1 Processor -- start 2023-06-09T04:38:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.066+0000 7f79128df640 1 -- start start 2023-06-09T04:38:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f79128df640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f79128df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790c15d680 0x7f790c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f79128df640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f790c15dad0 0x7f790c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f79128df640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c15a920 con 0x7f790c15dad0 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f79128df640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c15cf10 con 0x7f790c15d680 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f79128df640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c81b0 con 0x7f790c159320 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f790c15dad0 0x7f790c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f790c15dad0 0x7f790c0700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45482/0 (socket says 172.21.15.18:45482) 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 -- 172.21.15.18:0/3944615982 learned_addr learned my addr 172.21.15.18:0/3944615982 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:49.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790bfff640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 -- 172.21.15.18:0/3944615982 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 msgr2=0x7f790c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:49.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790b7fe640 1 --2- 172.21.15.18:0/3944615982 >> v2:172.21.15.81:3300/0 conn(0x7f790c15d680 0x7f790c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 -- 172.21.15.18:0/3944615982 >> v2:172.21.15.81:3300/0 conn(0x7f790c15d680 msgr2=0x7f790c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:49.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 --2- 172.21.15.18:0/3944615982 >> v2:172.21.15.81:3300/0 conn(0x7f790c15d680 0x7f790c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 -- 172.21.15.18:0/3944615982 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0c8490 con 0x7f790c15dad0 2023-06-09T04:38:49.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790bfff640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:49.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790b7fe640 1 --2- 172.21.15.18:0/3944615982 >> v2:172.21.15.81:3300/0 conn(0x7f790c15d680 0x7f790c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:49.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f7910e7c640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15dad0 0x7f790c0700a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f790c06b7a0 tx=0x7f790401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05e1a19e2923fbd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790affd640 1 -- 172.21.15.18:0/3944615982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040a57c0 con 0x7f790c15dad0 2023-06-09T04:38:49.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790affd640 1 -- 172.21.15.18:0/3944615982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79040a5920 con 0x7f790c15dad0 2023-06-09T04:38:49.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.070+0000 7f790affd640 1 -- 172.21.15.18:0/3944615982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040a5cb0 con 0x7f790c15dad0 2023-06-09T04:38:49.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 -- 172.21.15.18:0/3944615982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15dad0 msgr2=0x7f790c0700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15dad0 0x7f790c0700a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f790c06b7a0 tx=0x7f790401c940 comp rx=0 tx=0).stop 2023-06-09T04:38:49.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 -- 172.21.15.18:0/3944615982 shutdown_connections 2023-06-09T04:38:49.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15dad0 0x7f790c0700a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 --2- 172.21.15.18:0/3944615982 >> v2:172.21.15.81:3300/0 conn(0x7f790c15d680 0x7f790c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 --2- 172.21.15.18:0/3944615982 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 -- 172.21.15.18:0/3944615982 >> 172.21.15.18:0/3944615982 conn(0x7f790c0b0240 msgr2=0x7f790c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 -- 172.21.15.18:0/3944615982 shutdown_connections 2023-06-09T04:38:49.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 -- 172.21.15.18:0/3944615982 wait complete. 2023-06-09T04:38:49.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 Processor -- start 2023-06-09T04:38:49.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.074+0000 7f79128df640 1 -- start start 2023-06-09T04:38:49.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c0b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 0x7f790c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c15dad0 0x7f790c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c15ccd0 con 0x7f790c15d680 2023-06-09T04:38:49.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c54a0 con 0x7f790c15dad0 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0b0fb0 con 0x7f790c159320 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 0x7f790c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 0x7f790c15c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45490/0 (socket says 172.21.15.18:45490) 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 -- 172.21.15.18:0/1558107050 learned_addr learned my addr 172.21.15.18:0/1558107050 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790bfff640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c0b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f7910e7c640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c15dad0 0x7f790c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 -- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 msgr2=0x7f790c0b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c0b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 -- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c15dad0 msgr2=0x7f790c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c15dad0 0x7f790c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 -- 172.21.15.18:0/1558107050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904009b30 con 0x7f790c15d680 2023-06-09T04:38:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f790b7fe640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 0x7f790c15c790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f790000c7c0 tx=0x7f790000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900007a30 con 0x7f790c15d680 2023-06-09T04:38:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900007b90 con 0x7f790c15d680 2023-06-09T04:38:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000ce70 con 0x7f790c15d680 2023-06-09T04:38:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0c72e0 con 0x7f790c15d680 2023-06-09T04:38:49.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c0c78a0 con 0x7f790c15d680 2023-06-09T04:38:49.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c073380 con 0x7f790c15d680 2023-06-09T04:38:49.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.078+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79000113f0 con 0x7f790c15d680 2023-06-09T04:38:49.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.082+0000 7f7908ff9640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f78f8066280 0x7f78f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:49.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.082+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f79000843c0 con 0x7f790c15d680 2023-06-09T04:38:49.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.082+0000 7f790bfff640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f78f8066280 0x7f78f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:49.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.082+0000 7f790bfff640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f78f8066280 0x7f78f8068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00ab60 tx=0x7f78fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:49.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.086+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7900051600 con 0x7f790c15d680 2023-06-09T04:38:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.274+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f790c06a7c0 con 0x7f790c15d680 2023-06-09T04:38:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.274+0000 7f7908ff9640 1 -- 172.21.15.18:0/1558107050 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7900054c20 con 0x7f790c15d680 2023-06-09T04:38:49.278 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f78f8066280 msgr2=0x7f78f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f78f8066280 0x7f78f8068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00ab60 tx=0x7f78fc008040 comp rx=0 tx=0).stop 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 msgr2=0x7f790c15c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 0x7f790c15c790 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f790000c7c0 tx=0x7f790000cc80 comp rx=0 tx=0).stop 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 shutdown_connections 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c15dad0 0x7f790c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c15d680 0x7f790c15c790 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f78f8066280 0x7f78f8068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 --2- 172.21.15.18:0/1558107050 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f790c159320 0x7f790c0b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 >> 172.21.15.18:0/1558107050 conn(0x7f790c0b0240 msgr2=0x7f790c15b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 shutdown_connections 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:49.278+0000 7f79128df640 1 -- 172.21.15.18:0/1558107050 wait complete. 2023-06-09T04:38:49.297 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:49.297 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:49.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2023-06-09T04:38:49.298 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-09T04:38:49.298 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:49.298 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:49.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:49.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:49.299 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:38:49.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.299 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2023-06-09T04:38:49.304 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:49.305 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:49.305 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:49.305 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.305 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:49.305 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.305 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:49.306 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42460sec preferred_lft 42460sec 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2023-06-09T04:38:49.307 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:12:fb:92:ca brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.308 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-09T04:38:49.309 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.309 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:38:49.309 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:38:49.309 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-09T04:38:49.309 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.310 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:49.358 INFO:teuthology.orchestra.run.smithi018.stdout:1 2023-06-09T04:38:49.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.359 DEBUG:teuthology.orchestra.run.smithi018:> route 2023-06-09T04:38:49.408 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2023-06-09T04:38:49.409 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:49.409 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-09T04:38:49.409 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:38:49.409 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-09T04:38:49.409 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:49.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.410 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:49.410 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:49.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:38:49.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:38:49.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:38:49.411 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:49.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.487 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2023-06-09T04:38:49.532 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:38:49.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.533 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2023-06-09T04:38:49.580 INFO:teuthology.orchestra.run.smithi018.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-09T04:38:49.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.581 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:49.581 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:49.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:38:49.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-09T04:38:49.581 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:49.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:38:49.706 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 86:82:a7:be:24:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::8482:a7ff:febe:24f5/64 scope link 2023-06-09T04:38:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:38:49.763 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:49.763 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:49.763 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 86:82:a7:be:24:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:49.764 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.765 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::8482:a7ff:febe:24f5/64 scope link 2023-06-09T04:38:49.765 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:49.766 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-09T04:38:49.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.766 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:49.766 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:49.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-09T04:38:49.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:49.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-09T04:38:49.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-09T04:38:49.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-09T04:38:49.768 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:49.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:49.861 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:38:49.861 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:38:49.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.1 up 2023-06-09T04:38:49.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:38:49.862 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:38:49.881 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-06-09T04:38:49.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:49.882 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:49.931 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:38:49.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:49.931 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:49.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:50.033 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:50.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:50.085 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:50.086 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:50.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:50.087 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:50.135 INFO:teuthology.orchestra.run.smithi018.stdout:45 2023-06-09T04:38:50.136 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-06-09T04:38:50.136 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-06-09T04:38:50.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:50.193 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:50.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:50.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:50.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:50.246 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:50.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:2023-06-09T04:38:50.250+0000 7f0b8f3c5580 -1 init, newargv = 0x55c96e0b1a90 newargc=15 2023-06-09T04:38:50.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:ceph-fuse[45475]: starting ceph client 2023-06-09T04:38:50.259 INFO:teuthology.orchestra.run.smithi018.stdout:45 2023-06-09T04:38:50.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:ceph-fuse[45475]: starting fuse 2023-06-09T04:38:51.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:38:51.377 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:51.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:51.431 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:51.432 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:51.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:51.433 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:38:51.480 INFO:teuthology.orchestra.run.smithi018.stdout:45 2023-06-09T04:38:51.480 INFO:teuthology.orchestra.run.smithi018.stdout:46 2023-06-09T04:38:51.481 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-06-09T04:38:51.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:51.481 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2023-06-09T04:38:51.481 DEBUG:teuthology.orchestra.run.smithi018:> import re 2023-06-09T04:38:51.482 DEBUG:teuthology.orchestra.run.smithi018:> import os 2023-06-09T04:38:51.482 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2023-06-09T04:38:51.482 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:51.482 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2023-06-09T04:38:51.483 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-06-09T04:38:51.483 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2023-06-09T04:38:51.483 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-06-09T04:38:51.483 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:51.483 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2023-06-09T04:38:51.484 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2023-06-09T04:38:51.484 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2023-06-09T04:38:51.484 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2023-06-09T04:38:51.484 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:51.485 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2023-06-09T04:38:51.485 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:51.485 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:51.485 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:51.485 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2023-06-09T04:38:51.486 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2023-06-09T04:38:51.486 DEBUG:teuthology.orchestra.run.smithi018:> return f 2023-06-09T04:38:51.486 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:51.486 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:38:51.487 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.2")) 2023-06-09T04:38:51.487 DEBUG:teuthology.orchestra.run.smithi018:> ' 2023-06-09T04:38:51.607 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.2.45475.asok 2023-06-09T04:38:51.786 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45475.asok 2023-06-09T04:38:51.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:51.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45475.asok status 2023-06-09T04:38:51.945 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:38:51.945 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "2", 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "45475", 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2023-06-09T04:38:51.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4947, 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2023-06-09T04:38:51.947 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4947 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 397612479 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:51.948 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 397612479 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4947 192.168.0.2:0/397612479", 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.2:0/397612479", 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2023-06-09T04:38:51.949 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 8, 2023-06-09T04:38:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 28, 2023-06-09T04:38:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2023-06-09T04:38:51.950 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2023-06-09T04:38:51.950 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:38:51.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:52.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.082+0000 7f2520935640 1 Processor -- start 2023-06-09T04:38:52.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.082+0000 7f2520935640 1 -- start start 2023-06-09T04:38:52.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2520935640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f251c158310 0x7f251c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2520935640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f251c1586e0 0x7f251c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2520935640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c06a900 con 0x7f251c06c1f0 2023-06-09T04:38:52.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2520935640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c0cd0f0 con 0x7f251c1586e0 2023-06-09T04:38:52.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2520935640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c06c5c0 con 0x7f251c158310 2023-06-09T04:38:52.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2519d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f251c1586e0 0x7f251c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f251c06c1f0 0x7f251c15bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39942/0 (socket says 172.21.15.18:39942) 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251ad9d640 1 -- 172.21.15.18:0/3864803916 learned_addr learned my addr 172.21.15.18:0/3864803916 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251a59c640 1 --2- 172.21.15.18:0/3864803916 >> v2:172.21.15.81:3300/0 conn(0x7f251c158310 0x7f251c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2519d9b640 1 -- 172.21.15.18:0/3864803916 >> v2:172.21.15.81:3300/0 conn(0x7f251c158310 msgr2=0x7f251c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2519d9b640 1 --2- 172.21.15.18:0/3864803916 >> v2:172.21.15.81:3300/0 conn(0x7f251c158310 0x7f251c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2519d9b640 1 -- 172.21.15.18:0/3864803916 >> v1:172.21.15.18:6789/0 conn(0x7f251c06c1f0 legacy=0x7f251c15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2519d9b640 1 -- 172.21.15.18:0/3864803916 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c15ceb0 con 0x7f251c1586e0 2023-06-09T04:38:52.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251a59c640 1 --2- 172.21.15.18:0/3864803916 >> v2:172.21.15.81:3300/0 conn(0x7f251c158310 0x7f251c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f2519d9b640 1 --2- 172.21.15.18:0/3864803916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c1586e0 0x7f251c06bcb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f251c0cd230 tx=0x7f251001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9864a4190d12a216 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251959a640 1 -- 172.21.15.18:0/3864803916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100ab610 con 0x7f251c1586e0 2023-06-09T04:38:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251959a640 1 -- 172.21.15.18:0/3864803916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25100ab770 con 0x7f251c1586e0 2023-06-09T04:38:52.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.086+0000 7f251959a640 1 -- 172.21.15.18:0/3864803916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100abb00 con 0x7f251c1586e0 2023-06-09T04:38:52.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/3864803916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c1586e0 msgr2=0x7f251c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 --2- 172.21.15.18:0/3864803916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c1586e0 0x7f251c06bcb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f251c0cd230 tx=0x7f251001c410 comp rx=0 tx=0).stop 2023-06-09T04:38:52.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/3864803916 shutdown_connections 2023-06-09T04:38:52.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 --2- 172.21.15.18:0/3864803916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c1586e0 0x7f251c06bcb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 --2- 172.21.15.18:0/3864803916 >> v2:172.21.15.81:3300/0 conn(0x7f251c158310 0x7f251c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/3864803916 >> 172.21.15.18:0/3864803916 conn(0x7f251c0b0240 msgr2=0x7f251c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/3864803916 shutdown_connections 2023-06-09T04:38:52.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/3864803916 wait complete. 2023-06-09T04:38:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 Processor -- start 2023-06-09T04:38:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- start start 2023-06-09T04:38:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 0x7f251c14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f251c158310 0x7f251c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c1586e0 0x7f251c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c158ad0 con 0x7f251c06c1f0 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c7890 con 0x7f251c1586e0 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c7b70 con 0x7f251c158310 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 0x7f251c14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 0x7f251c14d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45510/0 (socket says 172.21.15.18:45510) 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 -- 172.21.15.18:0/2415840843 learned_addr learned my addr 172.21.15.18:0/2415840843 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:52.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 -- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f251c158310 msgr2=0x7f251c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f251c158310 0x7f251c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 -- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c1586e0 msgr2=0x7f251c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c1586e0 0x7f251c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 -- 172.21.15.18:0/2415840843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009420 con 0x7f251c06c1f0 2023-06-09T04:38:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f251a59c640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 0x7f251c14d9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f250c00e810 tx=0x7f250c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00c8d0 con 0x7f251c06c1f0 2023-06-09T04:38:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00ca30 con 0x7f251c06c1f0 2023-06-09T04:38:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00cdc0 con 0x7f251c06c1f0 2023-06-09T04:38:52.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c0c7e50 con 0x7f251c06c1f0 2023-06-09T04:38:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.090+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c0b2630 con 0x7f251c06c1f0 2023-06-09T04:38:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.094+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c158c10 con 0x7f251c06c1f0 2023-06-09T04:38:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.094+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f250c013410 con 0x7f251c06c1f0 2023-06-09T04:38:52.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.094+0000 7f250affd640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f24fc066280 0x7f24fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:52.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.094+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f250c083f90 con 0x7f251c06c1f0 2023-06-09T04:38:52.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.094+0000 7f2519d9b640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f24fc066280 0x7f24fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:52.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.094+0000 7f2519d9b640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f24fc066280 0x7f24fc068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f25100af000 tx=0x7f2510008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:52.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.098+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f250c050ff0 con 0x7f251c06c1f0 2023-06-09T04:38:52.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f251c073380 con 0x7f251c06c1f0 2023-06-09T04:38:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f250affd640 1 -- 172.21.15.18:0/2415840843 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f250c021070 con 0x7f251c06c1f0 2023-06-09T04:38:52.293 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:38:52.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f24fc066280 msgr2=0x7f24fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f24fc066280 0x7f24fc068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f25100af000 tx=0x7f2510008040 comp rx=0 tx=0).stop 2023-06-09T04:38:52.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 msgr2=0x7f251c14d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 0x7f251c14d9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f250c00e810 tx=0x7f250c00ecd0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 shutdown_connections 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f251c1586e0 0x7f251c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f24fc066280 0x7f24fc068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f251c158310 0x7f251c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 --2- 172.21.15.18:0/2415840843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c06c1f0 0x7f251c14d9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 >> 172.21.15.18:0/2415840843 conn(0x7f251c0b0240 msgr2=0x7f251c14ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 shutdown_connections 2023-06-09T04:38:52.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:52.290+0000 7f2520935640 1 -- 172.21.15.18:0/2415840843 wait complete. 2023-06-09T04:38:52.311 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:52.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:52.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-06-09T04:38:52.312 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-09T04:38:52.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:52.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:52.313 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:52.313 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:52.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:38:52.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.314 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-06-09T04:38:52.320 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:52.321 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:52.321 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:52.322 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42451sec preferred_lft 42451sec 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:d7:ff:64:49 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:38:52.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:52.324 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:38:52.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.324 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:52.324 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:52.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:38:52.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-06-09T04:38:52.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-06-09T04:38:52.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:38:52.326 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:52.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.406 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:52.456 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-06-09T04:38:52.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.458 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-06-09T04:38:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-06-09T04:38:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:38:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:38:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:38:52.521 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:38:52.522 INFO:teuthology.orchestra.run.smithi081.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:38:52.522 INFO:teuthology.orchestra.run.smithi081.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:38:52.522 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:38:52.522 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:52.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.522 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:52.523 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:52.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:38:52.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:38:52.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:38:52.524 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:52.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.598 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-06-09T04:38:52.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.644 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-06-09T04:38:52.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.692 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:52.692 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:52.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:38:52.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-09T04:38:52.693 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:52.762 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-09T04:38:52.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.762 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:52.763 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:52.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-09T04:38:52.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:52.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-09T04:38:52.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-09T04:38:52.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-09T04:38:52.764 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:52.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:52.860 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:52.861 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:52.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-06-09T04:38:52.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:38:52.861 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:52.879 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-09T04:38:52.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:52.880 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:52.927 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:38:52.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:52.927 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:52.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-06-09T04:38:53.022 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:53.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:53.072 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:53.073 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:53.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:53.074 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-06-09T04:38:53.119 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:38:53.120 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-09T04:38:53.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-06-09T04:38:53.177 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:53.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:53.229 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:53.230 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:53.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:53.231 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-06-09T04:38:53.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi081.stderr:2023-06-09T04:38:53.247+0000 7fdbf3d1a580 -1 init, newargv = 0x55a93ee26a30 newargc=15 2023-06-09T04:38:53.252 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi081.stderr:ceph-fuse[42843]: starting ceph client 2023-06-09T04:38:53.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi081.stderr:ceph-fuse[42843]: starting fuse 2023-06-09T04:38:54.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-06-09T04:38:54.372 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:54.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:54.427 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:54.428 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:54.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:54.429 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-06-09T04:38:54.476 INFO:teuthology.orchestra.run.smithi081.stdout:45 2023-06-09T04:38:54.476 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-09T04:38:54.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:54.477 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-06-09T04:38:54.477 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-06-09T04:38:54.477 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-06-09T04:38:54.477 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-06-09T04:38:54.478 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:54.478 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-06-09T04:38:54.478 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-09T04:38:54.478 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-06-09T04:38:54.479 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-09T04:38:54.479 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:54.479 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-06-09T04:38:54.479 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-06-09T04:38:54.479 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-06-09T04:38:54.480 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-06-09T04:38:54.480 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:54.480 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-06-09T04:38:54.480 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:54.481 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:54.481 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:54.481 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-06-09T04:38:54.481 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-06-09T04:38:54.481 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-06-09T04:38:54.482 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:54.482 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:54.482 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.1")) 2023-06-09T04:38:54.482 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-06-09T04:38:54.595 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.1.42843.asok 2023-06-09T04:38:54.778 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42843.asok 2023-06-09T04:38:54.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:54.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42843.asok status 2023-06-09T04:38:54.935 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-06-09T04:38:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-06-09T04:38:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "1", 2023-06-09T04:38:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-06-09T04:38:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "42843", 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4702, 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-06-09T04:38:54.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4702 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2437535026 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2437535026 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:54.939 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4702 192.168.0.1:0/2437535026", 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2437535026", 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 8, 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 28, 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-06-09T04:38:54.940 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-06-09T04:38:54.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.078+0000 7f716b88b640 1 Processor -- start 2023-06-09T04:38:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.078+0000 7f716b88b640 1 -- start start 2023-06-09T04:38:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f716b88b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7164157dc0 0x7f71640c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f716b88b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71640acd10 0x7f71640cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f716b88b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f716406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f716b88b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71640cbdc0 con 0x7f7164157dc0 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f716b88b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7164070520 con 0x7f71640acd10 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f716b88b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71640c9010 con 0x7f716406fb60 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7164157dc0 0x7f71640c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7164157dc0 0x7f71640c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45520/0 (socket says 172.21.15.18:45520) 2023-06-09T04:38:55.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 -- 172.21.15.18:0/3803867064 learned_addr learned my addr 172.21.15.18:0/3803867064 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:55.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169e28640 1 --2- 172.21.15.18:0/3803867064 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f716406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7168e26640 1 --2- 172.21.15.18:0/3803867064 >> v2:172.21.15.81:3300/0 conn(0x7f71640acd10 0x7f71640cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 -- 172.21.15.18:0/3803867064 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 msgr2=0x7f716406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:55.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 --2- 172.21.15.18:0/3803867064 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f716406ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 -- 172.21.15.18:0/3803867064 >> v2:172.21.15.81:3300/0 conn(0x7f71640acd10 msgr2=0x7f71640cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:55.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 --2- 172.21.15.18:0/3803867064 >> v2:172.21.15.81:3300/0 conn(0x7f71640acd10 0x7f71640cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.082+0000 7f7169627640 1 -- 172.21.15.18:0/3803867064 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640c8460 con 0x7f7164157dc0 2023-06-09T04:38:55.087 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7169627640 1 --2- 172.21.15.18:0/3803867064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7164157dc0 0x7f71640c94a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f716406b500 tx=0x7f71600213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856c2d2c6c6528c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f715bfff640 1 -- 172.21.15.18:0/3803867064 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600b1600 con 0x7f7164157dc0 2023-06-09T04:38:55.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f715bfff640 1 -- 172.21.15.18:0/3803867064 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71600ad050 con 0x7f7164157dc0 2023-06-09T04:38:55.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f715bfff640 1 -- 172.21.15.18:0/3803867064 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600b1980 con 0x7f7164157dc0 2023-06-09T04:38:55.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- 172.21.15.18:0/3803867064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7164157dc0 msgr2=0x7f71640c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- 172.21.15.18:0/3803867064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7164157dc0 0x7f71640c94a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f716406b500 tx=0x7f71600213c0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- 172.21.15.18:0/3803867064 shutdown_connections 2023-06-09T04:38:55.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- 172.21.15.18:0/3803867064 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f716406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- 172.21.15.18:0/3803867064 >> v2:172.21.15.81:3300/0 conn(0x7f71640acd10 0x7f71640cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- 172.21.15.18:0/3803867064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7164157dc0 0x7f71640c94a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- 172.21.15.18:0/3803867064 >> 172.21.15.18:0/3803867064 conn(0x7f71640b0240 msgr2=0x7f71640cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- 172.21.15.18:0/3803867064 shutdown_connections 2023-06-09T04:38:55.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- 172.21.15.18:0/3803867064 wait complete. 2023-06-09T04:38:55.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 Processor -- start 2023-06-09T04:38:55.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- start start 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f71640c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 0x7f71640b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7164157dc0 0x7f71641f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641586a0 con 0x7f71640acd10 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164158980 con 0x7f7164157dc0 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f716b88b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7164158c60 con 0x7f716406fb60 2023-06-09T04:38:55.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 0x7f71640b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 0x7f71640b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45526/0 (socket says 172.21.15.18:45526) 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 -- 172.21.15.18:0/936200878 learned_addr learned my addr 172.21.15.18:0/936200878 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7169627640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f71640c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7169e28640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7164157dc0 0x7f71641f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 -- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 msgr2=0x7f71640c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f71640c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 -- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7164157dc0 msgr2=0x7f71641f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7164157dc0 0x7f71641f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 -- 172.21.15.18:0/936200878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716000b770 con 0x7f71640acd10 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7169e28640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7164157dc0 0x7f71641f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7168e26640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 0x7f71640b0cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f715400d800 tx=0x7f715400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.086+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400b6c0 con 0x7f71640acd10 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715400b820 con 0x7f71640acd10 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7164158f40 con 0x7f71640acd10 2023-06-09T04:38:55.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715400bb90 con 0x7f71640acd10 2023-06-09T04:38:55.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71640b1210 con 0x7f71640acd10 2023-06-09T04:38:55.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f715400bcf0 con 0x7f71640acd10 2023-06-09T04:38:55.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7164073380 con 0x7f71640acd10 2023-06-09T04:38:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7159ffb640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7148066280 0x7f7148068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71540844b0 con 0x7f71640acd10 2023-06-09T04:38:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7169627640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7148066280 0x7f7148068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:55.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.090+0000 7f7169627640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7148066280 0x7f7148068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71600b3000 tx=0x7f71600ac000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:55.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.094+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7154055140 con 0x7f71640acd10 2023-06-09T04:38:55.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.282+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f71640ce2c0 con 0x7f71640acd10 2023-06-09T04:38:55.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.282+0000 7f7159ffb640 1 -- 172.21.15.18:0/936200878 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7154054cd0 con 0x7f71640acd10 2023-06-09T04:38:55.285 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:38:55.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.282+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7148066280 msgr2=0x7f7148068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.282+0000 7f716b88b640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7148066280 0x7f7148068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71600b3000 tx=0x7f71600ac000 comp rx=0 tx=0).stop 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.282+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 msgr2=0x7f71640b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.282+0000 7f716b88b640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 0x7f71640b0cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f715400d800 tx=0x7f715400dcc0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 shutdown_connections 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7164157dc0 0x7f71641f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71640acd10 0x7f71640b0cd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7148066280 0x7f7148068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 --2- 172.21.15.18:0/936200878 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f716406fb60 0x7f71640c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:55.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 >> 172.21.15.18:0/936200878 conn(0x7f71640b0240 msgr2=0x7f71640ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:55.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 shutdown_connections 2023-06-09T04:38:55.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:55.286+0000 7f716b88b640 1 -- 172.21.15.18:0/936200878 wait complete. 2023-06-09T04:38:55.303 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:38:55.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:55.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-06-09T04:38:55.303 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-09T04:38:55.304 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:55.304 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:38:55.304 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:38:55.304 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:55.304 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:38:55.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.305 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-06-09T04:38:55.311 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.311 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:55.312 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42448sec preferred_lft 42448sec 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-06-09T04:38:55.313 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.314 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:38:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:d7:ff:64:49 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:38:55.315 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:38:55.316 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:38:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-09T04:38:55.317 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.318 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:55.370 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-06-09T04:38:55.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.372 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-06-09T04:38:55.422 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-06-09T04:38:55.422 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:55.422 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:38:55.422 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:38:55.422 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:38:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:38:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:38:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:38:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:38:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:55.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.424 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:55.424 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:55.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:38:55.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:38:55.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:38:55.425 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:55.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.497 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-06-09T04:38:55.543 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T04:38:55.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.544 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-06-09T04:38:55.591 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-09T04:38:55.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.591 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:55.592 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:55.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T04:38:55.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-09T04:38:55.592 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:55.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:38:55.716 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:55.716 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:55.716 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:55.716 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.716 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:55.716 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.717 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:55.717 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 16:10:78:6d:10:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:55.717 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:55.717 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.717 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1410:78ff:fe6d:109c/64 scope link 2023-06-09T04:38:55.718 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:38:55.771 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 16:10:78:6d:10:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1410:78ff:fe6d:109c/64 scope link 2023-06-09T04:38:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:55.773 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-09T04:38:55.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.774 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:55.774 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:55.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-09T04:38:55.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:38:55.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-09T04:38:55.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-09T04:38:55.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-09T04:38:55.775 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:55.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:55.869 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-06-09T04:38:55.869 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-06-09T04:38:55.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2023-06-09T04:38:55.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:38:55.870 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-06-09T04:38:55.889 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-06-09T04:38:55.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:55.889 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:38:55.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:55.936 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:55.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-06-09T04:38:56.040 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:56.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:56.096 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:56.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:56.097 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-06-09T04:38:56.143 INFO:teuthology.orchestra.run.smithi081.stdout:45 2023-06-09T04:38:56.144 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-06-09T04:38:56.144 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-06-09T04:38:56.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-06-09T04:38:56.204 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:56.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:56.261 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:56.262 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:56.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:56.263 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-06-09T04:38:56.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi081.stderr:2023-06-09T04:38:56.259+0000 7fe9a1b28580 -1 init, newargv = 0x5595c866cd40 newargc=15 2023-06-09T04:38:56.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi081.stderr:ceph-fuse[42955]: starting ceph client 2023-06-09T04:38:56.271 INFO:teuthology.orchestra.run.smithi081.stdout:45 2023-06-09T04:38:56.274 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi081.stderr:ceph-fuse[42955]: starting fuse 2023-06-09T04:38:57.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2023-06-09T04:38:57.389 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:38:57.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:38:57.443 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:38:57.445 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:38:57.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:57.445 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2023-06-09T04:38:57.491 INFO:teuthology.orchestra.run.smithi081.stdout:45 2023-06-09T04:38:57.492 INFO:teuthology.orchestra.run.smithi081.stdout:46 2023-06-09T04:38:57.492 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-06-09T04:38:57.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:38:57.492 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2023-06-09T04:38:57.493 DEBUG:teuthology.orchestra.run.smithi081:> import re 2023-06-09T04:38:57.493 DEBUG:teuthology.orchestra.run.smithi081:> import os 2023-06-09T04:38:57.493 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2023-06-09T04:38:57.493 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:57.494 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2023-06-09T04:38:57.494 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-06-09T04:38:57.494 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2023-06-09T04:38:57.494 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-06-09T04:38:57.495 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:57.495 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2023-06-09T04:38:57.495 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2023-06-09T04:38:57.495 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2023-06-09T04:38:57.495 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2023-06-09T04:38:57.496 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:57.496 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2023-06-09T04:38:57.496 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:38:57.496 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:38:57.497 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:38:57.497 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2023-06-09T04:38:57.497 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2023-06-09T04:38:57.497 DEBUG:teuthology.orchestra.run.smithi081:> return f 2023-06-09T04:38:57.497 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:38:57.498 DEBUG:teuthology.orchestra.run.smithi081:> 2023-06-09T04:38:57.498 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.3")) 2023-06-09T04:38:57.498 DEBUG:teuthology.orchestra.run.smithi081:> ' 2023-06-09T04:38:57.613 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.3.42955.asok 2023-06-09T04:38:57.796 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42955.asok 2023-06-09T04:38:57.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:57.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42955.asok status 2023-06-09T04:38:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "3", 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-06-09T04:38:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "42955", 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4714, 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2023-06-09T04:38:57.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4714 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2383684102 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-06-09T04:38:57.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.2:0", 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2383684102 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4714 192.168.0.2:0/2383684102", 2023-06-09T04:38:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.2:0/2383684102", 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 8, 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 28, 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2023-06-09T04:38:57.958 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-06-09T04:38:57.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:57.967 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2023-06-09T04:38:57.967 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2023-06-09T04:38:57.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:57.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:57.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:58.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:58.029 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2023-06-09T04:38:58.029 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2023-06-09T04:38:58.081 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:58.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:58.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:38:58.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:58.137 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-06-09T04:38:58.137 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:58.143 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-06-09T04:38:58.144 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:58.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:58.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:38:58.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:58.205 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2023-06-09T04:38:58.205 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:58.252 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2023-06-09T04:38:58.253 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:58.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:58.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:38:58.308 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-09T04:38:58.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:58.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.454+0000 7fd29469b640 1 Processor -- start 2023-06-09T04:38:58.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.454+0000 7fd29469b640 1 -- start start 2023-06-09T04:38:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd29469b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 0x7fd28c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd29469b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd28c15d680 0x7fd28c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd29469b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c15cf10 con 0x7fd28c15dad0 2023-06-09T04:38:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd29469b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c15a920 con 0x7fd28c15d680 2023-06-09T04:38:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd29469b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c81b0 con 0x7fd28c159320 2023-06-09T04:38:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 0x7fd28c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd291c36640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd28c15d680 0x7fd28c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 0x7fd28c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:46536/0 (socket says 172.21.15.18:46536) 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 -- 172.21.15.18:0/978778993 learned_addr learned my addr 172.21.15.18:0/978778993 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 -- 172.21.15.18:0/978778993 >> v2:172.21.15.81:3300/0 conn(0x7fd28c15d680 msgr2=0x7fd28c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 --2- 172.21.15.18:0/978778993 >> v2:172.21.15.81:3300/0 conn(0x7fd28c15d680 0x7fd28c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 -- 172.21.15.18:0/978778993 >> v1:172.21.15.81:6789/0 conn(0x7fd28c15dad0 legacy=0x7fd28c0692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.458+0000 7fd292437640 1 -- 172.21.15.18:0/978778993 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0c8490 con 0x7fd28c159320 2023-06-09T04:38:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd292437640 1 --2- 172.21.15.18:0/978778993 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 0x7fd28c15a3e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd288009870 tx=0x7fd28801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3636888993a28f27 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd291435640 1 -- 172.21.15.18:0/978778993 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880ab680 con 0x7fd28c159320 2023-06-09T04:38:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd291435640 1 -- 172.21.15.18:0/978778993 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2880ab7e0 con 0x7fd28c159320 2023-06-09T04:38:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd291435640 1 -- 172.21.15.18:0/978778993 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880abb70 con 0x7fd28c159320 2023-06-09T04:38:58.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- 172.21.15.18:0/978778993 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 msgr2=0x7fd28c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 --2- 172.21.15.18:0/978778993 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 0x7fd28c15a3e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd288009870 tx=0x7fd28801c480 comp rx=0 tx=0).stop 2023-06-09T04:38:58.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- 172.21.15.18:0/978778993 shutdown_connections 2023-06-09T04:38:58.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 --2- 172.21.15.18:0/978778993 >> v2:172.21.15.81:3300/0 conn(0x7fd28c15d680 0x7fd28c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 --2- 172.21.15.18:0/978778993 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c159320 0x7fd28c15a3e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- 172.21.15.18:0/978778993 >> 172.21.15.18:0/978778993 conn(0x7fd28c0b0240 msgr2=0x7fd28c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- 172.21.15.18:0/978778993 shutdown_connections 2023-06-09T04:38:58.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- 172.21.15.18:0/978778993 wait complete. 2023-06-09T04:38:58.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 Processor -- start 2023-06-09T04:38:58.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- start start 2023-06-09T04:38:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c159320 0x7fd28c159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15d680 0x7fd28c14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 0x7fd28c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c7480 con 0x7fd28c15dad0 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c6800 con 0x7fd28c159320 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd29469b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c6ae0 con 0x7fd28c15d680 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd292c38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 0x7fd28c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd292c38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 0x7fd28c14f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40108/0 (socket says 172.21.15.18:40108) 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.462+0000 7fd292c38640 1 -- 172.21.15.18:0/3404767817 learned_addr learned my addr 172.21.15.18:0/3404767817 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd291c36640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15d680 0x7fd28c14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292437640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c159320 0x7fd28c159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292c38640 1 -- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15d680 msgr2=0x7fd28c14ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292c38640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15d680 0x7fd28c14ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292c38640 1 -- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c159320 msgr2=0x7fd28c159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292c38640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c159320 0x7fd28c159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292c38640 1 -- 172.21.15.18:0/3404767817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880094d0 con 0x7fd28c15dad0 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292c38640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 0x7fd28c14f2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c770 tx=0x7fd28400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284003b80 con 0x7fd28c15dad0 2023-06-09T04:38:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284003ce0 con 0x7fd28c15dad0 2023-06-09T04:38:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0c6dc0 con 0x7fd28c15dad0 2023-06-09T04:38:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400aa90 con 0x7fd28c15dad0 2023-06-09T04:38:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c15a010 con 0x7fd28c15dad0 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c0c75c0 con 0x7fd28c15dad0 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd28400abf0 con 0x7fd28c15dad0 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd282ffd640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd270066280 0x7fd270068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd284083de0 con 0x7fd28c15dad0 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292437640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd270066280 0x7fd270068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.466+0000 7fd292437640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd270066280 0x7fd270068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2880af000 tx=0x7fd2880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.470+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd28c0c75c0 con 0x7fd28c15dad0 2023-06-09T04:38:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.626+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd28c0c75c0 con 0x7fd28c15dad0 2023-06-09T04:38:58.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.630+0000 7fd282ffd640 1 -- 172.21.15.18:0/3404767817 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fd28c0c75c0 con 0x7fd28c15dad0 2023-06-09T04:38:58.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:38:58.634 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd270066280 msgr2=0x7fd270068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd270066280 0x7fd270068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2880af000 tx=0x7fd2880a7000 comp rx=0 tx=0).stop 2023-06-09T04:38:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 msgr2=0x7fd28c14f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 0x7fd28c14f2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c770 tx=0x7fd28400cc30 comp rx=0 tx=0).stop 2023-06-09T04:38:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 shutdown_connections 2023-06-09T04:38:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd28c15dad0 0x7fd28c14f2d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd270066280 0x7fd270068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd28c15d680 0x7fd28c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 --2- 172.21.15.18:0/3404767817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd28c159320 0x7fd28c159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 >> 172.21.15.18:0/3404767817 conn(0x7fd28c0b0240 msgr2=0x7fd28c0cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 shutdown_connections 2023-06-09T04:38:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.634+0000 7fd29469b640 1 -- 172.21.15.18:0/3404767817 wait complete. 2023-06-09T04:38:58.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:38:58.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:58.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc8e77640 1 Processor -- start 2023-06-09T04:38:58.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc8e77640 1 -- start start 2023-06-09T04:38:58.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc8e77640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efcc40cbd40 0x7efcc4069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc8e77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc415de50 con 0x7efcc4159590 2023-06-09T04:38:58.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc8e77640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc415d2d0 con 0x7efcc41591c0 2023-06-09T04:38:58.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc8e77640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc415d5b0 con 0x7efcc40cbd40 2023-06-09T04:38:58.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc2d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efcc4159590 0x7efcc4069b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60598/0 (socket says 172.21.15.18:60598) 2023-06-09T04:38:58.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc2d9d640 1 -- 172.21.15.18:0/760481177 learned_addr learned my addr 172.21.15.18:0/760481177 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:58.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc1d9b640 1 --2- 172.21.15.18:0/760481177 >> v2:172.21.15.81:3300/0 conn(0x7efcc40cbd40 0x7efcc4069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc159a640 1 -- 172.21.15.18:0/760481177 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423522629 0 0) 0x7efcc415de50 con 0x7efcc4159590 2023-06-09T04:38:58.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc159a640 1 -- 172.21.15.18:0/760481177 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb0003530 con 0x7efcc4159590 2023-06-09T04:38:58.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc1d9b640 1 -- 172.21.15.18:0/760481177 >> v1:172.21.15.81:6789/0 conn(0x7efcc41591c0 legacy=0x7efcc40cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc1d9b640 1 -- 172.21.15.18:0/760481177 >> v1:172.21.15.18:6789/0 conn(0x7efcc4159590 legacy=0x7efcc4069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.774+0000 7efcc1d9b640 1 -- 172.21.15.18:0/760481177 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc415d890 con 0x7efcc40cbd40 2023-06-09T04:38:58.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc1d9b640 1 --2- 172.21.15.18:0/760481177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4069600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009d90 tx=0x7efcb401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dcfe4067fc9aacc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc159a640 1 -- 172.21.15.18:0/760481177 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a5940 con 0x7efcc40cbd40 2023-06-09T04:38:58.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc159a640 1 -- 172.21.15.18:0/760481177 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40a5aa0 con 0x7efcc40cbd40 2023-06-09T04:38:58.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc159a640 1 -- 172.21.15.18:0/760481177 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a5e10 con 0x7efcc40cbd40 2023-06-09T04:38:58.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 -- 172.21.15.18:0/760481177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 msgr2=0x7efcc4069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 --2- 172.21.15.18:0/760481177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4069600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009d90 tx=0x7efcb401c920 comp rx=0 tx=0).stop 2023-06-09T04:38:58.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 -- 172.21.15.18:0/760481177 shutdown_connections 2023-06-09T04:38:58.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 --2- 172.21.15.18:0/760481177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4069600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 -- 172.21.15.18:0/760481177 >> 172.21.15.18:0/760481177 conn(0x7efcc40afa90 msgr2=0x7efcc40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 -- 172.21.15.18:0/760481177 shutdown_connections 2023-06-09T04:38:58.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 -- 172.21.15.18:0/760481177 wait complete. 2023-06-09T04:38:58.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 Processor -- start 2023-06-09T04:38:58.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.778+0000 7efcc8e77640 1 -- start start 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 0x7efcc41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcc4159590 0x7efcc4149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc415c860 con 0x7efcc41591c0 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc414bdb0 con 0x7efcc40cbd40 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4156cd0 con 0x7efcc4159590 2023-06-09T04:38:58.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 0x7efcc41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 0x7efcc41522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40118/0 (socket says 172.21.15.18:40118) 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 -- 172.21.15.18:0/508333349 learned_addr learned my addr 172.21.15.18:0/508333349 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc2d9d640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcc4159590 0x7efcc4149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc259c640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 -- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcc4159590 msgr2=0x7efcc4149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcc4159590 0x7efcc4149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.786 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 -- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 msgr2=0x7efcc4149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 -- 172.21.15.18:0/508333349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009a70 con 0x7efcc41591c0 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc1d9b640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 0x7efcc41522e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efcb4098460 tx=0x7efcb40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40aed60 con 0x7efcc41591c0 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40b7410 con 0x7efcc41591c0 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40b77c0 con 0x7efcc41591c0 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc414bad0 con 0x7efcc41591c0 2023-06-09T04:38:58.787 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc415c480 con 0x7efcc41591c0 2023-06-09T04:38:58.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc41567c0 con 0x7efcc41591c0 2023-06-09T04:38:58.788 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcb40b4050 con 0x7efcc41591c0 2023-06-09T04:38:58.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcbaffd640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efca40662b0 0x7efca4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:58.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efcb411ec20 con 0x7efcc41591c0 2023-06-09T04:38:58.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.782+0000 7efcc259c640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efca40662b0 0x7efca4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:58.789 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.786+0000 7efcc259c640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efca40662b0 0x7efca4068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efcac007fd0 tx=0x7efcac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:58.791 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.786+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcc41567c0 con 0x7efcc41591c0 2023-06-09T04:38:58.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc41567c0 con 0x7efcc41591c0 2023-06-09T04:38:58.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcbaffd640 1 -- 172.21.15.18:0/508333349 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcc41567c0 con 0x7efcc41591c0 2023-06-09T04:38:58.944 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:38:58.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efca40662b0 msgr2=0x7efca4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efca40662b0 0x7efca4068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efcac007fd0 tx=0x7efcac009040 comp rx=0 tx=0).stop 2023-06-09T04:38:58.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 msgr2=0x7efcc41522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 0x7efcc41522e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efcb4098460 tx=0x7efcb40196c0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 shutdown_connections 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efca40662b0 0x7efca4068760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efcc4159590 0x7efcc4149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc41591c0 0x7efcc41522e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 --2- 172.21.15.18:0/508333349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc40cbd40 0x7efcc4149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 >> 172.21.15.18:0/508333349 conn(0x7efcc40afa90 msgr2=0x7efcc41508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:58.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 shutdown_connections 2023-06-09T04:38:58.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:58.942+0000 7efcc8e77640 1 -- 172.21.15.18:0/508333349 wait complete. 2023-06-09T04:38:58.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd5567b2640 1 Processor -- start 2023-06-09T04:38:59.088 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd5567b2640 1 -- start start 2023-06-09T04:38:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd5567b2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd550159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.089 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd5567b2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500c9d40 con 0x7fd55006c520 2023-06-09T04:38:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd5567b2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500cab90 con 0x7fd5500c8bd0 2023-06-09T04:38:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd5567b2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55015cec0 con 0x7fd550159460 2023-06-09T04:38:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd554d4f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd55006c520 0x7fd55015d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60600/0 (socket says 172.21.15.18:60600) 2023-06-09T04:38:59.090 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd554d4f640 1 -- 172.21.15.18:0/2359243261 learned_addr learned my addr 172.21.15.18:0/2359243261 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:59.091 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd550159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216285460 0 0) 0x7fd548001120 con 0x7fd55006c520 2023-06-09T04:38:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd538003530 con 0x7fd55006c520 2023-06-09T04:38:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022215489 0 0) 0x7fd538003530 con 0x7fd55006c520 2023-06-09T04:38:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 msgr2=0x7fd550159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd550159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 >> v1:172.21.15.81:6789/0 conn(0x7fd5500c8bd0 legacy=0x7fd5500ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550159e20 con 0x7fd55006c520 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fd548001810 con 0x7fd55006c520 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 >> v1:172.21.15.18:6789/0 conn(0x7fd55006c520 legacy=0x7fd55015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd538003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd538004350 0x7fd538004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd538005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55015cec0 con 0x7fd5380039b0 2023-06-09T04:38:59.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53800b990 con 0x7fd538004350 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53800bb20 con 0x7fd550159460 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd538003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54f7fe640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd538004350 0x7fd538004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd554d4f640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd538005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 -- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 msgr2=0x7fd538005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd538005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 -- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd538004350 msgr2=0x7fd538004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd538004350 0x7fd538004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd54ffff640 1 -- 172.21.15.18:0/2359243261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538003530 con 0x7fd5380039b0 2023-06-09T04:38:59.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.086+0000 7fd554d4f640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd550159460 0x7fd538005070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd538003d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd540009fc0 tx=0x7fd54001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e6140bb8c75f78 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400a5c70 con 0x7fd5380039b0 2023-06-09T04:38:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000f040 con 0x7fd5380039b0 2023-06-09T04:38:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd54effd640 1 -- 172.21.15.18:0/2359243261 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400ad440 con 0x7fd5380039b0 2023-06-09T04:38:59.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 -- 172.21.15.18:0/2359243261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 msgr2=0x7fd538003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2359243261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd538003d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd540009fc0 tx=0x7fd54001cc60 comp rx=0 tx=0).stop 2023-06-09T04:38:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd554d4f640 1 -- 172.21.15.18:0/2359243261 reap_dead start 2023-06-09T04:38:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 -- 172.21.15.18:0/2359243261 shutdown_connections 2023-06-09T04:38:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 -- 172.21.15.18:0/2359243261 >> 172.21.15.18:0/2359243261 conn(0x7fd5500b0b10 msgr2=0x7fd5500ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 -- 172.21.15.18:0/2359243261 shutdown_connections 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 -- 172.21.15.18:0/2359243261 wait complete. 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 Processor -- start 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.090+0000 7fd5567b2640 1 -- start start 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd550147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5500b11c0 0x7fd5500b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5501583f0 0x7fd550158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500b29b0 con 0x7fd5380039b0 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550158da0 con 0x7fd5500b11c0 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500b1d30 con 0x7fd5501583f0 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd550147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd550147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40136/0 (socket says 172.21.15.18:40136) 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 -- 172.21.15.18:0/2308821123 learned_addr learned my addr 172.21.15.18:0/2308821123 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54f7fe640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5500b11c0 0x7fd5500b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd554d4f640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5501583f0 0x7fd550158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 -- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5501583f0 msgr2=0x7fd550158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5501583f0 0x7fd550158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 -- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5500b11c0 msgr2=0x7fd5500b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5500b11c0 0x7fd5500b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 -- 172.21.15.18:0/2308821123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500b2010 con 0x7fd5380039b0 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54ffff640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd550147720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd5400b0040 tx=0x7fd540009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400bd070 con 0x7fd5380039b0 2023-06-09T04:38:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400039a0 con 0x7fd5380039b0 2023-06-09T04:38:59.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5500b22f0 con 0x7fd5380039b0 2023-06-09T04:38:59.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540003d30 con 0x7fd5380039b0 2023-06-09T04:38:59.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5500c7e50 con 0x7fd5380039b0 2023-06-09T04:38:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5500b2cd0 con 0x7fd5380039b0 2023-06-09T04:38:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5400b4040 con 0x7fd5380039b0 2023-06-09T04:38:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54cff9640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd53c0662b0 0x7fd53c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd54011de20 con 0x7fd5380039b0 2023-06-09T04:38:59.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.094+0000 7fd54f7fe640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd53c0662b0 0x7fd53c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.098+0000 7fd54f7fe640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd53c0662b0 0x7fd53c068760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd54400afd0 tx=0x7fd54400a940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.098+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5500b2cd0 con 0x7fd5380039b0 2023-06-09T04:38:59.261 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.258+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5500b2cd0 con 0x7fd5380039b0 2023-06-09T04:38:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.258+0000 7fd54cff9640 1 -- 172.21.15.18:0/2308821123 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5500b2cd0 con 0x7fd5380039b0 2023-06-09T04:38:59.262 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:38:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd53c0662b0 msgr2=0x7fd53c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd53c0662b0 0x7fd53c068760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd54400afd0 tx=0x7fd54400a940 comp rx=0 tx=0).stop 2023-06-09T04:38:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 msgr2=0x7fd550147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd550147720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd5400b0040 tx=0x7fd540009750 comp rx=0 tx=0).stop 2023-06-09T04:38:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 shutdown_connections 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd53c0662b0 0x7fd53c068760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5501583f0 0x7fd550158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5500b11c0 0x7fd5500b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 --2- 172.21.15.18:0/2308821123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5380039b0 0x7fd550147720 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 >> 172.21.15.18:0/2308821123 conn(0x7fd5500b0b10 msgr2=0x7fd5500692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 shutdown_connections 2023-06-09T04:38:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.262+0000 7fd5567b2640 1 -- 172.21.15.18:0/2308821123 wait complete. 2023-06-09T04:38:59.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:38:59.395 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.390+0000 7f982c0bd640 1 Processor -- start 2023-06-09T04:38:59.395 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.390+0000 7f982c0bd640 1 -- start start 2023-06-09T04:38:59.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f982c0bd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f98241595b0 0x7f98240b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.396 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f982c0bd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9824159980 con 0x7f98240cf890 2023-06-09T04:38:59.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f982c0bd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240cabb0 con 0x7f98240ccb70 2023-06-09T04:38:59.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f982c0bd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240cbfc0 con 0x7f98241595b0 2023-06-09T04:38:59.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f98241595b0 0x7f98240b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f98241595b0 0x7f98240b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40152/0 (socket says 172.21.15.18:40152) 2023-06-09T04:38:59.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829658640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f98240cf890 0x7f98240cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60604/0 (socket says 172.21.15.18:60604) 2023-06-09T04:38:59.397 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 -- 172.21.15.18:0/884530103 learned_addr learned my addr 172.21.15.18:0/884530103 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:59.398 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 -- 172.21.15.18:0/884530103 >> v1:172.21.15.81:6789/0 conn(0x7f98240ccb70 legacy=0x7f982415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.398 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 -- 172.21.15.18:0/884530103 >> v1:172.21.15.18:6789/0 conn(0x7f98240cf890 legacy=0x7f98240cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.398 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 -- 172.21.15.18:0/884530103 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240ce9f0 con 0x7f98241595b0 2023-06-09T04:38:59.398 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9828e57640 1 -- 172.21.15.18:0/884530103 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302339434 0 0) 0x7f9824159980 con 0x7f98240cf890 2023-06-09T04:38:59.399 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9829e59640 1 --2- 172.21.15.18:0/884530103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98241595b0 0x7f98240b2bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9820009870 tx=0x7f982001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72c8758bc2473cf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.399 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9828e57640 1 -- 172.21.15.18:0/884530103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200ab600 con 0x7f98241595b0 2023-06-09T04:38:59.399 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9828e57640 1 -- 172.21.15.18:0/884530103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98200a7050 con 0x7f98241595b0 2023-06-09T04:38:59.399 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.394+0000 7f9828e57640 1 -- 172.21.15.18:0/884530103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200ab980 con 0x7f98241595b0 2023-06-09T04:38:59.400 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/884530103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98241595b0 msgr2=0x7f98240b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.400 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 --2- 172.21.15.18:0/884530103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98241595b0 0x7f98240b2bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9820009870 tx=0x7f982001c500 comp rx=0 tx=0).stop 2023-06-09T04:38:59.400 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/884530103 shutdown_connections 2023-06-09T04:38:59.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 --2- 172.21.15.18:0/884530103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98241595b0 0x7f98240b2bc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/884530103 >> 172.21.15.18:0/884530103 conn(0x7f982406ce60 msgr2=0x7f982406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/884530103 shutdown_connections 2023-06-09T04:38:59.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/884530103 wait complete. 2023-06-09T04:38:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 Processor -- start 2023-06-09T04:38:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- start start 2023-06-09T04:38:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f98240ccb70 0x7f98240b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 0x7f98241587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98241595b0 0x7f98240c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240b1dc0 con 0x7f98240cf890 2023-06-09T04:38:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824146ce0 con 0x7f98241595b0 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9824158d00 con 0x7f98240ccb70 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 0x7f98241587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 0x7f98241587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40160/0 (socket says 172.21.15.18:40160) 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 -- 172.21.15.18:0/4203291834 learned_addr learned my addr 172.21.15.18:0/4203291834 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829e59640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f98240ccb70 0x7f98240b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982a65a640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98241595b0 0x7f98240c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 -- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f98240ccb70 msgr2=0x7f98240b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f98240ccb70 0x7f98240b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 -- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98241595b0 msgr2=0x7f98240c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98241595b0 0x7f98240c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 -- 172.21.15.18:0/4203291834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200094d0 con 0x7f98240cf890 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f9829658640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 0x7f98241587c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f98140011f0 tx=0x7f981400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140074e0 con 0x7f98240cf890 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814007640 con 0x7f98240cf890 2023-06-09T04:38:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240b1ae0 con 0x7f98240cf890 2023-06-09T04:38:59.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814004a10 con 0x7f98240cf890 2023-06-09T04:38:59.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98240b0660 con 0x7f98240cf890 2023-06-09T04:38:59.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.398+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240b1f00 con 0x7f98240cf890 2023-06-09T04:38:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.402+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9814004b70 con 0x7f98240cf890 2023-06-09T04:38:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.402+0000 7f981a7fc640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9808066280 0x7f9808068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.402+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f98140832d0 con 0x7f98240cf890 2023-06-09T04:38:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.402+0000 7f9829e59640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9808066280 0x7f9808068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.402+0000 7f9829e59640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9808066280 0x7f9808068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f98200ad000 tx=0x7f9820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.406+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9814050460 con 0x7f98240cf890 2023-06-09T04:38:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98240ca810 con 0x7f98240cf890 2023-06-09T04:38:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f981a7fc640 1 -- 172.21.15.18:0/4203291834 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9814053a80 con 0x7f98240cf890 2023-06-09T04:38:59.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:38:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9808066280 msgr2=0x7f9808068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9808066280 0x7f9808068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f98200ad000 tx=0x7f9820008040 comp rx=0 tx=0).stop 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 msgr2=0x7f98241587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 0x7f98241587c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f98140011f0 tx=0x7f981400c9b0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 shutdown_connections 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98241595b0 0x7f98240c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240cf890 0x7f98241587c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9808066280 0x7f9808068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 --2- 172.21.15.18:0/4203291834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f98240ccb70 0x7f98240b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 >> 172.21.15.18:0/4203291834 conn(0x7f982406ce60 msgr2=0x7f98240c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 shutdown_connections 2023-06-09T04:38:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.558+0000 7f982c0bd640 1 -- 172.21.15.18:0/4203291834 wait complete. 2023-06-09T04:38:59.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:38:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dff45d640 1 Processor -- start 2023-06-09T04:38:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dff45d640 1 -- start start 2023-06-09T04:38:59.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dff45d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5df8069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dff45d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df815de50 con 0x7f5df81591c0 2023-06-09T04:38:59.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dff45d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df815d2d0 con 0x7f5df80cbd40 2023-06-09T04:38:59.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dff45d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df815d5b0 con 0x7f5df8159590 2023-06-09T04:38:59.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dfd1f9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5df81591c0 0x7f5df80cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60612/0 (socket says 172.21.15.18:60612) 2023-06-09T04:38:59.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.694+0000 7f5dfd1f9640 1 -- 172.21.15.18:0/4289589913 learned_addr learned my addr 172.21.15.18:0/4289589913 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:38:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfd9fa640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5df8069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452415661 0 0) 0x7f5df815de50 con 0x7f5df81591c0 2023-06-09T04:38:59.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de0003530 con 0x7f5df81591c0 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 144597336 0 0) 0x7f5de0003530 con 0x7f5df81591c0 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 msgr2=0x7f5df8069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5df8069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 >> v1:172.21.15.81:6789/0 conn(0x7f5df80cbd40 legacy=0x7f5df8069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df815d890 con 0x7f5df81591c0 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f5df0001800 con 0x7f5df81591c0 2023-06-09T04:38:59.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 >> v1:172.21.15.18:6789/0 conn(0x7f5df81591c0 legacy=0x7f5df80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00039b0 0x7f5de0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de00047d0 0x7f5de0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5de0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df815d5b0 con 0x7f5de00047d0 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de000ba40 con 0x7f5de00039b0 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de000bbd0 con 0x7f5df8159590 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de00047d0 0x7f5de0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfd1f9640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00039b0 0x7f5de0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfd9fa640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5de0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 -- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 msgr2=0x7f5de0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5de0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 -- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00039b0 msgr2=0x7f5de0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00039b0 0x7f5de0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 -- 172.21.15.18:0/4289589913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de0003530 con 0x7f5de00047d0 2023-06-09T04:38:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfd9fa640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df8159590 0x7f5de0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfc9f8640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de00047d0 0x7f5de0004c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5dec001e40 tx=0x7f5dec01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df62ba6497ef05d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec003b80 con 0x7f5de00047d0 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec003ce0 con 0x7f5de00047d0 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5df7fff640 1 -- 172.21.15.18:0/4289589913 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0052c0 con 0x7f5de00047d0 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dff45d640 1 -- 172.21.15.18:0/4289589913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de00047d0 msgr2=0x7f5de0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dff45d640 1 --2- 172.21.15.18:0/4289589913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de00047d0 0x7f5de0004c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5dec001e40 tx=0x7f5dec01c740 comp rx=0 tx=0).stop 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dfd9fa640 1 -- 172.21.15.18:0/4289589913 reap_dead start 2023-06-09T04:38:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dff45d640 1 -- 172.21.15.18:0/4289589913 shutdown_connections 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dff45d640 1 -- 172.21.15.18:0/4289589913 >> 172.21.15.18:0/4289589913 conn(0x7f5df80afa90 msgr2=0x7f5df80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dff45d640 1 -- 172.21.15.18:0/4289589913 shutdown_connections 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.698+0000 7f5dff45d640 1 -- 172.21.15.18:0/4289589913 wait complete. 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 Processor -- start 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- start start 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00047d0 0x7f5df80b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df81506a0 0x7f5df81599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 0x7f5df8147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80c2900 con 0x7f5df80c91a0 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df815a350 con 0x7f5de00047d0 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df815a630 con 0x7f5df81506a0 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 0x7f5df8147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 0x7f5df8147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40168/0 (socket says 172.21.15.18:40168) 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 -- 172.21.15.18:0/2212152086 learned_addr learned my addr 172.21.15.18:0/2212152086 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:38:59.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfc9f8640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df81506a0 0x7f5df81599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd1f9640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00047d0 0x7f5df80b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 -- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df81506a0 msgr2=0x7f5df81599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df81506a0 0x7f5df81599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 -- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00047d0 msgr2=0x7f5df80b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00047d0 0x7f5df80b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 -- 172.21.15.18:0/2212152086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80c2ba0 con 0x7f5df80c91a0 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfc9f8640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df81506a0 0x7f5df81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:59.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dfd9fa640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 0x7f5df8147f00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5df80cade0 tx=0x7f5de8010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80143f0 con 0x7f5df80c91a0 2023-06-09T04:38:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8014550 con 0x7f5df80c91a0 2023-06-09T04:38:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80148e0 con 0x7f5df80c91a0 2023-06-09T04:38:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df80c2e80 con 0x7f5df80c91a0 2023-06-09T04:38:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df815a0f0 con 0x7f5df80c91a0 2023-06-09T04:38:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.702+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df80c3070 con 0x7f5df80c91a0 2023-06-09T04:38:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.706+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5de8014a40 con 0x7f5df80c91a0 2023-06-09T04:38:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.706+0000 7f5df5ffb640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.706+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5de8083430 con 0x7f5df80c91a0 2023-06-09T04:38:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.706+0000 7f5dfd1f9640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.706+0000 7f5dfd1f9640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5df0001140 tx=0x7f5df0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.710+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5de8054050 con 0x7f5df80c91a0 2023-06-09T04:38:59.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5df815a7f0 con 0x7f5df80c91a0 2023-06-09T04:38:59.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5df5ffb640 1 -- 172.21.15.18:0/2212152086 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5de8053be0 con 0x7f5df80c91a0 2023-06-09T04:38:59.865 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:38:59.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 msgr2=0x7f5de4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5df0001140 tx=0x7f5df0009040 comp rx=0 tx=0).stop 2023-06-09T04:38:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 msgr2=0x7f5df8147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 0x7f5df8147f00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5df80cade0 tx=0x7f5de8010850 comp rx=0 tx=0).stop 2023-06-09T04:38:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 shutdown_connections 2023-06-09T04:38:59.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df80c91a0 0x7f5df8147f00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5df81506a0 0x7f5df81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 --2- 172.21.15.18:0/2212152086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00047d0 0x7f5df80b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:59.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 >> 172.21.15.18:0/2212152086 conn(0x7f5df80afa90 msgr2=0x7f5df80c9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 shutdown_connections 2023-06-09T04:38:59.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:38:59.862+0000 7f5dff45d640 1 -- 172.21.15.18:0/2212152086 wait complete. 2023-06-09T04:38:59.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 Processor -- start 2023-06-09T04:39:00.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 -- start start 2023-06-09T04:39:00.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7781579a0 0x7fe7780cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe77806fbd0 0x7fe778070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77815bcb0 con 0x7fe7780ad220 2023-06-09T04:39:00.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe778070590 con 0x7fe77806fbd0 2023-06-09T04:39:00.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77e631640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7780699a0 con 0x7fe7781579a0 2023-06-09T04:39:00.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe77806fbd0 0x7fe778070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe77806fbd0 0x7fe778070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40170/0 (socket says 172.21.15.18:40170) 2023-06-09T04:39:00.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 -- 172.21.15.18:0/535739706 learned_addr learned my addr 172.21.15.18:0/535739706 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:00.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe777fff640 1 --2- 172.21.15.18:0/535739706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7781579a0 0x7fe7780cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 -- 172.21.15.18:0/535739706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7781579a0 msgr2=0x7fe7780cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 --2- 172.21.15.18:0/535739706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7781579a0 0x7fe7780cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 -- 172.21.15.18:0/535739706 >> v1:172.21.15.81:6789/0 conn(0x7fe7780ad220 legacy=0x7fe77815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.010+0000 7fe77cbce640 1 -- 172.21.15.18:0/535739706 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77815bef0 con 0x7fe77806fbd0 2023-06-09T04:39:00.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77cbce640 1 --2- 172.21.15.18:0/535739706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe77806fbd0 0x7fe778070050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe770009e50 tx=0x7fe77001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b75f680ad61ba3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe7777fe640 1 -- 172.21.15.18:0/535739706 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700a58a0 con 0x7fe77806fbd0 2023-06-09T04:39:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe7777fe640 1 -- 172.21.15.18:0/535739706 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7700a5a00 con 0x7fe77806fbd0 2023-06-09T04:39:00.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe7777fe640 1 -- 172.21.15.18:0/535739706 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700a5d90 con 0x7fe77806fbd0 2023-06-09T04:39:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- 172.21.15.18:0/535739706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe77806fbd0 msgr2=0x7fe778070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 --2- 172.21.15.18:0/535739706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe77806fbd0 0x7fe778070050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe770009e50 tx=0x7fe77001c9e0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- 172.21.15.18:0/535739706 shutdown_connections 2023-06-09T04:39:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 --2- 172.21.15.18:0/535739706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe77806fbd0 0x7fe778070050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 --2- 172.21.15.18:0/535739706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7781579a0 0x7fe7780cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- 172.21.15.18:0/535739706 >> 172.21.15.18:0/535739706 conn(0x7fe7780afa90 msgr2=0x7fe7780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- 172.21.15.18:0/535739706 shutdown_connections 2023-06-09T04:39:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- 172.21.15.18:0/535739706 wait complete. 2023-06-09T04:39:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 Processor -- start 2023-06-09T04:39:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- start start 2023-06-09T04:39:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77806fbd0 0x7fe77815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 0x7fe7781431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe778143710 0x7fe778140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe778143b80 con 0x7fe7781579a0 2023-06-09T04:39:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77814ba60 con 0x7fe77806fbd0 2023-06-09T04:39:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe77e631640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77814bd40 con 0x7fe778143710 2023-06-09T04:39:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe76ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 0x7fe7781431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe76ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 0x7fe7781431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40182/0 (socket says 172.21.15.18:40182) 2023-06-09T04:39:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.014+0000 7fe76ffff640 1 -- 172.21.15.18:0/1403577558 learned_addr learned my addr 172.21.15.18:0/1403577558 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe777fff640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77806fbd0 0x7fe77815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe77cbce640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe778143710 0x7fe778140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe76ffff640 1 -- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe778143710 msgr2=0x7fe778140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe76ffff640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe778143710 0x7fe778140af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe76ffff640 1 -- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77806fbd0 msgr2=0x7fe77815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe76ffff640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77806fbd0 0x7fe77815a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe76ffff640 1 -- 172.21.15.18:0/1403577558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770009b30 con 0x7fe7781579a0 2023-06-09T04:39:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe76ffff640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 0x7fe7781431d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c500 tx=0x7fe76000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760005220 con 0x7fe7781579a0 2023-06-09T04:39:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760005380 con 0x7fe7781579a0 2023-06-09T04:39:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760007270 con 0x7fe7781579a0 2023-06-09T04:39:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77814c020 con 0x7fe7781579a0 2023-06-09T04:39:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7780b0d10 con 0x7fe7781579a0 2023-06-09T04:39:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe778073380 con 0x7fe7781579a0 2023-06-09T04:39:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7600073d0 con 0x7fe7781579a0 2023-06-09T04:39:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe7757fa640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe758066280 0x7fe758068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe760083700 con 0x7fe7781579a0 2023-06-09T04:39:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe777fff640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe758066280 0x7fe758068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.018+0000 7fe777fff640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe758066280 0x7fe758068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe768006fd0 tx=0x7fe768008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.022+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7600508a0 con 0x7fe7781579a0 2023-06-09T04:39:00.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.174+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe77815bcb0 con 0x7fe7781579a0 2023-06-09T04:39:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.178+0000 7fe7757fa640 1 -- 172.21.15.18:0/1403577558 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe77815bcb0 con 0x7fe7781579a0 2023-06-09T04:39:00.182 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.178+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe758066280 msgr2=0x7fe758068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.178+0000 7fe77e631640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe758066280 0x7fe758068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe768006fd0 tx=0x7fe768008040 comp rx=0 tx=0).stop 2023-06-09T04:39:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.178+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 msgr2=0x7fe7781431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.178+0000 7fe77e631640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 0x7fe7781431d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe76000c500 tx=0x7fe76000c9c0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 shutdown_connections 2023-06-09T04:39:00.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe758066280 0x7fe758068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe778143710 0x7fe778140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7781579a0 0x7fe7781431d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 --2- 172.21.15.18:0/1403577558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77806fbd0 0x7fe77815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 >> 172.21.15.18:0/1403577558 conn(0x7fe7780afa90 msgr2=0x7fe7780cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 shutdown_connections 2023-06-09T04:39:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.182+0000 7fe77e631640 1 -- 172.21.15.18:0/1403577558 wait complete. 2023-06-09T04:39:00.201 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:00.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 Processor -- start 2023-06-09T04:39:00.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 -- start start 2023-06-09T04:39:00.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5cbc0b12a0 0x7f5cbc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd550 0x7f5cbc15c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cbc070f40 con 0x7f5cbc0cd180 2023-06-09T04:39:00.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc0cb400 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc2d93640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0ae3b0 con 0x7f5cbc0cd550 2023-06-09T04:39:00.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cbbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5cbc0b12a0 0x7f5cbc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cbbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5cbc0b12a0 0x7f5cbc0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40194/0 (socket says 172.21.15.18:40194) 2023-06-09T04:39:00.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cbbfff640 1 -- 172.21.15.18:0/1874878174 learned_addr learned my addr 172.21.15.18:0/1874878174 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:00.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cc1330640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd550 0x7f5cbc15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cbbfff640 1 -- 172.21.15.18:0/1874878174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd550 msgr2=0x7f5cbc15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cbbfff640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd550 0x7f5cbc15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.326 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.318+0000 7f5cbbfff640 1 -- 172.21.15.18:0/1874878174 >> v1:172.21.15.81:6789/0 conn(0x7f5cbc0cd180 legacy=0x7f5cbc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cbbfff640 1 -- 172.21.15.18:0/1874878174 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc06e340 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc1330640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd550 0x7f5cbc15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:00.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cbbfff640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc0cc6b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000bb10 tx=0x7f5cb001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742394d14771f86f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cbb7fe640 1 -- 172.21.15.18:0/1874878174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00a7cb0 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cbb7fe640 1 -- 172.21.15.18:0/1874878174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb00a7e10 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cbb7fe640 1 -- 172.21.15.18:0/1874878174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00af660 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 -- 172.21.15.18:0/1874878174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 msgr2=0x7f5cbc0cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc0cc6b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000bb10 tx=0x7f5cb001ebe0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 -- 172.21.15.18:0/1874878174 shutdown_connections 2023-06-09T04:39:00.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd550 0x7f5cbc15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/1874878174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc0cc6b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 -- 172.21.15.18:0/1874878174 >> 172.21.15.18:0/1874878174 conn(0x7f5cbc0b2720 msgr2=0x7f5cbc0ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.322+0000 7f5cc2d93640 1 -- 172.21.15.18:0/1874878174 shutdown_connections 2023-06-09T04:39:00.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 -- 172.21.15.18:0/1874878174 wait complete. 2023-06-09T04:39:00.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 Processor -- start 2023-06-09T04:39:00.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 -- start start 2023-06-09T04:39:00.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd180 0x7f5cbc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc0cd550 0x7f5cbc0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0c6590 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0c6870 con 0x7f5cbc0cd550 2023-06-09T04:39:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc2d93640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0c6b50 con 0x7f5cbc0cd180 2023-06-09T04:39:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc1526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40196/0 (socket says 172.21.15.18:40196) 2023-06-09T04:39:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 -- 172.21.15.18:0/3119151966 learned_addr learned my addr 172.21.15.18:0/3119151966 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cbbfff640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd180 0x7f5cbc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc1330640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc0cd550 0x7f5cbc0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 -- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd180 msgr2=0x7f5cbc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd180 0x7f5cbc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 -- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc0cd550 msgr2=0x7f5cbc0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc0cd550 0x7f5cbc0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 -- 172.21.15.18:0/3119151966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb000b770 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cbbfff640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd180 0x7f5cbc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc1330640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc0cd550 0x7f5cbc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cc0b2f640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc1526f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c3c0 tx=0x7f5ca800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80052d0 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8005430 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.326+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8003840 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc0c6e30 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc15c400 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc073380 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ca80039a0 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cb97fa640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ca0066280 0x7f5ca0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ca80834d0 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cbbfff640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ca0066280 0x7f5ca0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.330+0000 7f5cbbfff640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ca0066280 0x7f5ca0068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00b1000 tx=0x7f5cb00a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.334+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ca80506f0 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.490+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cbc0c92d0 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.490+0000 7f5cb97fa640 1 -- 172.21.15.18:0/3119151966 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f5ca8053d10 con 0x7f5cbc0b12a0 2023-06-09T04:39:00.496 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:00.496 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ca0066280 msgr2=0x7f5ca0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ca0066280 0x7f5ca0068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00b1000 tx=0x7f5cb00a9070 comp rx=0 tx=0).stop 2023-06-09T04:39:00.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 msgr2=0x7f5cbc1526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc1526f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c3c0 tx=0x7f5ca800c880 comp rx=0 tx=0).stop 2023-06-09T04:39:00.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 shutdown_connections 2023-06-09T04:39:00.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cbc0cd550 0x7f5cbc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.499 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ca0066280 0x7f5ca0068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cbc0cd180 0x7f5cbc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 --2- 172.21.15.18:0/3119151966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5cbc0b12a0 0x7f5cbc1526f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 >> 172.21.15.18:0/3119151966 conn(0x7f5cbc0b2720 msgr2=0x7f5cbc0cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 shutdown_connections 2023-06-09T04:39:00.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.494+0000 7f5cc2d93640 1 -- 172.21.15.18:0/3119151966 wait complete. 2023-06-09T04:39:00.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:00.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:00.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 Processor -- start 2023-06-09T04:39:00.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 -- start start 2023-06-09T04:39:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda9415f280 0x7fda9415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda940b39d0 0x7fda940b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9415fd40 con 0x7fda9415b600 2023-06-09T04:39:00.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940cfce0 con 0x7fda940b39d0 2023-06-09T04:39:00.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda9b23a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b4390 con 0x7fda9415f280 2023-06-09T04:39:00.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda997d7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda940b39d0 0x7fda940b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda98fd6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda9415b600 0x7fda940b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60624/0 (socket says 172.21.15.18:60624) 2023-06-09T04:39:00.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda98fd6640 1 -- 172.21.15.18:0/681658867 learned_addr learned my addr 172.21.15.18:0/681658867 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:00.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda93fff640 1 --2- 172.21.15.18:0/681658867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda9415f280 0x7fda9415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda997d7640 1 -- 172.21.15.18:0/681658867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda9415f280 msgr2=0x7fda9415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda997d7640 1 --2- 172.21.15.18:0/681658867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda9415f280 0x7fda9415f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda997d7640 1 -- 172.21.15.18:0/681658867 >> v1:172.21.15.18:6789/0 conn(0x7fda9415b600 legacy=0x7fda940b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda997d7640 1 -- 172.21.15.18:0/681658867 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94160020 con 0x7fda940b39d0 2023-06-09T04:39:00.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.630+0000 7fda937fe640 1 -- 172.21.15.18:0/681658867 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774818139 0 0) 0x7fda9415fd40 con 0x7fda9415b600 2023-06-09T04:39:00.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda997d7640 1 --2- 172.21.15.18:0/681658867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda940b39d0 0x7fda940b3e50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009d90 tx=0x7fda8c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c247adf6d6d9a47 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda937fe640 1 -- 172.21.15.18:0/681658867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0a5870 con 0x7fda940b39d0 2023-06-09T04:39:00.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda937fe640 1 -- 172.21.15.18:0/681658867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c0a59d0 con 0x7fda940b39d0 2023-06-09T04:39:00.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda937fe640 1 -- 172.21.15.18:0/681658867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0a5d60 con 0x7fda940b39d0 2023-06-09T04:39:00.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/681658867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda940b39d0 msgr2=0x7fda940b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 --2- 172.21.15.18:0/681658867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda940b39d0 0x7fda940b3e50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009d90 tx=0x7fda8c01c8c0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/681658867 shutdown_connections 2023-06-09T04:39:00.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 --2- 172.21.15.18:0/681658867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda940b39d0 0x7fda940b3e50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 --2- 172.21.15.18:0/681658867 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda9415f280 0x7fda9415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/681658867 >> 172.21.15.18:0/681658867 conn(0x7fda940d2120 msgr2=0x7fda940d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/681658867 shutdown_connections 2023-06-09T04:39:00.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/681658867 wait complete. 2023-06-09T04:39:00.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 Processor -- start 2023-06-09T04:39:00.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- start start 2023-06-09T04:39:00.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda940b39d0 0x7fda9414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 0x7fda9415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda9415f280 0x7fda9415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda94151470 con 0x7fda9415b600 2023-06-09T04:39:00.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9415e5b0 con 0x7fda9415f280 2023-06-09T04:39:00.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9415e860 con 0x7fda940b39d0 2023-06-09T04:39:00.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 0x7fda9415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 0x7fda9415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40206/0 (socket says 172.21.15.18:40206) 2023-06-09T04:39:00.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 -- 172.21.15.18:0/104388532 learned_addr learned my addr 172.21.15.18:0/104388532 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:00.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda98fd6640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda940b39d0 0x7fda9414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda997d7640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda9415f280 0x7fda9415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 -- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda940b39d0 msgr2=0x7fda9414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda940b39d0 0x7fda9414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 -- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda9415f280 msgr2=0x7fda9415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda9415f280 0x7fda9415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 -- 172.21.15.18:0/104388532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009a70 con 0x7fda9415b600 2023-06-09T04:39:00.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda997d7640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda9415f280 0x7fda9415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda93fff640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 0x7fda9415db30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda8800d5f0 tx=0x7fda8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880125f0 con 0x7fda9415b600 2023-06-09T04:39:00.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88012750 con 0x7fda9415b600 2023-06-09T04:39:00.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88012ae0 con 0x7fda9415b600 2023-06-09T04:39:00.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94150e20 con 0x7fda9415b600 2023-06-09T04:39:00.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.634+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9414f830 con 0x7fda9415b600 2023-06-09T04:39:00.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.638+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94073380 con 0x7fda9415b600 2023-06-09T04:39:00.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.638+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda88012c40 con 0x7fda9415b600 2023-06-09T04:39:00.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.638+0000 7fda917fa640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda80066280 0x7fda80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.638+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda880845a0 con 0x7fda9415b600 2023-06-09T04:39:00.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.638+0000 7fda98fd6640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda80066280 0x7fda80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.638+0000 7fda98fd6640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda80066280 0x7fda80068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda84000f70 tx=0x7fda84007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.642+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda88051690 con 0x7fda9415b600 2023-06-09T04:39:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.786+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda9406a7d0 con 0x7fda9415b600 2023-06-09T04:39:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.786+0000 7fda917fa640 1 -- 172.21.15.18:0/104388532 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda88054cb0 con 0x7fda9415b600 2023-06-09T04:39:00.792 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:00.793 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda80066280 msgr2=0x7fda80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.793 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda80066280 0x7fda80068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda84000f70 tx=0x7fda84007b60 comp rx=0 tx=0).stop 2023-06-09T04:39:00.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 msgr2=0x7fda9415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 0x7fda9415db30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda8800d5f0 tx=0x7fda8800dab0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 shutdown_connections 2023-06-09T04:39:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda9415f280 0x7fda9415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9415b600 0x7fda9415db30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda80066280 0x7fda80068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 --2- 172.21.15.18:0/104388532 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda940b39d0 0x7fda9414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 >> 172.21.15.18:0/104388532 conn(0x7fda940d2120 msgr2=0x7fda940b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 shutdown_connections 2023-06-09T04:39:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.790+0000 7fda9b23a640 1 -- 172.21.15.18:0/104388532 wait complete. 2023-06-09T04:39:00.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:00.936 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 Processor -- start 2023-06-09T04:39:00.937 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 -- start start 2023-06-09T04:39:00.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f126c15b970 0x7f126c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f126c06c420 0x7f126c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c06cdc0 con 0x7f126c15ffb0 2023-06-09T04:39:00.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0c9220 con 0x7f126c15b970 2023-06-09T04:39:00.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f1273408640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0c9500 con 0x7f126c06c420 2023-06-09T04:39:00.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12711a4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f126c15b970 0x7f126c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12709a3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f126c15ffb0 0x7f126c0c8960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60634/0 (socket says 172.21.15.18:60634) 2023-06-09T04:39:00.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12709a3640 1 -- 172.21.15.18:0/1488148302 learned_addr learned my addr 172.21.15.18:0/1488148302 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:00.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12719a5640 1 --2- 172.21.15.18:0/1488148302 >> v2:172.21.15.81:3300/0 conn(0x7f126c06c420 0x7f126c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12711a4640 1 -- 172.21.15.18:0/1488148302 >> v2:172.21.15.81:3300/0 conn(0x7f126c06c420 msgr2=0x7f126c06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:00.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12711a4640 1 --2- 172.21.15.18:0/1488148302 >> v2:172.21.15.81:3300/0 conn(0x7f126c06c420 0x7f126c06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12711a4640 1 -- 172.21.15.18:0/1488148302 >> v1:172.21.15.18:6789/0 conn(0x7f126c15ffb0 legacy=0x7f126c0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.934+0000 7f12711a4640 1 -- 172.21.15.18:0/1488148302 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c15c0c0 con 0x7f126c15b970 2023-06-09T04:39:00.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12711a4640 1 --2- 172.21.15.18:0/1488148302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15b970 0x7f126c15c8c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ce2a0 tx=0x7f126801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6c610c9904392 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1263fff640 1 -- 172.21.15.18:0/1488148302 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680ab600 con 0x7f126c15b970 2023-06-09T04:39:00.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1263fff640 1 -- 172.21.15.18:0/1488148302 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12680a7050 con 0x7f126c15b970 2023-06-09T04:39:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1263fff640 1 -- 172.21.15.18:0/1488148302 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680ab980 con 0x7f126c15b970 2023-06-09T04:39:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- 172.21.15.18:0/1488148302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15b970 msgr2=0x7f126c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 --2- 172.21.15.18:0/1488148302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15b970 0x7f126c15c8c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ce2a0 tx=0x7f126801c3d0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- 172.21.15.18:0/1488148302 shutdown_connections 2023-06-09T04:39:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 --2- 172.21.15.18:0/1488148302 >> v2:172.21.15.81:3300/0 conn(0x7f126c06c420 0x7f126c06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 --2- 172.21.15.18:0/1488148302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15b970 0x7f126c15c8c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- 172.21.15.18:0/1488148302 >> 172.21.15.18:0/1488148302 conn(0x7f126c0b0220 msgr2=0x7f126c0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:00.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- 172.21.15.18:0/1488148302 shutdown_connections 2023-06-09T04:39:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- 172.21.15.18:0/1488148302 wait complete. 2023-06-09T04:39:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 Processor -- start 2023-06-09T04:39:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- start start 2023-06-09T04:39:00.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f126c06c420 0x7f126c14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f126c15b970 0x7f126c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 0x7f126c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c151e20 con 0x7f126c15ffb0 2023-06-09T04:39:00.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c15b230 con 0x7f126c15b970 2023-06-09T04:39:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f1273408640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c152490 con 0x7f126c06c420 2023-06-09T04:39:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 0x7f126c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 0x7f126c15acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40226/0 (socket says 172.21.15.18:40226) 2023-06-09T04:39:00.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 -- 172.21.15.18:0/824273855 learned_addr learned my addr 172.21.15.18:0/824273855 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12711a4640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f126c06c420 0x7f126c14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12709a3640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f126c15b970 0x7f126c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 -- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f126c06c420 msgr2=0x7f126c14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f126c06c420 0x7f126c14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 -- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f126c15b970 msgr2=0x7f126c1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f126c15b970 0x7f126c1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.938+0000 7f12719a5640 1 -- 172.21.15.18:0/824273855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009420 con 0x7f126c15ffb0 2023-06-09T04:39:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f12709a3640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f126c15b970 0x7f126c1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f12711a4640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f126c06c420 0x7f126c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f12719a5640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 0x7f126c15acf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f126400efc0 tx=0x7f126400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264009ba0 con 0x7f126c15ffb0 2023-06-09T04:39:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126400f040 con 0x7f126c15ffb0 2023-06-09T04:39:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640146c0 con 0x7f126c15ffb0 2023-06-09T04:39:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c152770 con 0x7f126c15ffb0 2023-06-09T04:39:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c152d30 con 0x7f126c15ffb0 2023-06-09T04:39:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c073380 con 0x7f126c15ffb0 2023-06-09T04:39:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1264014820 con 0x7f126c15ffb0 2023-06-09T04:39:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1261ffb640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1250066280 0x7f1250068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12640853f0 con 0x7f126c15ffb0 2023-06-09T04:39:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f12711a4640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1250066280 0x7f1250068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.942+0000 7f12711a4640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1250066280 0x7f1250068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f12680ad000 tx=0x7f1268008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:00.946+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1264052560 con 0x7f126c15ffb0 2023-06-09T04:39:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f126c0cbc00 con 0x7f126c15ffb0 2023-06-09T04:39:01.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1261ffb640 1 -- 172.21.15.18:0/824273855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1264055b80 con 0x7f126c15ffb0 2023-06-09T04:39:01.105 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:01.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1250066280 msgr2=0x7f1250068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1250066280 0x7f1250068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f12680ad000 tx=0x7f1268008040 comp rx=0 tx=0).stop 2023-06-09T04:39:01.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 msgr2=0x7f126c15acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 0x7f126c15acf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f126400efc0 tx=0x7f126400c490 comp rx=0 tx=0).stop 2023-06-09T04:39:01.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 shutdown_connections 2023-06-09T04:39:01.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f126c15ffb0 0x7f126c15acf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f126c15b970 0x7f126c1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1250066280 0x7f1250068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 --2- 172.21.15.18:0/824273855 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f126c06c420 0x7f126c14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 >> 172.21.15.18:0/824273855 conn(0x7f126c0b0220 msgr2=0x7f126c154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 shutdown_connections 2023-06-09T04:39:01.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.102+0000 7f1273408640 1 -- 172.21.15.18:0/824273855 wait complete. 2023-06-09T04:39:01.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 Processor -- start 2023-06-09T04:39:01.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 -- start start 2023-06-09T04:39:01.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44201527e0 0x7f44200692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f44200c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442015fb20 con 0x7f442015f590 2023-06-09T04:39:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442015fe00 con 0x7f44201527e0 2023-06-09T04:39:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f4425635640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442006fd50 con 0x7f442015f140 2023-06-09T04:39:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f44200c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44201527e0 0x7f44200692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f44200c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:46720/0 (socket says 172.21.15.18:46720) 2023-06-09T04:39:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 -- 172.21.15.18:0/1013259727 learned_addr learned my addr 172.21.15.18:0/1013259727 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 -- 172.21.15.18:0/1013259727 >> v2:172.21.15.81:3300/0 conn(0x7f44201527e0 msgr2=0x7f44200692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 --2- 172.21.15.18:0/1013259727 >> v2:172.21.15.81:3300/0 conn(0x7f44201527e0 0x7f44200692b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 -- 172.21.15.18:0/1013259727 >> v1:172.21.15.81:6789/0 conn(0x7f442015f590 legacy=0x7f4420070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441e7fc640 1 -- 172.21.15.18:0/1013259727 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420070030 con 0x7f442015f140 2023-06-09T04:39:01.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.250+0000 7f441effd640 1 --2- 172.21.15.18:0/1013259727 >> v2:172.21.15.81:3300/0 conn(0x7f44201527e0 0x7f44200692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:01.259 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f441e7fc640 1 --2- 172.21.15.18:0/1013259727 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f44200c2900 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4414009870 tx=0x7f441401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d4b10fd417c88c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.260 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f441dffb640 1 -- 172.21.15.18:0/1013259727 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140ab650 con 0x7f442015f140 2023-06-09T04:39:01.260 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f441dffb640 1 -- 172.21.15.18:0/1013259727 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44140ab7b0 con 0x7f442015f140 2023-06-09T04:39:01.260 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f441dffb640 1 -- 172.21.15.18:0/1013259727 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140abb40 con 0x7f442015f140 2023-06-09T04:39:01.260 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 -- 172.21.15.18:0/1013259727 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 msgr2=0x7f44200c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.261 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 --2- 172.21.15.18:0/1013259727 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f44200c2900 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4414009870 tx=0x7f441401c540 comp rx=0 tx=0).stop 2023-06-09T04:39:01.261 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 -- 172.21.15.18:0/1013259727 shutdown_connections 2023-06-09T04:39:01.261 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 --2- 172.21.15.18:0/1013259727 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f44200c2900 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.261 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 --2- 172.21.15.18:0/1013259727 >> v2:172.21.15.81:3300/0 conn(0x7f44201527e0 0x7f44200692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.261 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 -- 172.21.15.18:0/1013259727 >> 172.21.15.18:0/1013259727 conn(0x7f44200afa90 msgr2=0x7f44200afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 -- 172.21.15.18:0/1013259727 shutdown_connections 2023-06-09T04:39:01.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.254+0000 7f4425635640 1 -- 172.21.15.18:0/1013259727 wait complete. 2023-06-09T04:39:01.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 Processor -- start 2023-06-09T04:39:01.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- start start 2023-06-09T04:39:01.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 0x7f442014f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f442015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442015f590 0x7f44200ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44200abd60 con 0x7f44201527e0 2023-06-09T04:39:01.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442015dbd0 con 0x7f442015f590 2023-06-09T04:39:01.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442015e3b0 con 0x7f442015f140 2023-06-09T04:39:01.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 0x7f442014f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 0x7f442014f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40228/0 (socket says 172.21.15.18:40228) 2023-06-09T04:39:01.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 -- 172.21.15.18:0/444800551 learned_addr learned my addr 172.21.15.18:0/444800551 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:01.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441e7fc640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f442015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441f7fe640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442015f590 0x7f44200ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 -- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 msgr2=0x7f442015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f442015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 -- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442015f590 msgr2=0x7f44200ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442015f590 0x7f44200ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 -- 172.21.15.18:0/444800551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100093b0 con 0x7f44201527e0 2023-06-09T04:39:01.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f441effd640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 0x7f442014f170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f441000ec10 tx=0x7f441000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410009760 con 0x7f44201527e0 2023-06-09T04:39:01.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000cc30 con 0x7f44201527e0 2023-06-09T04:39:01.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44140094d0 con 0x7f44201527e0 2023-06-09T04:39:01.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100059a0 con 0x7f44201527e0 2023-06-09T04:39:01.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44200abfb0 con 0x7f44201527e0 2023-06-09T04:39:01.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4420073380 con 0x7f44201527e0 2023-06-09T04:39:01.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.258+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4410005b00 con 0x7f44201527e0 2023-06-09T04:39:01.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.262+0000 7f44077fe640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f440c066280 0x7f440c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.262+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4410084440 con 0x7f44201527e0 2023-06-09T04:39:01.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.262+0000 7f441e7fc640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f440c066280 0x7f440c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.262+0000 7f441e7fc640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f440c066280 0x7f440c068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44140af000 tx=0x7f44140b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.266+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4410051690 con 0x7f44201527e0 2023-06-09T04:39:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44200b0440 con 0x7f44201527e0 2023-06-09T04:39:01.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f44077fe640 1 -- 172.21.15.18:0/444800551 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4410054cb0 con 0x7f44201527e0 2023-06-09T04:39:01.417 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f440c066280 msgr2=0x7f440c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f440c066280 0x7f440c068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44140af000 tx=0x7f44140b6040 comp rx=0 tx=0).stop 2023-06-09T04:39:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 msgr2=0x7f442014f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 0x7f442014f170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f441000ec10 tx=0x7f441000c520 comp rx=0 tx=0).stop 2023-06-09T04:39:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 shutdown_connections 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442015f590 0x7f44200ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f440c066280 0x7f440c068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f442015f140 0x7f442015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 --2- 172.21.15.18:0/444800551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44201527e0 0x7f442014f170 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 >> 172.21.15.18:0/444800551 conn(0x7f44200afa90 msgr2=0x7f44200cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 shutdown_connections 2023-06-09T04:39:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.414+0000 7f4425635640 1 -- 172.21.15.18:0/444800551 wait complete. 2023-06-09T04:39:01.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.546+0000 7f9a7c044640 1 Processor -- start 2023-06-09T04:39:01.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.546+0000 7f9a7c044640 1 -- start start 2023-06-09T04:39:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7c044640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a740ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7c044640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a74069df0 con 0x7f9a740b1530 2023-06-09T04:39:01.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7c044640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7406a0d0 con 0x7f9a7406b800 2023-06-09T04:39:01.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7c044640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740cc610 con 0x7f9a740b75e0 2023-06-09T04:39:01.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a795df640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9a740b1530 0x7f9a7406b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60636/0 (socket says 172.21.15.18:60636) 2023-06-09T04:39:01.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a795df640 1 -- 172.21.15.18:0/124061427 learned_addr learned my addr 172.21.15.18:0/124061427 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:01.554 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a79de0640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a740ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434586427 0 0) 0x7f9a74069df0 con 0x7f9a740b1530 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a60003530 con 0x7f9a740b1530 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925846063 0 0) 0x7f9a60003530 con 0x7f9a740b1530 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 msgr2=0x7f9a740ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a740ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 >> v1:172.21.15.81:6789/0 conn(0x7f9a7406b800 legacy=0x7f9a740cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740cc8f0 con 0x7f9a740b1530 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f9a64001680 con 0x7f9a740b1530 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 >> v1:172.21.15.18:6789/0 conn(0x7f9a740b1530 legacy=0x7f9a7406b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a60003f30 0x7f9a600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740cc610 con 0x7f9a60004d10 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6000ba70 con 0x7f9a60003f30 2023-06-09T04:39:01.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6000bc30 con 0x7f9a740b75e0 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7a5e1640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a795df640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a60003f30 0x7f9a600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a79de0640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7a5e1640 1 -- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 msgr2=0x7f9a600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7a5e1640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7a5e1640 1 -- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a60003f30 msgr2=0x7f9a600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7a5e1640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a60003f30 0x7f9a600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a7a5e1640 1 -- 172.21.15.18:0/124061427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60003530 con 0x7f9a60004d10 2023-06-09T04:39:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a795df640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a60003f30 0x7f9a600047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.550+0000 7f9a79de0640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740b75e0 0x7f9a600039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:01.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7a5e1640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a60005180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a7406bbf0 tx=0x7f9a6c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0590051c4f860c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c003b80 con 0x7f9a60004d10 2023-06-09T04:39:01.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c003ce0 con 0x7f9a60004d10 2023-06-09T04:39:01.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a78dde640 1 -- 172.21.15.18:0/124061427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c005310 con 0x7f9a60004d10 2023-06-09T04:39:01.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- 172.21.15.18:0/124061427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 msgr2=0x7f9a60005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 --2- 172.21.15.18:0/124061427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a60005180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a7406bbf0 tx=0x7f9a6c01c700 comp rx=0 tx=0).stop 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7a5e1640 1 -- 172.21.15.18:0/124061427 reap_dead start 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- 172.21.15.18:0/124061427 shutdown_connections 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- 172.21.15.18:0/124061427 >> 172.21.15.18:0/124061427 conn(0x7f9a740b46c0 msgr2=0x7f9a740d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- 172.21.15.18:0/124061427 shutdown_connections 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- 172.21.15.18:0/124061427 wait complete. 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 Processor -- start 2023-06-09T04:39:01.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- start start 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a7414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a740cb520 0x7f9a740cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740c9d40 0x7f9a740ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740cbed0 con 0x7f9a60004d10 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740a8890 con 0x7f9a740cb520 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740a9410 con 0x7f9a740c9d40 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a7414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a7414d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40242/0 (socket says 172.21.15.18:40242) 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 -- 172.21.15.18:0/2070726945 learned_addr learned my addr 172.21.15.18:0/2070726945 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7a5e1640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740c9d40 0x7f9a740ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a795df640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a740cb520 0x7f9a740cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 -- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740c9d40 msgr2=0x7f9a740ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740c9d40 0x7f9a740ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 -- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a740cb520 msgr2=0x7f9a740cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a740cb520 0x7f9a740cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 -- 172.21.15.18:0/2070726945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740a8ae0 con 0x7f9a60004d10 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7a5e1640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740c9d40 0x7f9a740ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a79de0640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a7414d3d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9a70010930 tx=0x7f9a70010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000ec20 con 0x7f9a60004d10 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7000ed80 con 0x7f9a60004d10 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70004260 con 0x7f9a60004d10 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.554+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a740a8dc0 con 0x7f9a60004d10 2023-06-09T04:39:01.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7414d910 con 0x7f9a60004d10 2023-06-09T04:39:01.565 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a740d2e50 con 0x7f9a60004d10 2023-06-09T04:39:01.565 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a700043c0 con 0x7f9a60004d10 2023-06-09T04:39:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a6a7fc640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a58066280 0x7f9a58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a70083fe0 con 0x7f9a60004d10 2023-06-09T04:39:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a795df640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a58066280 0x7f9a58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.558+0000 7f9a795df640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a58066280 0x7f9a58068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a740b0970 tx=0x7f9a64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.562+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a70051160 con 0x7f9a60004d10 2023-06-09T04:39:01.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.714+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a7415ecf0 con 0x7f9a60004d10 2023-06-09T04:39:01.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.714+0000 7f9a6a7fc640 1 -- 172.21.15.18:0/2070726945 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a70054780 con 0x7f9a60004d10 2023-06-09T04:39:01.718 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:01.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a58066280 msgr2=0x7f9a58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a58066280 0x7f9a58068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a740b0970 tx=0x7f9a64009040 comp rx=0 tx=0).stop 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 msgr2=0x7f9a7414d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a7414d3d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9a70010930 tx=0x7f9a70010df0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 shutdown_connections 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a58066280 0x7f9a58068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a740c9d40 0x7f9a740ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a740cb520 0x7f9a740cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 --2- 172.21.15.18:0/2070726945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60004d10 0x7f9a7414d3d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 >> 172.21.15.18:0/2070726945 conn(0x7f9a740b46c0 msgr2=0x7f9a740cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 shutdown_connections 2023-06-09T04:39:01.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.718+0000 7f9a7c044640 1 -- 172.21.15.18:0/2070726945 wait complete. 2023-06-09T04:39:01.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 Processor -- start 2023-06-09T04:39:01.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 -- start start 2023-06-09T04:39:01.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15b600 0x7f25fc0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25fc15f280 0x7f25fc15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc15fd40 con 0x7f25fc0b39d0 2023-06-09T04:39:01.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25fc0cfce0 con 0x7f25fc15f280 2023-06-09T04:39:01.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f26009a4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc160020 con 0x7f25fc15b600 2023-06-09T04:39:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f25fc0b39d0 0x7f25fc0d06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60650/0 (socket says 172.21.15.18:60650) 2023-06-09T04:39:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fad9d640 1 -- 172.21.15.18:0/3477016150 learned_addr learned my addr 172.21.15.18:0/3477016150 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/3477016150 >> v2:172.21.15.81:3300/0 conn(0x7f25fc15f280 0x7f25fc15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fa59c640 1 --2- 172.21.15.18:0/3477016150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15b600 0x7f25fc0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25f959a640 1 -- 172.21.15.18:0/3477016150 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899093028 0 0) 0x7f25fc15fd40 con 0x7f25fc0b39d0 2023-06-09T04:39:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25f959a640 1 -- 172.21.15.18:0/3477016150 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e4003530 con 0x7f25fc0b39d0 2023-06-09T04:39:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fa59c640 1 -- 172.21.15.18:0/3477016150 >> v2:172.21.15.81:3300/0 conn(0x7f25fc15f280 msgr2=0x7f25fc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fa59c640 1 --2- 172.21.15.18:0/3477016150 >> v2:172.21.15.81:3300/0 conn(0x7f25fc15f280 0x7f25fc15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fa59c640 1 -- 172.21.15.18:0/3477016150 >> v1:172.21.15.18:6789/0 conn(0x7f25fc0b39d0 legacy=0x7f25fc0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.858+0000 7f25fa59c640 1 -- 172.21.15.18:0/3477016150 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc0cfef0 con 0x7f25fc15b600 2023-06-09T04:39:01.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f25fa59c640 1 --2- 172.21.15.18:0/3477016150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15b600 0x7f25fc0b4da0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0097c0 tx=0x7f25ec01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ff8a360d9aec11 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f25f959a640 1 -- 172.21.15.18:0/3477016150 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0ac640 con 0x7f25fc15b600 2023-06-09T04:39:01.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f25f959a640 1 -- 172.21.15.18:0/3477016150 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec0ac7a0 con 0x7f25fc15b600 2023-06-09T04:39:01.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f25f959a640 1 -- 172.21.15.18:0/3477016150 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0acb10 con 0x7f25fc15b600 2023-06-09T04:39:01.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 -- 172.21.15.18:0/3477016150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15b600 msgr2=0x7f25fc0b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 --2- 172.21.15.18:0/3477016150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15b600 0x7f25fc0b4da0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0097c0 tx=0x7f25ec01c3c0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 -- 172.21.15.18:0/3477016150 shutdown_connections 2023-06-09T04:39:01.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 --2- 172.21.15.18:0/3477016150 >> v2:172.21.15.81:3300/0 conn(0x7f25fc15f280 0x7f25fc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 --2- 172.21.15.18:0/3477016150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15b600 0x7f25fc0b4da0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 -- 172.21.15.18:0/3477016150 >> 172.21.15.18:0/3477016150 conn(0x7f25fc0d2120 msgr2=0x7f25fc0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:01.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 -- 172.21.15.18:0/3477016150 shutdown_connections 2023-06-09T04:39:01.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 -- 172.21.15.18:0/3477016150 wait complete. 2023-06-09T04:39:01.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 Processor -- start 2023-06-09T04:39:01.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.862+0000 7f26009a4640 1 -- start start 2023-06-09T04:39:01.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc0b39d0 0x7f25fc156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 0x7f25fc150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15f280 0x7f25fc151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc15ca10 con 0x7f25fc15b600 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc15ccf0 con 0x7f25fc0b39d0 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc15cfd0 con 0x7f25fc15f280 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 0x7f25fc150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 0x7f25fc150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40252/0 (socket says 172.21.15.18:40252) 2023-06-09T04:39:01.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2691315430 learned_addr learned my addr 172.21.15.18:0/2691315430 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc0b39d0 0x7f25fc156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25fad9d640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15f280 0x7f25fc151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15f280 msgr2=0x7f25fc151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15f280 0x7f25fc151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc0b39d0 msgr2=0x7f25fc156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc0b39d0 0x7f25fc156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:01.870 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 -- 172.21.15.18:0/2691315430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec009420 con 0x7f25fc15b600 2023-06-09T04:39:01.871 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25f9d9b640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 0x7f25fc150cf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e930 tx=0x7f25f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0009690 con 0x7f25fc15b600 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f000ca00 con 0x7f25fc15b600 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000cd70 con 0x7f25fc15b600 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25fc15d2b0 con 0x7f25fc15b600 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc1565c0 con 0x7f25fc15b600 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc073380 con 0x7f25fc15b600 2023-06-09T04:39:01.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25f0013470 con 0x7f25fc15b600 2023-06-09T04:39:01.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25eaffd640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f25dc066280 0x7f25dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:01.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25f00842d0 con 0x7f25fc15b600 2023-06-09T04:39:01.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.866+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f25dc066280 0x7f25dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:01.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.870+0000 7f25fa59c640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f25dc066280 0x7f25dc068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ae000 tx=0x7f25ec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:01.874 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:01.870+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25f0051490 con 0x7f25fc15b600 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.022+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f25fc06a7d0 con 0x7f25fc15b600 2023-06-09T04:39:02.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.022+0000 7f25eaffd640 1 -- 172.21.15.18:0/2691315430 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f25f0054ab0 con 0x7f25fc15b600 2023-06-09T04:39:02.027 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f25dc066280 msgr2=0x7f25dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f25dc066280 0x7f25dc068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ae000 tx=0x7f25ec0a7000 comp rx=0 tx=0).stop 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 msgr2=0x7f25fc150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 0x7f25fc150cf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e930 tx=0x7f25f000edf0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 shutdown_connections 2023-06-09T04:39:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f25dc066280 0x7f25dc068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f25fc15f280 0x7f25fc151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc15b600 0x7f25fc150cf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 --2- 172.21.15.18:0/2691315430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25fc0b39d0 0x7f25fc156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 >> 172.21.15.18:0/2691315430 conn(0x7f25fc0d2120 msgr2=0x7f25fc0b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 shutdown_connections 2023-06-09T04:39:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.026+0000 7f26009a4640 1 -- 172.21.15.18:0/2691315430 wait complete. 2023-06-09T04:39:02.045 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:02.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.162+0000 7f3f559a5640 1 Processor -- start 2023-06-09T04:39:02.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.162+0000 7f3f559a5640 1 -- start start 2023-06-09T04:39:02.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f559a5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f500cc9b0 0x7f3f5015f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f559a5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f5015f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f559a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5015c950 con 0x7f3f500b7480 2023-06-09T04:39:02.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f559a5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500ce320 con 0x7f3f500cc9b0 2023-06-09T04:39:02.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f559a5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500cc4b0 con 0x7f3f500b3fe0 2023-06-09T04:39:02.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f5015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f5015f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:46774/0 (socket says 172.21.15.18:46774) 2023-06-09T04:39:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 -- 172.21.15.18:0/1753400928 learned_addr learned my addr 172.21.15.18:0/1753400928 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4e7fc640 1 --2- 172.21.15.18:0/1753400928 >> v2:172.21.15.81:3300/0 conn(0x7f3f500cc9b0 0x7f3f5015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 -- 172.21.15.18:0/1753400928 >> v2:172.21.15.81:3300/0 conn(0x7f3f500cc9b0 msgr2=0x7f3f5015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 --2- 172.21.15.18:0/1753400928 >> v2:172.21.15.81:3300/0 conn(0x7f3f500cc9b0 0x7f3f5015f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 -- 172.21.15.18:0/1753400928 >> v1:172.21.15.81:6789/0 conn(0x7f3f500b7480 legacy=0x7f3f500b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 -- 172.21.15.18:0/1753400928 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500ce010 con 0x7f3f500b3fe0 2023-06-09T04:39:02.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.166+0000 7f3f4f7fe640 1 --2- 172.21.15.18:0/1753400928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f5015f690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009e50 tx=0x7f3f4801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67a13195712ac4d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4dffb640 1 -- 172.21.15.18:0/1753400928 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480a5900 con 0x7f3f500b3fe0 2023-06-09T04:39:02.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4dffb640 1 -- 172.21.15.18:0/1753400928 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480a5a60 con 0x7f3f500b3fe0 2023-06-09T04:39:02.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4dffb640 1 -- 172.21.15.18:0/1753400928 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480a5df0 con 0x7f3f500b3fe0 2023-06-09T04:39:02.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- 172.21.15.18:0/1753400928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 msgr2=0x7f3f5015f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 --2- 172.21.15.18:0/1753400928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f5015f690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009e50 tx=0x7f3f4801ca10 comp rx=0 tx=0).stop 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- 172.21.15.18:0/1753400928 shutdown_connections 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 --2- 172.21.15.18:0/1753400928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f5015f690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 --2- 172.21.15.18:0/1753400928 >> v2:172.21.15.81:3300/0 conn(0x7f3f500cc9b0 0x7f3f5015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- 172.21.15.18:0/1753400928 >> 172.21.15.18:0/1753400928 conn(0x7f3f500d2ae0 msgr2=0x7f3f500ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- 172.21.15.18:0/1753400928 shutdown_connections 2023-06-09T04:39:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- 172.21.15.18:0/1753400928 wait complete. 2023-06-09T04:39:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 Processor -- start 2023-06-09T04:39:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- start start 2023-06-09T04:39:02.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f500cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 0x7f3f500d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f50147760 0x7f3f500b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50145330 con 0x7f3f500b7480 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501579e0 con 0x7f3f50147760 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f559a5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50157700 con 0x7f3f500b3fe0 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 0x7f3f500d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 0x7f3f500d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40258/0 (socket says 172.21.15.18:40258) 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4e7fc640 1 -- 172.21.15.18:0/725983395 learned_addr learned my addr 172.21.15.18:0/725983395 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f500cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.177 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.170+0000 7f3f4f7fe640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f50147760 0x7f3f500b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4e7fc640 1 -- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 msgr2=0x7f3f500cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4e7fc640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f500cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4e7fc640 1 -- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f50147760 msgr2=0x7f3f500b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4e7fc640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f50147760 0x7f3f500b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4e7fc640 1 -- 172.21.15.18:0/725983395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48009b30 con 0x7f3f500b7480 2023-06-09T04:39:02.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4e7fc640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 0x7f3f500d04b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e870 tx=0x7f3f4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400ee60 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400c940 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50144c70 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400ccb0 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500b3420 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f50145470 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f44013470 con 0x7f3f500b7480 2023-06-09T04:39:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f37fff640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3f3c066280 0x7f3f3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f44083fa0 con 0x7f3f500b7480 2023-06-09T04:39:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4effd640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3f3c066280 0x7f3f3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.174+0000 7f3f4effd640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3f3c066280 0x7f3f3c068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f40007fd0 tx=0x7f3f40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.178+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f440b4700 con 0x7f3f500b7480 2023-06-09T04:39:02.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.330+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f50073380 con 0x7f3f500b7480 2023-06-09T04:39:02.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f37fff640 1 -- 172.21.15.18:0/725983395 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f3f44017090 con 0x7f3f500b7480 2023-06-09T04:39:02.337 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:02.337 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3f3c066280 msgr2=0x7f3f3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3f3c066280 0x7f3f3c068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f40007fd0 tx=0x7f3f40009040 comp rx=0 tx=0).stop 2023-06-09T04:39:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 msgr2=0x7f3f500d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 0x7f3f500d04b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e870 tx=0x7f3f4400ed30 comp rx=0 tx=0).stop 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 shutdown_connections 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f50147760 0x7f3f500b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f500b7480 0x7f3f500d04b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3f3c066280 0x7f3f3c068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 --2- 172.21.15.18:0/725983395 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3f500b3fe0 0x7f3f500cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 >> 172.21.15.18:0/725983395 conn(0x7f3f500d2ae0 msgr2=0x7f3f5015b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 shutdown_connections 2023-06-09T04:39:02.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.334+0000 7f3f559a5640 1 -- 172.21.15.18:0/725983395 wait complete. 2023-06-09T04:39:02.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:02.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:02.476 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 Processor -- start 2023-06-09T04:39:02.476 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 -- start start 2023-06-09T04:39:02.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3cc06b800 0x7ff3cc0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3cc0b1530 0x7ff3cc0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc069df0 con 0x7ff3cc0b75e0 2023-06-09T04:39:02.477 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc06a0d0 con 0x7ff3cc0b1530 2023-06-09T04:39:02.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3d149a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0cc610 con 0x7ff3cc06b800 2023-06-09T04:39:02.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3caffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff3cc0b75e0 0x7ff3cc06b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60662/0 (socket says 172.21.15.18:60662) 2023-06-09T04:39:02.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3caffd640 1 -- 172.21.15.18:0/1341839747 learned_addr learned my addr 172.21.15.18:0/1341839747 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:02.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3cb7fe640 1 --2- 172.21.15.18:0/1341839747 >> v2:172.21.15.18:3300/0 conn(0x7ff3cc0b1530 0x7ff3cc0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3ca7fc640 1 --2- 172.21.15.18:0/1341839747 >> v2:172.21.15.81:3300/0 conn(0x7ff3cc06b800 0x7ff3cc0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3cb7fe640 1 -- 172.21.15.18:0/1341839747 >> v2:172.21.15.81:3300/0 conn(0x7ff3cc06b800 msgr2=0x7ff3cc0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3cb7fe640 1 --2- 172.21.15.18:0/1341839747 >> v2:172.21.15.81:3300/0 conn(0x7ff3cc06b800 0x7ff3cc0ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3cb7fe640 1 -- 172.21.15.18:0/1341839747 >> v1:172.21.15.18:6789/0 conn(0x7ff3cc0b75e0 legacy=0x7ff3cc06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.474+0000 7ff3cb7fe640 1 -- 172.21.15.18:0/1341839747 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0cc8f0 con 0x7ff3cc0b1530 2023-06-09T04:39:02.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3cb7fe640 1 --2- 172.21.15.18:0/1341839747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc0b1530 0x7ff3cc0cfd90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc06bce0 tx=0x7ff3c401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf76bbf91aa7ef8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3c9ffb640 1 -- 172.21.15.18:0/1341839747 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40a5990 con 0x7ff3cc0b1530 2023-06-09T04:39:02.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3c9ffb640 1 -- 172.21.15.18:0/1341839747 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40a5af0 con 0x7ff3cc0b1530 2023-06-09T04:39:02.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3c9ffb640 1 -- 172.21.15.18:0/1341839747 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40a5e80 con 0x7ff3cc0b1530 2023-06-09T04:39:02.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/1341839747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc0b1530 msgr2=0x7ff3cc0cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 --2- 172.21.15.18:0/1341839747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc0b1530 0x7ff3cc0cfd90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc06bce0 tx=0x7ff3c401c8b0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/1341839747 shutdown_connections 2023-06-09T04:39:02.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 --2- 172.21.15.18:0/1341839747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc0b1530 0x7ff3cc0cfd90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 --2- 172.21.15.18:0/1341839747 >> v2:172.21.15.81:3300/0 conn(0x7ff3cc06b800 0x7ff3cc0ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/1341839747 >> 172.21.15.18:0/1341839747 conn(0x7ff3cc0b46c0 msgr2=0x7ff3cc0d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/1341839747 shutdown_connections 2023-06-09T04:39:02.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/1341839747 wait complete. 2023-06-09T04:39:02.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 Processor -- start 2023-06-09T04:39:02.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- start start 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 0x7ff3cc157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3cc0b1530 0x7ff3cc157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3cc0b75e0 0x7ff3cc15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc159900 con 0x7ff3cc06b800 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc158860 con 0x7ff3cc0b1530 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc158b40 con 0x7ff3cc0b75e0 2023-06-09T04:39:02.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 0x7ff3cc157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 0x7ff3cc157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40272/0 (socket says 172.21.15.18:40272) 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 -- 172.21.15.18:0/68627221 learned_addr learned my addr 172.21.15.18:0/68627221 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 -- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3cc0b75e0 msgr2=0x7ff3cc15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3cc0b75e0 0x7ff3cc15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 -- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3cc0b1530 msgr2=0x7ff3cc157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3cc0b1530 0x7ff3cc157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 -- 172.21.15.18:0/68627221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4009a70 con 0x7ff3cc06b800 2023-06-09T04:39:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3caffd640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 0x7ff3cc157690 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c400 tx=0x7ff3bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc005cf0 con 0x7ff3cc06b800 2023-06-09T04:39:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc005e50 con 0x7ff3cc06b800 2023-06-09T04:39:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc158e20 con 0x7ff3cc06b800 2023-06-09T04:39:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0072d0 con 0x7ff3cc06b800 2023-06-09T04:39:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.478+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc1593e0 con 0x7ff3cc06b800 2023-06-09T04:39:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.482+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc073380 con 0x7ff3cc06b800 2023-06-09T04:39:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.482+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3bc007430 con 0x7ff3cc06b800 2023-06-09T04:39:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.482+0000 7ff3b37fe640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff3b8066280 0x7ff3b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.482+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff3bc083580 con 0x7ff3cc06b800 2023-06-09T04:39:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.482+0000 7ff3ca7fc640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff3b8066280 0x7ff3b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.482+0000 7ff3ca7fc640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff3b8066280 0x7ff3b8068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc159ea0 tx=0x7ff3c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.486+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3bc050720 con 0x7ff3cc06b800 2023-06-09T04:39:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.630+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3cc06a750 con 0x7ff3cc06b800 2023-06-09T04:39:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.630+0000 7ff3b37fe640 1 -- 172.21.15.18:0/68627221 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3bc053d40 con 0x7ff3cc06b800 2023-06-09T04:39:02.634 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:02.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff3b8066280 msgr2=0x7ff3b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff3b8066280 0x7ff3b8068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc159ea0 tx=0x7ff3c0008040 comp rx=0 tx=0).stop 2023-06-09T04:39:02.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 msgr2=0x7ff3cc157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 0x7ff3cc157690 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c400 tx=0x7ff3bc00c8c0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 shutdown_connections 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff3b8066280 0x7ff3b8068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff3cc0b75e0 0x7ff3cc15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3cc0b1530 0x7ff3cc157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 --2- 172.21.15.18:0/68627221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3cc06b800 0x7ff3cc157690 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 >> 172.21.15.18:0/68627221 conn(0x7ff3cc0b46c0 msgr2=0x7ff3cc0b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 shutdown_connections 2023-06-09T04:39:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.634+0000 7ff3d149a640 1 -- 172.21.15.18:0/68627221 wait complete. 2023-06-09T04:39:02.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:02.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.762+0000 7f183b307640 1 Processor -- start 2023-06-09T04:39:02.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.762+0000 7f183b307640 1 -- start start 2023-06-09T04:39:02.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f183b307640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18340cbd40 0x7f1834069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f183b307640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1834159590 0x7f1834069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f183b307640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183415de50 con 0x7f18341591c0 2023-06-09T04:39:02.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f183b307640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183415d2d0 con 0x7f1834159590 2023-06-09T04:39:02.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f183b307640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183415d5b0 con 0x7f18340cbd40 2023-06-09T04:39:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1834159590 0x7f1834069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1834159590 0x7f1834069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40282/0 (socket says 172.21.15.18:40282) 2023-06-09T04:39:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 -- 172.21.15.18:0/2007191229 learned_addr learned my addr 172.21.15.18:0/2007191229 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18388a2640 1 --2- 172.21.15.18:0/2007191229 >> v2:172.21.15.81:3300/0 conn(0x7f18340cbd40 0x7f1834069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 -- 172.21.15.18:0/2007191229 >> v2:172.21.15.81:3300/0 conn(0x7f18340cbd40 msgr2=0x7f1834069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 --2- 172.21.15.18:0/2007191229 >> v2:172.21.15.81:3300/0 conn(0x7f18340cbd40 0x7f1834069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 -- 172.21.15.18:0/2007191229 >> v1:172.21.15.81:6789/0 conn(0x7f18341591c0 legacy=0x7f18340cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:02.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 -- 172.21.15.18:0/2007191229 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183415d890 con 0x7f1834159590 2023-06-09T04:39:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f18398a4640 1 --2- 172.21.15.18:0/2007191229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f1834069b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18340692b0 tx=0x7f182c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87e0394b044c072 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f182bfff640 1 -- 172.21.15.18:0/2007191229 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0a5780 con 0x7f1834159590 2023-06-09T04:39:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f182bfff640 1 -- 172.21.15.18:0/2007191229 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c0a58e0 con 0x7f1834159590 2023-06-09T04:39:02.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.766+0000 7f182bfff640 1 -- 172.21.15.18:0/2007191229 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0a5c70 con 0x7f1834159590 2023-06-09T04:39:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/2007191229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 msgr2=0x7f1834069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 --2- 172.21.15.18:0/2007191229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f1834069b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18340692b0 tx=0x7f182c01c960 comp rx=0 tx=0).stop 2023-06-09T04:39:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/2007191229 shutdown_connections 2023-06-09T04:39:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 --2- 172.21.15.18:0/2007191229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f1834069b40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 --2- 172.21.15.18:0/2007191229 >> v2:172.21.15.81:3300/0 conn(0x7f18340cbd40 0x7f1834069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/2007191229 >> 172.21.15.18:0/2007191229 conn(0x7f18340afa90 msgr2=0x7f18340afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/2007191229 shutdown_connections 2023-06-09T04:39:02.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/2007191229 wait complete. 2023-06-09T04:39:02.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 Processor -- start 2023-06-09T04:39:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- start start 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18340cbd40 0x7f18341f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18341591c0 0x7f183415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f183415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18340b3300 con 0x7f1834159590 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834153f40 con 0x7f18340cbd40 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18341f4cc0 con 0x7f18341591c0 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f183415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f183415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40294/0 (socket says 172.21.15.18:40294) 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 -- 172.21.15.18:0/1539993193 learned_addr learned my addr 172.21.15.18:0/1539993193 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18390a3640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18340cbd40 0x7f18341f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18388a2640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18341591c0 0x7f183415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 -- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18341591c0 msgr2=0x7f183415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18341591c0 0x7f183415e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 -- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18340cbd40 msgr2=0x7f18341f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18340cbd40 0x7f18341f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 -- 172.21.15.18:0/1539993193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c009b30 con 0x7f1834159590 2023-06-09T04:39:02.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f18398a4640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f183415e5b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f182c0af040 tx=0x7f182c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b8670 con 0x7f1834159590 2023-06-09T04:39:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c0b87d0 con 0x7f1834159590 2023-06-09T04:39:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c0b8b80 con 0x7f1834159590 2023-06-09T04:39:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18340b26f0 con 0x7f1834159590 2023-06-09T04:39:02.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.770+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18340b2cb0 con 0x7f1834159590 2023-06-09T04:39:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.774+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18340b34b0 con 0x7f1834159590 2023-06-09T04:39:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.774+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f182c0b8ce0 con 0x7f1834159590 2023-06-09T04:39:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.774+0000 7f1829ffb640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1818066280 0x7f1818068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.774+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f182c11f630 con 0x7f1834159590 2023-06-09T04:39:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.774+0000 7f18390a3640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1818066280 0x7f1818068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:02.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.774+0000 7f18390a3640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1818066280 0x7f1818068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1830007fd0 tx=0x7f1830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:02.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.778+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f182c0ec720 con 0x7f1834159590 2023-06-09T04:39:02.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.926+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18340b34b0 con 0x7f1834159590 2023-06-09T04:39:02.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.926+0000 7f1829ffb640 1 -- 172.21.15.18:0/1539993193 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f182c0efd40 con 0x7f1834159590 2023-06-09T04:39:02.930 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1818066280 msgr2=0x7f1818068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1818066280 0x7f1818068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1830007fd0 tx=0x7f1830009040 comp rx=0 tx=0).stop 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 msgr2=0x7f183415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f183415e5b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f182c0af040 tx=0x7f182c019700 comp rx=0 tx=0).stop 2023-06-09T04:39:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 shutdown_connections 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1834159590 0x7f183415e5b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1818066280 0x7f1818068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18341591c0 0x7f183415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 --2- 172.21.15.18:0/1539993193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18340cbd40 0x7f18341f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 >> 172.21.15.18:0/1539993193 conn(0x7f18340afa90 msgr2=0x7f1834156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 shutdown_connections 2023-06-09T04:39:02.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:02.930+0000 7f183b307640 1 -- 172.21.15.18:0/1539993193 wait complete. 2023-06-09T04:39:02.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:03.063 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee2d900640 1 Processor -- start 2023-06-09T04:39:03.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee2d900640 1 -- start start 2023-06-09T04:39:03.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee2d900640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee280cbd40 0x7fee28069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee2d900640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2815de50 con 0x7fee281591c0 2023-06-09T04:39:03.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee2d900640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2815d2d0 con 0x7fee28159590 2023-06-09T04:39:03.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee2d900640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2815d5b0 con 0x7fee280cbd40 2023-06-09T04:39:03.065 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee26ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fee281591c0 0x7fee280cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60674/0 (socket says 172.21.15.18:60674) 2023-06-09T04:39:03.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee26ffd640 1 -- 172.21.15.18:0/2184955662 learned_addr learned my addr 172.21.15.18:0/2184955662 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:03.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee1e7fc640 1 --2- 172.21.15.18:0/2184955662 >> v2:172.21.15.81:3300/0 conn(0x7fee280cbd40 0x7fee28069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee267fc640 1 -- 172.21.15.18:0/2184955662 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231785279 0 0) 0x7fee2815de50 con 0x7fee281591c0 2023-06-09T04:39:03.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee267fc640 1 -- 172.21.15.18:0/2184955662 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee14003530 con 0x7fee281591c0 2023-06-09T04:39:03.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee1e7fc640 1 -- 172.21.15.18:0/2184955662 >> v1:172.21.15.81:6789/0 conn(0x7fee28159590 legacy=0x7fee28069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee1e7fc640 1 -- 172.21.15.18:0/2184955662 >> v1:172.21.15.18:6789/0 conn(0x7fee281591c0 legacy=0x7fee280cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.062+0000 7fee1e7fc640 1 -- 172.21.15.18:0/2184955662 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2815d890 con 0x7fee280cbd40 2023-06-09T04:39:03.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee1e7fc640 1 --2- 172.21.15.18:0/2184955662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee28069600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee100097c0 tx=0x7fee1001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f20ffb89a659dcad server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee267fc640 1 -- 172.21.15.18:0/2184955662 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100ac410 con 0x7fee280cbd40 2023-06-09T04:39:03.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee267fc640 1 -- 172.21.15.18:0/2184955662 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee100ac570 con 0x7fee280cbd40 2023-06-09T04:39:03.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee267fc640 1 -- 172.21.15.18:0/2184955662 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100ac8e0 con 0x7fee280cbd40 2023-06-09T04:39:03.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- 172.21.15.18:0/2184955662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 msgr2=0x7fee28069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 --2- 172.21.15.18:0/2184955662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee28069600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee100097c0 tx=0x7fee1001c450 comp rx=0 tx=0).stop 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- 172.21.15.18:0/2184955662 shutdown_connections 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 --2- 172.21.15.18:0/2184955662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee28069600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- 172.21.15.18:0/2184955662 >> 172.21.15.18:0/2184955662 conn(0x7fee280afa90 msgr2=0x7fee280afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- 172.21.15.18:0/2184955662 shutdown_connections 2023-06-09T04:39:03.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- 172.21.15.18:0/2184955662 wait complete. 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 Processor -- start 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- start start 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee2814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee281591c0 0x7fee280b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 0x7fee280c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2814f8c0 con 0x7fee28159590 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280c44d0 con 0x7fee280cbd40 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee2d900640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280c2a30 con 0x7fee281591c0 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee277fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 0x7fee280c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee277fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 0x7fee280c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40306/0 (socket says 172.21.15.18:40306) 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.066+0000 7fee277fe640 1 -- 172.21.15.18:0/3127082959 learned_addr learned my addr 172.21.15.18:0/3127082959 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:03.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee1e7fc640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee281591c0 0x7fee280b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee26ffd640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee2814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee277fe640 1 -- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee281591c0 msgr2=0x7fee280b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee277fe640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee281591c0 0x7fee280b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee277fe640 1 -- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 msgr2=0x7fee2814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee277fe640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee2814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee277fe640 1 -- 172.21.15.18:0/3127082959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10009420 con 0x7fee28159590 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee277fe640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 0x7fee280c91a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c730 tx=0x7fee2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20003b80 con 0x7fee28159590 2023-06-09T04:39:03.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee20003ce0 con 0x7fee28159590 2023-06-09T04:39:03.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee280c3f10 con 0x7fee28159590 2023-06-09T04:39:03.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20005310 con 0x7fee28159590 2023-06-09T04:39:03.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee280c2cd0 con 0x7fee28159590 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee28065140 con 0x7fee28159590 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee20005680 con 0x7fee28159590 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee24ff9640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fee08066280 0x7fee08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee20083f40 con 0x7fee28159590 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee26ffd640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fee08066280 0x7fee08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.070+0000 7fee26ffd640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fee08066280 0x7fee08068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fee18007fd0 tx=0x7fee18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.074+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee20051160 con 0x7fee28159590 2023-06-09T04:39:03.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.222+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee280ccbd0 con 0x7fee28159590 2023-06-09T04:39:03.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.222+0000 7fee24ff9640 1 -- 172.21.15.18:0/3127082959 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee20054780 con 0x7fee28159590 2023-06-09T04:39:03.227 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:03.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fee08066280 msgr2=0x7fee08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fee08066280 0x7fee08068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fee18007fd0 tx=0x7fee18009040 comp rx=0 tx=0).stop 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 msgr2=0x7fee280c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 0x7fee280c91a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c730 tx=0x7fee2000cbf0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 shutdown_connections 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee28159590 0x7fee280c91a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fee08066280 0x7fee08068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fee281591c0 0x7fee280b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 --2- 172.21.15.18:0/3127082959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee280cbd40 0x7fee2814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 >> 172.21.15.18:0/3127082959 conn(0x7fee280afa90 msgr2=0x7fee280ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 shutdown_connections 2023-06-09T04:39:03.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.226+0000 7fee2d900640 1 -- 172.21.15.18:0/3127082959 wait complete. 2023-06-09T04:39:03.244 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:03.364 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 Processor -- start 2023-06-09T04:39:03.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 -- start start 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd2c0cddc0 0x7fdd2c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd2c15fdb0 0x7fdd2c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c15f100 con 0x7fdd2c06c520 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0ce230 con 0x7fdd2c0cddc0 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd33606640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c15f3e0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd2c0cddc0 0x7fdd2c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd2c0cddc0 0x7fdd2c15f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40320/0 (socket says 172.21.15.18:40320) 2023-06-09T04:39:03.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 -- 172.21.15.18:0/4216801639 learned_addr learned my addr 172.21.15.18:0/4216801639 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:03.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd31ba3640 1 --2- 172.21.15.18:0/4216801639 >> v2:172.21.15.81:3300/0 conn(0x7fdd2c15fdb0 0x7fdd2c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 -- 172.21.15.18:0/4216801639 >> v2:172.21.15.81:3300/0 conn(0x7fdd2c15fdb0 msgr2=0x7fdd2c15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:03.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 --2- 172.21.15.18:0/4216801639 >> v2:172.21.15.81:3300/0 conn(0x7fdd2c15fdb0 0x7fdd2c15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 -- 172.21.15.18:0/4216801639 >> v1:172.21.15.18:6789/0 conn(0x7fdd2c06c520 legacy=0x7fdd2c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.362+0000 7fdd30ba1640 1 -- 172.21.15.18:0/4216801639 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c15c3a0 con 0x7fdd2c0cddc0 2023-06-09T04:39:03.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd30ba1640 1 --2- 172.21.15.18:0/4216801639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c0cddc0 0x7fdd2c15f870 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c070210 tx=0x7fdd1c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef151aa468bfa86d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd23fff640 1 -- 172.21.15.18:0/4216801639 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c0ab600 con 0x7fdd2c0cddc0 2023-06-09T04:39:03.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd23fff640 1 -- 172.21.15.18:0/4216801639 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c0a7050 con 0x7fdd2c0cddc0 2023-06-09T04:39:03.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd23fff640 1 -- 172.21.15.18:0/4216801639 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c0ab980 con 0x7fdd2c0cddc0 2023-06-09T04:39:03.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- 172.21.15.18:0/4216801639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c0cddc0 msgr2=0x7fdd2c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 --2- 172.21.15.18:0/4216801639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c0cddc0 0x7fdd2c15f870 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c070210 tx=0x7fdd1c01c3b0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- 172.21.15.18:0/4216801639 shutdown_connections 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 --2- 172.21.15.18:0/4216801639 >> v2:172.21.15.81:3300/0 conn(0x7fdd2c15fdb0 0x7fdd2c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 --2- 172.21.15.18:0/4216801639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c0cddc0 0x7fdd2c15f870 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- 172.21.15.18:0/4216801639 >> 172.21.15.18:0/4216801639 conn(0x7fdd2c0b0b10 msgr2=0x7fdd2c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- 172.21.15.18:0/4216801639 shutdown_connections 2023-06-09T04:39:03.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- 172.21.15.18:0/4216801639 wait complete. 2023-06-09T04:39:03.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 Processor -- start 2023-06-09T04:39:03.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- start start 2023-06-09T04:39:03.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c06c520 0x7fdd2c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd2c0cddc0 0x7fdd2c14f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 0x7fdd2c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c15eec0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c15d260 con 0x7fdd2c06c520 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd33606640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c15d540 con 0x7fdd2c0cddc0 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd31ba3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 0x7fdd2c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd31ba3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 0x7fdd2c1593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40332/0 (socket says 172.21.15.18:40332) 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.366+0000 7fdd31ba3640 1 -- 172.21.15.18:0/4250845186 learned_addr learned my addr 172.21.15.18:0/4250845186 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd313a2640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c06c520 0x7fdd2c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd30ba1640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd2c0cddc0 0x7fdd2c14f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd31ba3640 1 -- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd2c0cddc0 msgr2=0x7fdd2c14f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd31ba3640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd2c0cddc0 0x7fdd2c14f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd31ba3640 1 -- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c06c520 msgr2=0x7fdd2c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd31ba3640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c06c520 0x7fdd2c15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd31ba3640 1 -- 172.21.15.18:0/4250845186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0094d0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd30ba1640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd2c0cddc0 0x7fdd2c14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd31ba3640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 0x7fdd2c1593e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd24007e60 tx=0x7fdd2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24014420 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240145a0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24014950 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c15d820 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c15eaa0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c0cf280 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd24014ab0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd21ffb640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd10066280 0x7fdd10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd24084950 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.370+0000 7fdd313a2640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd10066280 0x7fdd10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.374+0000 7fdd313a2640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd10066280 0x7fdd10068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000f70 tx=0x7fdd28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.374+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd24055560 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd2c0cf040 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd21ffb640 1 -- 172.21.15.18:0/4250845186 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd240550f0 con 0x7fdd2c15fdb0 2023-06-09T04:39:03.528 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd10066280 msgr2=0x7fdd10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd10066280 0x7fdd10068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000f70 tx=0x7fdd28009040 comp rx=0 tx=0).stop 2023-06-09T04:39:03.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 msgr2=0x7fdd2c1593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 0x7fdd2c1593e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd24007e60 tx=0x7fdd2400e4b0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 shutdown_connections 2023-06-09T04:39:03.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd2c15fdb0 0x7fdd2c1593e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd10066280 0x7fdd10068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd2c0cddc0 0x7fdd2c14f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 --2- 172.21.15.18:0/4250845186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c06c520 0x7fdd2c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 >> 172.21.15.18:0/4250845186 conn(0x7fdd2c0b0b10 msgr2=0x7fdd2c0693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 shutdown_connections 2023-06-09T04:39:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.526+0000 7fdd33606640 1 -- 172.21.15.18:0/4250845186 wait complete. 2023-06-09T04:39:03.546 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:03.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.662+0000 7f5c21c79640 1 Processor -- start 2023-06-09T04:39:03.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.662+0000 7f5c21c79640 1 -- start start 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c1591c0 0x7f5c1c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5c1c0acdf0 0x7f5c1c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c15de50 con 0x7f5c1c159590 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c15d2d0 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c15d5b0 con 0x7f5c1c1591c0 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5c1c0acdf0 0x7f5c1c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5c1c0acdf0 0x7f5c1c0cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40344/0 (socket says 172.21.15.18:40344) 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 -- 172.21.15.18:0/2884731646 learned_addr learned my addr 172.21.15.18:0/2884731646 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c12ffd640 1 --1- 172.21.15.18:0/2884731646 >> v1:172.21.15.18:6789/0 conn(0x7f5c1c159590 0x7f5c1c06bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60686/0 (socket says 172.21.15.18:60686) 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1b7fe640 1 --2- 172.21.15.18:0/2884731646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c1591c0 0x7f5c1c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 -- 172.21.15.18:0/2884731646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c1591c0 msgr2=0x7f5c1c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 --2- 172.21.15.18:0/2884731646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c1591c0 0x7f5c1c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 -- 172.21.15.18:0/2884731646 >> v1:172.21.15.18:6789/0 conn(0x7f5c1c159590 legacy=0x7f5c1c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 -- 172.21.15.18:0/2884731646 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c15d890 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1bfff640 1 --2- 172.21.15.18:0/2884731646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c0cbb70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009e50 tx=0x7f5c1401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9916e75d7906221a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1affd640 1 -- 172.21.15.18:0/2884731646 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c140a5810 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1affd640 1 -- 172.21.15.18:0/2884731646 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c140a5970 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c1affd640 1 -- 172.21.15.18:0/2884731646 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c140a5d00 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- 172.21.15.18:0/2884731646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 msgr2=0x7f5c1c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 --2- 172.21.15.18:0/2884731646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c0cbb70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009e50 tx=0x7f5c1401c9e0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- 172.21.15.18:0/2884731646 shutdown_connections 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 --2- 172.21.15.18:0/2884731646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c0cbb70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 --2- 172.21.15.18:0/2884731646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c1591c0 0x7f5c1c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- 172.21.15.18:0/2884731646 >> 172.21.15.18:0/2884731646 conn(0x7f5c1c0afa90 msgr2=0x7f5c1c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- 172.21.15.18:0/2884731646 shutdown_connections 2023-06-09T04:39:03.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.666+0000 7f5c21c79640 1 -- 172.21.15.18:0/2884731646 wait complete. 2023-06-09T04:39:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 Processor -- start 2023-06-09T04:39:03.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- start start 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c1591c0 0x7f5c1c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c159590 0x7f5c1c0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c15c7b0 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0c36c0 con 0x7f5c1c1591c0 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0c39a0 con 0x7f5c1c159590 2023-06-09T04:39:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40348/0 (socket says 172.21.15.18:40348) 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 -- 172.21.15.18:0/1096032693 learned_addr learned my addr 172.21.15.18:0/1096032693 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c12ffd640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c1591c0 0x7f5c1c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1bfff640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c159590 0x7f5c1c0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 -- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c159590 msgr2=0x7f5c1c0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c159590 0x7f5c1c0c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 -- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c1591c0 msgr2=0x7f5c1c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c1591c0 0x7f5c1c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 -- 172.21.15.18:0/1096032693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c14009b30 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c12ffd640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c1591c0 0x7f5c1c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c1b7fe640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c155c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00d800 tx=0x7f5c0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c018070 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0059a0 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c0c3c80 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c005b50 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c0c4240 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.670+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c0c4400 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.674+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c0c005cb0 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.674+0000 7f5c18ff9640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5bfc066280 0x7f5bfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.674+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5c0c083f10 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.674+0000 7f5c12ffd640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5bfc066280 0x7f5bfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.674+0000 7f5c12ffd640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5bfc066280 0x7f5bfc068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c1636c0 tx=0x7f5c04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.678+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c0c054b30 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.835 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.830+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5c1c073380 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c18ff9640 1 -- 172.21.15.18:0/1096032693 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5c0c0546c0 con 0x7f5c1c0acdf0 2023-06-09T04:39:03.836 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5bfc066280 msgr2=0x7f5bfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5bfc066280 0x7f5bfc068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c1636c0 tx=0x7f5c04009040 comp rx=0 tx=0).stop 2023-06-09T04:39:03.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 msgr2=0x7f5c1c155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c155c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00d800 tx=0x7f5c0c00dcc0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 shutdown_connections 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5bfc066280 0x7f5bfc068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5c1c159590 0x7f5c1c0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c1c1591c0 0x7f5c1c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 --2- 172.21.15.18:0/1096032693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5c1c0acdf0 0x7f5c1c155c60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 >> 172.21.15.18:0/1096032693 conn(0x7f5c1c0afa90 msgr2=0x7f5c1c0ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 shutdown_connections 2023-06-09T04:39:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.834+0000 7f5c21c79640 1 -- 172.21.15.18:0/1096032693 wait complete. 2023-06-09T04:39:03.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:03.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 Processor -- start 2023-06-09T04:39:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 -- start start 2023-06-09T04:39:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e80c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2e80acd10 0x7fa2e80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e80c9010 con 0x7fa2e806fb60 2023-06-09T04:39:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e80cbdc0 con 0x7fa2e80acd10 2023-06-09T04:39:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2efe4c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80c8460 con 0x7fa2e8157dc0 2023-06-09T04:39:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ed3e7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2e80acd10 0x7fa2e80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ee3e9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa2e806fb60 0x7fa2e80694c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60702/0 (socket says 172.21.15.18:60702) 2023-06-09T04:39:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ee3e9640 1 -- 172.21.15.18:0/3320800350 learned_addr learned my addr 172.21.15.18:0/3320800350 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2edbe8640 1 --2- 172.21.15.18:0/3320800350 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e80c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ed3e7640 1 -- 172.21.15.18:0/3320800350 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 msgr2=0x7fa2e80c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ed3e7640 1 --2- 172.21.15.18:0/3320800350 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e80c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ed3e7640 1 -- 172.21.15.18:0/3320800350 >> v1:172.21.15.18:6789/0 conn(0x7fa2e806fb60 legacy=0x7fa2e80694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ed3e7640 1 -- 172.21.15.18:0/3320800350 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80ad160 con 0x7fa2e80acd10 2023-06-09T04:39:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ecbe6640 1 -- 172.21.15.18:0/3320800350 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615308968 0 0) 0x7fa2e80c9010 con 0x7fa2e806fb60 2023-06-09T04:39:03.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.978+0000 7fa2ed3e7640 1 --2- 172.21.15.18:0/3320800350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80acd10 0x7fa2e80cb880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80097c0 tx=0x7fa2d801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95423a7e0915c711 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.984 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2ecbe6640 1 -- 172.21.15.18:0/3320800350 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80a8970 con 0x7fa2e80acd10 2023-06-09T04:39:03.984 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2ecbe6640 1 -- 172.21.15.18:0/3320800350 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d80a8ad0 con 0x7fa2e80acd10 2023-06-09T04:39:03.984 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2ecbe6640 1 -- 172.21.15.18:0/3320800350 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80a8e60 con 0x7fa2e80acd10 2023-06-09T04:39:03.984 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/3320800350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80acd10 msgr2=0x7fa2e80cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/3320800350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80acd10 0x7fa2e80cb880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80097c0 tx=0x7fa2d801ec70 comp rx=0 tx=0).stop 2023-06-09T04:39:03.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/3320800350 shutdown_connections 2023-06-09T04:39:03.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/3320800350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e80acd10 0x7fa2e80cb880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/3320800350 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e80c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/3320800350 >> 172.21.15.18:0/3320800350 conn(0x7fa2e80b0240 msgr2=0x7fa2e80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:03.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/3320800350 shutdown_connections 2023-06-09T04:39:03.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/3320800350 wait complete. 2023-06-09T04:39:03.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 Processor -- start 2023-06-09T04:39:03.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- start start 2023-06-09T04:39:03.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 0x7fa2e80b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e80acd10 0x7fa2e814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e8158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8159050 con 0x7fa2e806fb60 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b3350 con 0x7fa2e80acd10 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b12c0 con 0x7fa2e8157dc0 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 0x7fa2e80b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 0x7fa2e80b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40354/0 (socket says 172.21.15.18:40354) 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 -- 172.21.15.18:0/729855058 learned_addr learned my addr 172.21.15.18:0/729855058 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2ed3e7640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e80acd10 0x7fa2e814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2ee3e9640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e8158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 -- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 msgr2=0x7fa2e8158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e8158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 -- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e80acd10 msgr2=0x7fa2e814bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:03.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e80acd10 0x7fa2e814bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 -- 172.21.15.18:0/729855058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8009420 con 0x7fa2e806fb60 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2edbe8640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 0x7fa2e80b2e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0007ef0 tx=0x7fa2e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0014620 con 0x7fa2e806fb60 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0014780 con 0x7fa2e806fb60 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e80b1510 con 0x7fa2e806fb60 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0014b30 con 0x7fa2e806fb60 2023-06-09T04:39:03.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.982+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e80b1ad0 con 0x7fa2e806fb60 2023-06-09T04:39:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.986+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e8073380 con 0x7fa2e806fb60 2023-06-09T04:39:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.986+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2e0014c90 con 0x7fa2e806fb60 2023-06-09T04:39:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.986+0000 7fa2de7fc640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa2cc066280 0x7fa2cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:03.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.986+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa2e0084a50 con 0x7fa2e806fb60 2023-06-09T04:39:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.986+0000 7fa2ed3e7640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa2cc066280 0x7fa2cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.986+0000 7fa2ed3e7640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa2cc066280 0x7fa2cc068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80b2000 tx=0x7fa2d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:03.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:03.990+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2e0051bc0 con 0x7fa2e806fb60 2023-06-09T04:39:04.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2e80c97a0 con 0x7fa2e806fb60 2023-06-09T04:39:04.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2de7fc640 1 -- 172.21.15.18:0/729855058 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fa2e00551e0 con 0x7fa2e806fb60 2023-06-09T04:39:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:04.146 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa2cc066280 msgr2=0x7fa2cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa2cc066280 0x7fa2cc068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80b2000 tx=0x7fa2d8008040 comp rx=0 tx=0).stop 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 msgr2=0x7fa2e80b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 0x7fa2e80b2e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0007ef0 tx=0x7fa2e000e4b0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 shutdown_connections 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa2cc066280 0x7fa2cc068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2e8157dc0 0x7fa2e8158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2e80acd10 0x7fa2e814bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 --2- 172.21.15.18:0/729855058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e806fb60 0x7fa2e80b2e10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 >> 172.21.15.18:0/729855058 conn(0x7fa2e80b0240 msgr2=0x7fa2e8069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 shutdown_connections 2023-06-09T04:39:04.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.142+0000 7fa2efe4c640 1 -- 172.21.15.18:0/729855058 wait complete. 2023-06-09T04:39:04.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:04.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:04.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.274+0000 7f950aef6640 1 Processor -- start 2023-06-09T04:39:04.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f950aef6640 1 -- start start 2023-06-09T04:39:04.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f950aef6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 0x7f950406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f950aef6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f950406c310 0x7f95040c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f950aef6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950415c620 con 0x7f9504155d20 2023-06-09T04:39:04.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f950aef6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950415ce40 con 0x7f950406c310 2023-06-09T04:39:04.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f950aef6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040cc450 con 0x7f95041595d0 2023-06-09T04:39:04.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 0x7f950406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 0x7f950406bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:46862/0 (socket says 172.21.15.18:46862) 2023-06-09T04:39:04.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 -- 172.21.15.18:0/1767911403 learned_addr learned my addr 172.21.15.18:0/1767911403 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:04.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9509493640 1 --2- 172.21.15.18:0/1767911403 >> v2:172.21.15.81:3300/0 conn(0x7f950406c310 0x7f95040c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 -- 172.21.15.18:0/1767911403 >> v2:172.21.15.81:3300/0 conn(0x7f950406c310 msgr2=0x7f95040c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 --2- 172.21.15.18:0/1767911403 >> v2:172.21.15.81:3300/0 conn(0x7f950406c310 0x7f95040c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 -- 172.21.15.18:0/1767911403 >> v1:172.21.15.81:6789/0 conn(0x7f9504155d20 legacy=0x7f950415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.278+0000 7f9503fff640 1 -- 172.21.15.18:0/1767911403 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950415c880 con 0x7f95041595d0 2023-06-09T04:39:04.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f9503fff640 1 --2- 172.21.15.18:0/1767911403 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 0x7f950406bdd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009870 tx=0x7f94f801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ce6c400712ce13 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f95037fe640 1 -- 172.21.15.18:0/1767911403 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80ab620 con 0x7f95041595d0 2023-06-09T04:39:04.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f95037fe640 1 -- 172.21.15.18:0/1767911403 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f80ab780 con 0x7f95041595d0 2023-06-09T04:39:04.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f95037fe640 1 -- 172.21.15.18:0/1767911403 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80abb10 con 0x7f95041595d0 2023-06-09T04:39:04.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- 172.21.15.18:0/1767911403 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 msgr2=0x7f950406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 --2- 172.21.15.18:0/1767911403 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 0x7f950406bdd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009870 tx=0x7f94f801c510 comp rx=0 tx=0).stop 2023-06-09T04:39:04.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- 172.21.15.18:0/1767911403 shutdown_connections 2023-06-09T04:39:04.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 --2- 172.21.15.18:0/1767911403 >> v2:172.21.15.81:3300/0 conn(0x7f950406c310 0x7f95040c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 --2- 172.21.15.18:0/1767911403 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95041595d0 0x7f950406bdd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- 172.21.15.18:0/1767911403 >> 172.21.15.18:0/1767911403 conn(0x7f95040afa90 msgr2=0x7f95040afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- 172.21.15.18:0/1767911403 shutdown_connections 2023-06-09T04:39:04.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- 172.21.15.18:0/1767911403 wait complete. 2023-06-09T04:39:04.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 Processor -- start 2023-06-09T04:39:04.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- start start 2023-06-09T04:39:04.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f950406c310 0x7f950415ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9504155d20 0x7f9504155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 0x7f9504155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950415f230 con 0x7f95041595d0 2023-06-09T04:39:04.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040b3840 con 0x7f950406c310 2023-06-09T04:39:04.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.282+0000 7f950aef6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95041604a0 con 0x7f9504155d20 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 0x7f9504155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 0x7f9504155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40358/0 (socket says 172.21.15.18:40358) 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 -- 172.21.15.18:0/2521733388 learned_addr learned my addr 172.21.15.18:0/2521733388 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9508c92640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f950406c310 0x7f950415ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9503fff640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9504155d20 0x7f9504155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 -- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9504155d20 msgr2=0x7f9504155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9504155d20 0x7f9504155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 -- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f950406c310 msgr2=0x7f950415ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f950406c310 0x7f950415ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 -- 172.21.15.18:0/2521733388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f80094d0 con 0x7f95041595d0 2023-06-09T04:39:04.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9508c92640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f950406c310 0x7f950415ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:04.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9509493640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 0x7f9504155550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00efc0 tx=0x7f94fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc014480 con 0x7f95041595d0 2023-06-09T04:39:04.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc00f040 con 0x7f95041595d0 2023-06-09T04:39:04.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95040b28a0 con 0x7f95041595d0 2023-06-09T04:39:04.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc014820 con 0x7f95041595d0 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950415f760 con 0x7f95041595d0 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9504073380 con 0x7f95041595d0 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94fc014980 con 0x7f95041595d0 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f95017fa640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94f0066280 0x7f94f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94fc084b70 con 0x7f95041595d0 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9508c92640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94f0066280 0x7f94f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.286+0000 7f9508c92640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94f0066280 0x7f94f0068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f95040b2e80 tx=0x7f94f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.290+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94fc051d90 con 0x7f95041595d0 2023-06-09T04:39:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.438+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95040af470 con 0x7f95041595d0 2023-06-09T04:39:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.438+0000 7f95017fa640 1 -- 172.21.15.18:0/2521733388 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94fc0180a0 con 0x7f95041595d0 2023-06-09T04:39:04.443 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:04.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94f0066280 msgr2=0x7f94f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94f0066280 0x7f94f0068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f95040b2e80 tx=0x7f94f4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:04.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 msgr2=0x7f9504155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 0x7f9504155550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00efc0 tx=0x7f94fc00c490 comp rx=0 tx=0).stop 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 shutdown_connections 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95041595d0 0x7f9504155550 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f94f0066280 0x7f94f0068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9504155d20 0x7f9504155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 --2- 172.21.15.18:0/2521733388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f950406c310 0x7f950415ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 >> 172.21.15.18:0/2521733388 conn(0x7f95040afa90 msgr2=0x7f950415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 shutdown_connections 2023-06-09T04:39:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.442+0000 7f950aef6640 1 -- 172.21.15.18:0/2521733388 wait complete. 2023-06-09T04:39:04.461 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 Processor -- start 2023-06-09T04:39:04.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 -- start start 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df00cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4df00acdf0 0x7f4df00cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df015de50 con 0x7f4df0159590 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df015d2d0 con 0x7f4df00acdf0 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df6d3e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df015d5b0 con 0x7f4df01591c0 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4deffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4df0159590 0x7f4df006bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60718/0 (socket says 172.21.15.18:60718) 2023-06-09T04:39:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4deffff640 1 -- 172.21.15.18:0/98288190 learned_addr learned my addr 172.21.15.18:0/98288190 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:04.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df4ada640 1 --2- 172.21.15.18:0/98288190 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df00cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df52db640 1 --2- 172.21.15.18:0/98288190 >> v2:172.21.15.81:3300/0 conn(0x7f4df00acdf0 0x7f4df00cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4def7fe640 1 -- 172.21.15.18:0/98288190 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128206401 0 0) 0x7f4df015de50 con 0x7f4df0159590 2023-06-09T04:39:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4def7fe640 1 -- 172.21.15.18:0/98288190 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd8003530 con 0x7f4df0159590 2023-06-09T04:39:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df4ada640 1 -- 172.21.15.18:0/98288190 >> v2:172.21.15.81:3300/0 conn(0x7f4df00acdf0 msgr2=0x7f4df00cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df4ada640 1 --2- 172.21.15.18:0/98288190 >> v2:172.21.15.81:3300/0 conn(0x7f4df00acdf0 0x7f4df00cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df4ada640 1 -- 172.21.15.18:0/98288190 >> v1:172.21.15.18:6789/0 conn(0x7f4df0159590 legacy=0x7f4df006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.586+0000 7f4df4ada640 1 -- 172.21.15.18:0/98288190 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df015d890 con 0x7f4df01591c0 2023-06-09T04:39:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 --2- 172.21.15.18:0/98288190 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df00cb630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4de00097a0 tx=0x7f4de001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f039eb96944fe58d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4def7fe640 1 -- 172.21.15.18:0/98288190 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00ad640 con 0x7f4df01591c0 2023-06-09T04:39:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4def7fe640 1 -- 172.21.15.18:0/98288190 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de00ad7a0 con 0x7f4df01591c0 2023-06-09T04:39:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4def7fe640 1 -- 172.21.15.18:0/98288190 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00adb10 con 0x7f4df01591c0 2023-06-09T04:39:04.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- 172.21.15.18:0/98288190 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 msgr2=0x7f4df00cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/98288190 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df00cb630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4de00097a0 tx=0x7f4de001c430 comp rx=0 tx=0).stop 2023-06-09T04:39:04.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- 172.21.15.18:0/98288190 shutdown_connections 2023-06-09T04:39:04.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/98288190 >> v2:172.21.15.81:3300/0 conn(0x7f4df00acdf0 0x7f4df00cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/98288190 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df00cb630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- 172.21.15.18:0/98288190 >> 172.21.15.18:0/98288190 conn(0x7f4df00afa90 msgr2=0x7f4df00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- 172.21.15.18:0/98288190 shutdown_connections 2023-06-09T04:39:04.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- 172.21.15.18:0/98288190 wait complete. 2023-06-09T04:39:04.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 Processor -- start 2023-06-09T04:39:04.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- start start 2023-06-09T04:39:04.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 0x7f4df00ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df0159590 0x7f4df0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df015b5e0 con 0x7f4df00acdf0 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df015b810 con 0x7f4df0159590 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df6d3e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df015baf0 con 0x7f4df01591c0 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 0x7f4df00ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 0x7f4df00ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40364/0 (socket says 172.21.15.18:40364) 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 -- 172.21.15.18:0/1444115640 learned_addr learned my addr 172.21.15.18:0/1444115640 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4deffff640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df52db640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df0159590 0x7f4df0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 -- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 msgr2=0x7f4df015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 -- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df0159590 msgr2=0x7f4df0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df0159590 0x7f4df0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.590+0000 7f4df4ada640 1 -- 172.21.15.18:0/1444115640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de00093b0 con 0x7f4df00acdf0 2023-06-09T04:39:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4df4ada640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 0x7f4df00ae130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4de001a060 tx=0x7f4de00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0004220 con 0x7f4df00acdf0 2023-06-09T04:39:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de00a6070 con 0x7f4df00acdf0 2023-06-09T04:39:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df015bdd0 con 0x7f4df00acdf0 2023-06-09T04:39:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00ad910 con 0x7f4df00acdf0 2023-06-09T04:39:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df015c390 con 0x7f4df00acdf0 2023-06-09T04:39:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df0073380 con 0x7f4df00acdf0 2023-06-09T04:39:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4de00b4040 con 0x7f4df00acdf0 2023-06-09T04:39:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4ded7fa640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4ddc066280 0x7f4ddc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4de011d420 con 0x7f4df00acdf0 2023-06-09T04:39:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4deffff640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4ddc066280 0x7f4ddc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.594+0000 7f4deffff640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4ddc066280 0x7f4ddc068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4df0158880 tx=0x7f4de4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.598+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4de00ea520 con 0x7f4df00acdf0 2023-06-09T04:39:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.754+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4df00ac8c0 con 0x7f4df00acdf0 2023-06-09T04:39:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.754+0000 7f4ded7fa640 1 -- 172.21.15.18:0/1444115640 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4de00edb40 con 0x7f4df00acdf0 2023-06-09T04:39:04.759 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4ddc066280 msgr2=0x7f4ddc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4ddc066280 0x7f4ddc068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4df0158880 tx=0x7f4de4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:04.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 msgr2=0x7f4df00ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 0x7f4df00ae130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4de001a060 tx=0x7f4de00191d0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 shutdown_connections 2023-06-09T04:39:04.762 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df0159590 0x7f4df0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4ddc066280 0x7f4ddc068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df01591c0 0x7f4df015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 --2- 172.21.15.18:0/1444115640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df00acdf0 0x7f4df00ae130 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 >> 172.21.15.18:0/1444115640 conn(0x7f4df00afa90 msgr2=0x7f4df00cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 shutdown_connections 2023-06-09T04:39:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.758+0000 7f4df6d3e640 1 -- 172.21.15.18:0/1444115640 wait complete. 2023-06-09T04:39:04.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.902+0000 7f85d0c40640 1 Processor -- start 2023-06-09T04:39:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.902+0000 7f85d0c40640 1 -- start start 2023-06-09T04:39:04.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85d0c40640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85cc0cf890 0x7f85cc0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85d0c40640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 0x7f85cc15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85d0c40640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc159980 con 0x7f85cc1595b0 2023-06-09T04:39:04.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85d0c40640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0cbfc0 con 0x7f85cc0cf890 2023-06-09T04:39:04.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85d0c40640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0ce710 con 0x7f85cc0ccb70 2023-06-09T04:39:04.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85cad9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 0x7f85cc15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85c9d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85cc0cf890 0x7f85cc0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85cad9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 0x7f85cc15d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:46900/0 (socket says 172.21.15.18:46900) 2023-06-09T04:39:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85cad9d640 1 -- 172.21.15.18:0/3651398021 learned_addr learned my addr 172.21.15.18:0/3651398021 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85c9d9b640 1 -- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 msgr2=0x7f85cc15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85c9d9b640 1 --2- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 0x7f85cc15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85c9d9b640 1 -- 172.21.15.18:0/3651398021 >> v1:172.21.15.81:6789/0 conn(0x7f85cc1595b0 legacy=0x7f85cc0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85c9d9b640 1 -- 172.21.15.18:0/3651398021 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0cabb0 con 0x7f85cc0cf890 2023-06-09T04:39:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.906+0000 7f85cad9d640 1 --2- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 0x7f85cc15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:04.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c9d9b640 1 --2- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0cf890 0x7f85cc0b2bc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097c0 tx=0x7f85c001c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14cf877fb6540200 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c959a640 1 -- 172.21.15.18:0/3651398021 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00ab600 con 0x7f85cc0cf890 2023-06-09T04:39:04.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c959a640 1 -- 172.21.15.18:0/3651398021 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00a7050 con 0x7f85cc0cf890 2023-06-09T04:39:04.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c959a640 1 -- 172.21.15.18:0/3651398021 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00ab980 con 0x7f85cc0cf890 2023-06-09T04:39:04.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0cf890 msgr2=0x7f85cc0b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 --2- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0cf890 0x7f85cc0b2bc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097c0 tx=0x7f85c001c1c0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- 172.21.15.18:0/3651398021 shutdown_connections 2023-06-09T04:39:04.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 --2- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc0ccb70 0x7f85cc15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 --2- 172.21.15.18:0/3651398021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0cf890 0x7f85cc0b2bc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- 172.21.15.18:0/3651398021 >> 172.21.15.18:0/3651398021 conn(0x7f85cc06ce60 msgr2=0x7f85cc06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:04.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- 172.21.15.18:0/3651398021 shutdown_connections 2023-06-09T04:39:04.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- 172.21.15.18:0/3651398021 wait complete. 2023-06-09T04:39:04.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 Processor -- start 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- start start 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0ccb70 0x7f85cc14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 0x7f85cc14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc1595b0 0x7f85cc150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc14ec50 con 0x7f85cc0cf890 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc14dfd0 con 0x7f85cc0ccb70 2023-06-09T04:39:04.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85d0c40640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc14e2b0 con 0x7f85cc1595b0 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 0x7f85cc14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 0x7f85cc14fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40374/0 (socket says 172.21.15.18:40374) 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c9d9b640 1 -- 172.21.15.18:0/1784074543 learned_addr learned my addr 172.21.15.18:0/1784074543 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85ca59c640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0ccb70 0x7f85cc14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85cad9d640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc1595b0 0x7f85cc150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.910+0000 7f85c9d9b640 1 -- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc1595b0 msgr2=0x7f85cc150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85c9d9b640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc1595b0 0x7f85cc150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85c9d9b640 1 -- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0ccb70 msgr2=0x7f85cc14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85c9d9b640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0ccb70 0x7f85cc14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85c9d9b640 1 -- 172.21.15.18:0/1784074543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4009b30 con 0x7f85cc0cf890 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85cad9d640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc1595b0 0x7f85cc150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85c9d9b640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 0x7f85cc14fc50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f85c001a870 tx=0x7f85c0018f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00b9070 con 0x7f85cc0cf890 2023-06-09T04:39:04.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00abdc0 con 0x7f85cc0cf890 2023-06-09T04:39:04.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00b4660 con 0x7f85cc0cf890 2023-06-09T04:39:04.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c0009420 con 0x7f85cc0cf890 2023-06-09T04:39:04.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc0ce9f0 con 0x7f85cc0cf890 2023-06-09T04:39:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85c00b2040 con 0x7f85cc0cf890 2023-06-09T04:39:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc14ed90 con 0x7f85cc0cf890 2023-06-09T04:39:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85baffd640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85ac066280 0x7f85ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85c011d400 con 0x7f85cc0cf890 2023-06-09T04:39:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85ca59c640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85ac066280 0x7f85ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:04.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.914+0000 7f85ca59c640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85ac066280 0x7f85ac068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85cc155270 tx=0x7f85bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:04.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:04.918+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85cc14ed90 con 0x7f85cc0cf890 2023-06-09T04:39:05.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.066+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85cc14ed90 con 0x7f85cc0cf890 2023-06-09T04:39:05.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.066+0000 7f85baffd640 1 -- 172.21.15.18:0/1784074543 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85cc14ed90 con 0x7f85cc0cf890 2023-06-09T04:39:05.071 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:05.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85ac066280 msgr2=0x7f85ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85ac066280 0x7f85ac068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f85cc155270 tx=0x7f85bc009040 comp rx=0 tx=0).stop 2023-06-09T04:39:05.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 msgr2=0x7f85cc14fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 0x7f85cc14fc50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f85c001a870 tx=0x7f85c0018f60 comp rx=0 tx=0).stop 2023-06-09T04:39:05.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 shutdown_connections 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f85ac066280 0x7f85ac068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85cc1595b0 0x7f85cc150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85cc0cf890 0x7f85cc14fc50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 --2- 172.21.15.18:0/1784074543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85cc0ccb70 0x7f85cc14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 >> 172.21.15.18:0/1784074543 conn(0x7f85cc06ce60 msgr2=0x7f85cc0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 shutdown_connections 2023-06-09T04:39:05.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.070+0000 7f85d0c40640 1 -- 172.21.15.18:0/1784074543 wait complete. 2023-06-09T04:39:05.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.202+0000 7f723f7d1640 1 Processor -- start 2023-06-09T04:39:05.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.202+0000 7f723f7d1640 1 -- start start 2023-06-09T04:39:05.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723f7d1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72380cbd40 0x7f7238069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723f7d1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723815de50 con 0x7f7238159590 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723f7d1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723815d2d0 con 0x7f72381591c0 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723f7d1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723815d5b0 con 0x7f72380cbd40 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72380cbd40 0x7f7238069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72380cbd40 0x7f7238069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40380/0 (socket says 172.21.15.18:40380) 2023-06-09T04:39:05.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 -- 172.21.15.18:0/391741574 learned_addr learned my addr 172.21.15.18:0/391741574 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 -- 172.21.15.18:0/391741574 >> v1:172.21.15.81:6789/0 conn(0x7f72381591c0 legacy=0x7f72380cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 -- 172.21.15.18:0/391741574 >> v1:172.21.15.18:6789/0 conn(0x7f7238159590 legacy=0x7f7238069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 -- 172.21.15.18:0/391741574 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723815d890 con 0x7f72380cbd40 2023-06-09T04:39:05.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.206+0000 7f723cd6c640 1 --2- 172.21.15.18:0/391741574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72380cbd40 0x7f7238069600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7228009870 tx=0x7f722801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b753f1e87310aff2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f722ffff640 1 -- 172.21.15.18:0/391741574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280a7070 con 0x7f72380cbd40 2023-06-09T04:39:05.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f722ffff640 1 -- 172.21.15.18:0/391741574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280ab430 con 0x7f72380cbd40 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f722ffff640 1 -- 172.21.15.18:0/391741574 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280ab7c0 con 0x7f72380cbd40 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- 172.21.15.18:0/391741574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72380cbd40 msgr2=0x7f7238069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 --2- 172.21.15.18:0/391741574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72380cbd40 0x7f7238069600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7228009870 tx=0x7f722801c4d0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- 172.21.15.18:0/391741574 shutdown_connections 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 --2- 172.21.15.18:0/391741574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72380cbd40 0x7f7238069600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- 172.21.15.18:0/391741574 >> 172.21.15.18:0/391741574 conn(0x7f72380afa90 msgr2=0x7f72380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- 172.21.15.18:0/391741574 shutdown_connections 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- 172.21.15.18:0/391741574 wait complete. 2023-06-09T04:39:05.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 Processor -- start 2023-06-09T04:39:05.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- start start 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cbd40 0x7f723814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72381591c0 0x7f72380b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 0x7f72381599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723814eab0 con 0x7f7238159590 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238155730 con 0x7f72380cbd40 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.210+0000 7f723f7d1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72380b30f0 con 0x7f72381591c0 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 0x7f72381599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 0x7f72381599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40382/0 (socket says 172.21.15.18:40382) 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 -- 172.21.15.18:0/1563902406 learned_addr learned my addr 172.21.15.18:0/1563902406 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:05.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723d56d640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cbd40 0x7f723814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723cd6c640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72381591c0 0x7f72380b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 -- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72381591c0 msgr2=0x7f72380b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72381591c0 0x7f72380b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 -- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cbd40 msgr2=0x7f723814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cbd40 0x7f723814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 -- 172.21.15.18:0/1563902406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280094d0 con 0x7f7238159590 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723cd6c640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72381591c0 0x7f72380b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:05.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723dd6e640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 0x7f72381599e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f723000c760 tx=0x7f723000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230003b80 con 0x7f7238159590 2023-06-09T04:39:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230003ce0 con 0x7f7238159590 2023-06-09T04:39:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723000aa90 con 0x7f7238159590 2023-06-09T04:39:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72380b3900 con 0x7f7238159590 2023-06-09T04:39:05.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72380b3620 con 0x7f7238159590 2023-06-09T04:39:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723814ebf0 con 0x7f7238159590 2023-06-09T04:39:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f723000abf0 con 0x7f7238159590 2023-06-09T04:39:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f722dffb640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f721c066280 0x7f721c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7230083c60 con 0x7f7238159590 2023-06-09T04:39:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.214+0000 7f723d56d640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f721c066280 0x7f721c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.218+0000 7f723d56d640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f721c066280 0x7f721c068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7234001850 tx=0x7f7234009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.218+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f723814ebf0 con 0x7f7238159590 2023-06-09T04:39:05.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f723814ebf0 con 0x7f7238159590 2023-06-09T04:39:05.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f722dffb640 1 -- 172.21.15.18:0/1563902406 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f723814ebf0 con 0x7f7238159590 2023-06-09T04:39:05.373 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f721c066280 msgr2=0x7f721c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f721c066280 0x7f721c068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7234001850 tx=0x7f7234009040 comp rx=0 tx=0).stop 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 msgr2=0x7f72381599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 0x7f72381599e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f723000c760 tx=0x7f723000cc20 comp rx=0 tx=0).stop 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 shutdown_connections 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7238159590 0x7f72381599e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f721c066280 0x7f721c068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72381591c0 0x7f72380b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 --2- 172.21.15.18:0/1563902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cbd40 0x7f723814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 >> 172.21.15.18:0/1563902406 conn(0x7f72380afa90 msgr2=0x7f7238156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 shutdown_connections 2023-06-09T04:39:05.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.370+0000 7f723f7d1640 1 -- 172.21.15.18:0/1563902406 wait complete. 2023-06-09T04:39:05.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:05.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 Processor -- start 2023-06-09T04:39:05.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 -- start start 2023-06-09T04:39:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac15f280 0x7fc9ac15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9ac0b39d0 0x7fc9ac0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac15fd40 con 0x7fc9ac15b600 2023-06-09T04:39:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac0cfce0 con 0x7fc9ac0b39d0 2023-06-09T04:39:05.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b44f7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0b4390 con 0x7fc9ac15f280 2023-06-09T04:39:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2293640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc9ac15b600 0x7fc9ac0b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:42700/0 (socket says 172.21.15.18:42700) 2023-06-09T04:39:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2293640 1 -- 172.21.15.18:0/2514704795 learned_addr learned my addr 172.21.15.18:0/2514704795 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b1a92640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac15f280 0x7fc9ac15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2a94640 1 --2- 172.21.15.18:0/2514704795 >> v2:172.21.15.81:3300/0 conn(0x7fc9ac0b39d0 0x7fc9ac0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2a94640 1 -- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac15f280 msgr2=0x7fc9ac15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2a94640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac15f280 0x7fc9ac15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2a94640 1 -- 172.21.15.18:0/2514704795 >> v1:172.21.15.81:6789/0 conn(0x7fc9ac15b600 legacy=0x7fc9ac0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b2a94640 1 -- 172.21.15.18:0/2514704795 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac160020 con 0x7fc9ac0b39d0 2023-06-09T04:39:05.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.506+0000 7fc9b1a92640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac15f280 0x7fc9ac15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:05.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b2a94640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac0b39d0 0x7fc9ac0b3e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009d90 tx=0x7fc9a401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e28d79cde5cd82 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b1291640 1 -- 172.21.15.18:0/2514704795 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40a5870 con 0x7fc9ac0b39d0 2023-06-09T04:39:05.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b1291640 1 -- 172.21.15.18:0/2514704795 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40a59d0 con 0x7fc9ac0b39d0 2023-06-09T04:39:05.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b1291640 1 -- 172.21.15.18:0/2514704795 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40a5d60 con 0x7fc9ac0b39d0 2023-06-09T04:39:05.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac0b39d0 msgr2=0x7fc9ac0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac0b39d0 0x7fc9ac0b3e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009d90 tx=0x7fc9a401c8c0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2514704795 shutdown_connections 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac0b39d0 0x7fc9ac0b3e50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2514704795 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac15f280 0x7fc9ac15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2514704795 >> 172.21.15.18:0/2514704795 conn(0x7fc9ac0d2120 msgr2=0x7fc9ac0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2514704795 shutdown_connections 2023-06-09T04:39:05.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2514704795 wait complete. 2023-06-09T04:39:05.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 Processor -- start 2023-06-09T04:39:05.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.510+0000 7fc9b44f7640 1 -- start start 2023-06-09T04:39:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac0b39d0 0x7fc9ac14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 0x7fc9ac156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac15f280 0x7fc9ac15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac157aa0 con 0x7fc9ac15b600 2023-06-09T04:39:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac157610 con 0x7fc9ac15f280 2023-06-09T04:39:05.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac156a00 con 0x7fc9ac0b39d0 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 0x7fc9ac156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 0x7fc9ac156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40388/0 (socket says 172.21.15.18:40388) 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 -- 172.21.15.18:0/2829820921 learned_addr learned my addr 172.21.15.18:0/2829820921 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b2293640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac0b39d0 0x7fc9ac14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b2a94640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac15f280 0x7fc9ac15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 -- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac0b39d0 msgr2=0x7fc9ac14bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac0b39d0 0x7fc9ac14bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 -- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac15f280 msgr2=0x7fc9ac15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac15f280 0x7fc9ac15d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 -- 172.21.15.18:0/2829820921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009420 con 0x7fc9ac15b600 2023-06-09T04:39:05.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b1a92640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 0x7fc9ac156020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00e980 tx=0x7fc99c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00ca00 con 0x7fc9ac15b600 2023-06-09T04:39:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00cb60 con 0x7fc9ac15b600 2023-06-09T04:39:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a4009a70 con 0x7fc9ac15b600 2023-06-09T04:39:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c013470 con 0x7fc9ac15b600 2023-06-09T04:39:05.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac156fc0 con 0x7fc9ac15b600 2023-06-09T04:39:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac157780 con 0x7fc9ac15b600 2023-06-09T04:39:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc99c0135d0 con 0x7fc9ac15b600 2023-06-09T04:39:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.514+0000 7fc9a2ffd640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc990066280 0x7fc990068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.518+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc99c0848a0 con 0x7fc9ac15b600 2023-06-09T04:39:05.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.518+0000 7fc9b2293640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc990066280 0x7fc990068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.518+0000 7fc9b2293640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc990066280 0x7fc990068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8005890 tx=0x7fc9a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.518+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc99c051c50 con 0x7fc9ac15b600 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc9ac073380 con 0x7fc9ac15b600 2023-06-09T04:39:05.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9a2ffd640 1 -- 172.21.15.18:0/2829820921 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc99c055270 con 0x7fc9ac15b600 2023-06-09T04:39:05.673 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc990066280 msgr2=0x7fc990068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc990066280 0x7fc990068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8005890 tx=0x7fc9a8009040 comp rx=0 tx=0).stop 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 msgr2=0x7fc9ac156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 0x7fc9ac156020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00e980 tx=0x7fc99c00ee40 comp rx=0 tx=0).stop 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 shutdown_connections 2023-06-09T04:39:05.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9ac15f280 0x7fc9ac15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9ac15b600 0x7fc9ac156020 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc990066280 0x7fc990068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 --2- 172.21.15.18:0/2829820921 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc9ac0b39d0 0x7fc9ac14bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 >> 172.21.15.18:0/2829820921 conn(0x7fc9ac0d2120 msgr2=0x7fc9ac0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 shutdown_connections 2023-06-09T04:39:05.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.670+0000 7fc9b44f7640 1 -- 172.21.15.18:0/2829820921 wait complete. 2023-06-09T04:39:05.700 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T04:39:05.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T04:39:05.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.806+0000 7f4dd5e5f640 1 Processor -- start 2023-06-09T04:39:05.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.806+0000 7f4dd5e5f640 1 -- start start 2023-06-09T04:39:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dd00cc9b0 0x7f4dd015f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd015f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd015c950 con 0x7f4dd00b7480 2023-06-09T04:39:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00ce320 con 0x7f4dd00cc9b0 2023-06-09T04:39:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00cc4b0 con 0x7f4dd00b3fe0 2023-06-09T04:39:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dd00cc9b0 0x7f4dd015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dd00cc9b0 0x7f4dd015f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40390/0 (socket says 172.21.15.18:40390) 2023-06-09T04:39:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 -- 172.21.15.18:0/3492336488 learned_addr learned my addr 172.21.15.18:0/3492336488 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dcf7fe640 1 --1- 172.21.15.18:0/3492336488 >> v1:172.21.15.18:6789/0 conn(0x7f4dd00b7480 0x7f4dd00b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60738/0 (socket says 172.21.15.18:60738) 2023-06-09T04:39:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dcffff640 1 --2- 172.21.15.18:0/3492336488 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 -- 172.21.15.18:0/3492336488 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 msgr2=0x7f4dd015f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 --2- 172.21.15.18:0/3492336488 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd015f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 -- 172.21.15.18:0/3492336488 >> v1:172.21.15.18:6789/0 conn(0x7f4dd00b7480 legacy=0x7f4dd00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 -- 172.21.15.18:0/3492336488 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00ce010 con 0x7f4dd00cc9b0 2023-06-09T04:39:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dce7fc640 1 -- 172.21.15.18:0/3492336488 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251776925 0 0) 0x7f4dd015c950 con 0x7f4dd00b7480 2023-06-09T04:39:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dceffd640 1 --2- 172.21.15.18:0/3492336488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00cc9b0 0x7f4dd015f150 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c39969ae0eae4a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dce7fc640 1 -- 172.21.15.18:0/3492336488 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40a9620 con 0x7f4dd00cc9b0 2023-06-09T04:39:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dce7fc640 1 -- 172.21.15.18:0/3492336488 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40a9780 con 0x7f4dd00cc9b0 2023-06-09T04:39:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dce7fc640 1 -- 172.21.15.18:0/3492336488 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40a9b10 con 0x7f4dd00cc9b0 2023-06-09T04:39:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/3492336488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00cc9b0 msgr2=0x7f4dd015f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/3492336488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00cc9b0 0x7f4dd015f150 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc401c540 comp rx=0 tx=0).stop 2023-06-09T04:39:05.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/3492336488 shutdown_connections 2023-06-09T04:39:05.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/3492336488 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/3492336488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00cc9b0 0x7f4dd015f150 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.810+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/3492336488 >> 172.21.15.18:0/3492336488 conn(0x7f4dd00d2ae0 msgr2=0x7f4dd00ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:05.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/3492336488 shutdown_connections 2023-06-09T04:39:05.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/3492336488 wait complete. 2023-06-09T04:39:05.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 Processor -- start 2023-06-09T04:39:05.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- start start 2023-06-09T04:39:05.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd01595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 0x7f4dd01f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd014dda0 0x7f4dd01f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd015b310 con 0x7f4dd00b7480 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0158d10 con 0x7f4dd014dda0 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0159290 con 0x7f4dd00b3fe0 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 0x7f4dd01f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 0x7f4dd01f7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40398/0 (socket says 172.21.15.18:40398) 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 -- 172.21.15.18:0/4219886240 learned_addr learned my addr 172.21.15.18:0/4219886240 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:05.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dcf7fe640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd01595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dcffff640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd014dda0 0x7f4dd01f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 -- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 msgr2=0x7f4dd01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd01595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 -- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd014dda0 msgr2=0x7f4dd01f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd014dda0 0x7f4dd01f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 -- 172.21.15.18:0/4219886240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40094d0 con 0x7f4dd00b7480 2023-06-09T04:39:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dcffff640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd014dda0 0x7f4dd01f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dceffd640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 0x7f4dd01f7fd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4dc401a170 tx=0x7f4dc401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40bc5f0 con 0x7f4dd00b7480 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40bc770 con 0x7f4dd00b7480 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd0158fb0 con 0x7f4dd00b7480 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40bcb20 con 0x7f4dd00b7480 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd014e440 con 0x7f4dd00b7480 2023-06-09T04:39:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.814+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd0073380 con 0x7f4dd00b7480 2023-06-09T04:39:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.818+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4dc40b23f0 con 0x7f4dd00b7480 2023-06-09T04:39:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.818+0000 7f4db7fff640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dbc066280 0x7f4dbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:05.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.818+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4dc411e940 con 0x7f4dd00b7480 2023-06-09T04:39:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.818+0000 7f4dcf7fe640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dbc066280 0x7f4dbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.818+0000 7f4dcf7fe640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dbc066280 0x7f4dbc068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000f70 tx=0x7f4dc0007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:05.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:05.822+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dc40ebc10 con 0x7f4dd00b7480 2023-06-09T04:39:06.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.022+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f4dd015b450 con 0x7f4dd00b7480 2023-06-09T04:39:06.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.222+0000 7f4db7fff640 1 -- 172.21.15.18:0/4219886240 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v68) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4dc40ef230 con 0x7f4dd00b7480 2023-06-09T04:39:06.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dbc066280 msgr2=0x7f4dbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dbc066280 0x7f4dbc068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000f70 tx=0x7f4dc0007b60 comp rx=0 tx=0).stop 2023-06-09T04:39:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 msgr2=0x7f4dd01f7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 0x7f4dd01f7fd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4dc401a170 tx=0x7f4dc401ad80 comp rx=0 tx=0).stop 2023-06-09T04:39:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 shutdown_connections 2023-06-09T04:39:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd014dda0 0x7f4dd01f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd00b7480 0x7f4dd01f7fd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dbc066280 0x7f4dbc068730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 --2- 172.21.15.18:0/4219886240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4dd00b3fe0 0x7f4dd01595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 >> 172.21.15.18:0/4219886240 conn(0x7f4dd00d2ae0 msgr2=0x7f4dd0154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 shutdown_connections 2023-06-09T04:39:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.226+0000 7f4dd5e5f640 1 -- 172.21.15.18:0/4219886240 wait complete. 2023-06-09T04:39:06.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-09T04:39:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d2348640 1 Processor -- start 2023-06-09T04:39:06.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d2348640 1 -- start start 2023-06-09T04:39:06.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d2348640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6cc0cbd40 0x7fe6cc069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d2348640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc15de50 con 0x7fe6cc1591c0 2023-06-09T04:39:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d2348640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc15d2d0 con 0x7fe6cc159590 2023-06-09T04:39:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d2348640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc15d5b0 con 0x7fe6cc0cbd40 2023-06-09T04:39:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cbfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe6cc1591c0 0x7fe6cc0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60742/0 (socket says 172.21.15.18:60742) 2023-06-09T04:39:06.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cbfff640 1 -- 172.21.15.18:0/3888103885 learned_addr learned my addr 172.21.15.18:0/3888103885 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:06.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580635860 0 0) 0x7fe6cc15de50 con 0x7fe6cc1591c0 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b4003530 con 0x7fe6cc1591c0 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 --2- 172.21.15.18:0/3888103885 >> v2:172.21.15.81:3300/0 conn(0x7fe6cc0cbd40 0x7fe6cc069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436475532 0 0) 0x7fe6b4003530 con 0x7fe6cc1591c0 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 >> v2:172.21.15.81:3300/0 conn(0x7fe6cc0cbd40 msgr2=0x7fe6cc069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 --2- 172.21.15.18:0/3888103885 >> v2:172.21.15.81:3300/0 conn(0x7fe6cc0cbd40 0x7fe6cc069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 >> v1:172.21.15.81:6789/0 conn(0x7fe6cc159590 legacy=0x7fe6cc069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc15d890 con 0x7fe6cc1591c0 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fe6bc001800 con 0x7fe6cc1591c0 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 >> v1:172.21.15.18:6789/0 conn(0x7fe6cc1591c0 legacy=0x7fe6cc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6b4003980 0x7fe6b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40047d0 0x7fe6b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b4005180 0x7fe6b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc15d5b0 con 0x7fe6b40047d0 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b400c000 con 0x7fe6b4005180 2023-06-09T04:39:06.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b400c1c0 con 0x7fe6b4003980 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40047d0 0x7fe6b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 -- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6b4003980 msgr2=0x7fe6b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d08e5640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b4005180 0x7fe6b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cbfff640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6b4003980 0x7fe6b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6b4003980 0x7fe6b4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 -- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b4005180 msgr2=0x7fe6b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b4005180 0x7fe6b400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6cb7fe640 1 -- 172.21.15.18:0/3888103885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4003530 con 0x7fe6b40047d0 2023-06-09T04:39:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d08e5640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b4005180 0x7fe6b400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:06.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.370+0000 7fe6d08e5640 1 -- 172.21.15.18:0/3888103885 reap_dead start 2023-06-09T04:39:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6cb7fe640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40047d0 0x7fe6b4004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009ab0 tx=0x7fe6c001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20a3f93f58284b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00a6460 con 0x7fe6b40047d0 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c00a65c0 con 0x7fe6b40047d0 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6caffd640 1 -- 172.21.15.18:0/3888103885 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00a6970 con 0x7fe6b40047d0 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 -- 172.21.15.18:0/3888103885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40047d0 msgr2=0x7fe6b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40047d0 0x7fe6b4004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009ab0 tx=0x7fe6c001c970 comp rx=0 tx=0).stop 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 -- 172.21.15.18:0/3888103885 shutdown_connections 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3888103885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6b40047d0 0x7fe6b4004c40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 -- 172.21.15.18:0/3888103885 >> 172.21.15.18:0/3888103885 conn(0x7fe6cc0afa90 msgr2=0x7fe6cc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 -- 172.21.15.18:0/3888103885 shutdown_connections 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 -- 172.21.15.18:0/3888103885 wait complete. 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 Processor -- start 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.374+0000 7fe6d2348640 1 -- start start 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b40047d0 0x7fe6cc14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6cc0c2900 0x7fe6cc0c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 0x7fe6cc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc157a70 con 0x7fe6cc156910 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0c32b0 con 0x7fe6b40047d0 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc157680 con 0x7fe6cc0c2900 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 0x7fe6cc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 0x7fe6cc156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40418/0 (socket says 172.21.15.18:40418) 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 -- 172.21.15.18:0/3191954095 learned_addr learned my addr 172.21.15.18:0/3191954095 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:06.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6cbfff640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b40047d0 0x7fe6cc14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6cb7fe640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6cc0c2900 0x7fe6cc0c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 -- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6cc0c2900 msgr2=0x7fe6cc0c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6cc0c2900 0x7fe6cc0c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 -- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b40047d0 msgr2=0x7fe6cc14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b40047d0 0x7fe6cc14e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 -- 172.21.15.18:0/3191954095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc1f0f50 con 0x7fe6cc156910 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d08e5640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 0x7fe6cc156d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0cd9c0 tx=0x7fe6c400d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c400b070 con 0x7fe6cc156910 2023-06-09T04:39:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4003980 con 0x7fe6cc156910 2023-06-09T04:39:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc1f0190 con 0x7fe6cc156910 2023-06-09T04:39:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4003d30 con 0x7fe6cc156910 2023-06-09T04:39:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc1f0750 con 0x7fe6cc156910 2023-06-09T04:39:06.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc0650c0 con 0x7fe6cc156910 2023-06-09T04:39:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6c4005070 con 0x7fe6cc156910 2023-06-09T04:39:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6c8ff9640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6b8066280 0x7fe6b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe6c4083240 con 0x7fe6cc156910 2023-06-09T04:39:06.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6cbfff640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6b8066280 0x7fe6b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.378+0000 7fe6cbfff640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6b8066280 0x7fe6b8068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001140 tx=0x7fe6bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.382+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6c40503c0 con 0x7fe6cc156910 2023-06-09T04:39:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.538+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe6cc0cceb0 con 0x7fe6cc156910 2023-06-09T04:39:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.542+0000 7fe6c8ff9640 1 -- 172.21.15.18:0/3191954095 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6c40180c0 con 0x7fe6cc156910 2023-06-09T04:39:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6b8066280 msgr2=0x7fe6b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6b8066280 0x7fe6b8068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001140 tx=0x7fe6bc009040 comp rx=0 tx=0).stop 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 msgr2=0x7fe6cc156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 0x7fe6cc156d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0cd9c0 tx=0x7fe6c400d830 comp rx=0 tx=0).stop 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 shutdown_connections 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6cc156910 0x7fe6cc156d80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6b8066280 0x7fe6b8068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6cc0c2900 0x7fe6cc0c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 --2- 172.21.15.18:0/3191954095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6b40047d0 0x7fe6cc14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 >> 172.21.15.18:0/3191954095 conn(0x7fe6cc0afa90 msgr2=0x7fe6cc0ada90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 shutdown_connections 2023-06-09T04:39:06.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.546+0000 7fe6d2348640 1 -- 172.21.15.18:0/3191954095 wait complete. 2023-06-09T04:39:06.566 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T04:39:06.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:39:06.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:39:06.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T04:39:06.677 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:39:06.678 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:06.683 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:39:06.684 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:06.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:06.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcf0ec6640 1 Processor -- start 2023-06-09T04:39:06.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcf0ec6640 1 -- start start 2023-06-09T04:39:06.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcf0ec6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdcec159320 0x7fdcec15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcf0ec6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec15cf10 con 0x7fdcec15d680 2023-06-09T04:39:06.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcf0ec6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec0c81b0 con 0x7fdcec070270 2023-06-09T04:39:06.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcf0ec6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcec15a920 con 0x7fdcec159320 2023-06-09T04:39:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdcea59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdcec159320 0x7fdcec15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdce9d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdcec15d680 0x7fdcec06fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52416/0 (socket says 172.21.15.18:52416) 2023-06-09T04:39:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdce9d9b640 1 -- 172.21.15.18:0/923915868 learned_addr learned my addr 172.21.15.18:0/923915868 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdce959a640 1 -- 172.21.15.18:0/923915868 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808106254 0 0) 0x7fdcec15cf10 con 0x7fdcec15d680 2023-06-09T04:39:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.902+0000 7fdce959a640 1 -- 172.21.15.18:0/923915868 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd8003530 con 0x7fdcec15d680 2023-06-09T04:39:06.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.906+0000 7fdcea59c640 1 -- 172.21.15.18:0/923915868 >> v1:172.21.15.81:6789/0 conn(0x7fdcec070270 legacy=0x7fdcec06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.906+0000 7fdcea59c640 1 -- 172.21.15.18:0/923915868 >> v1:172.21.15.18:6789/0 conn(0x7fdcec15d680 legacy=0x7fdcec06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.906+0000 7fdcea59c640 1 -- 172.21.15.18:0/923915868 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0c8490 con 0x7fdcec159320 2023-06-09T04:39:06.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcea59c640 1 --2- 172.21.15.18:0/923915868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec159320 0x7fdcec15a3e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdcec15aa60 tx=0x7fdcdc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6ad1f7ea566fc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce959a640 1 -- 172.21.15.18:0/923915868 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0ab600 con 0x7fdcec159320 2023-06-09T04:39:06.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce959a640 1 -- 172.21.15.18:0/923915868 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0a7050 con 0x7fdcec159320 2023-06-09T04:39:06.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce959a640 1 -- 172.21.15.18:0/923915868 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0ab980 con 0x7fdcec159320 2023-06-09T04:39:06.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/923915868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec159320 msgr2=0x7fdcec15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/923915868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec159320 0x7fdcec15a3e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdcec15aa60 tx=0x7fdcdc01c3c0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/923915868 shutdown_connections 2023-06-09T04:39:06.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/923915868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec159320 0x7fdcec15a3e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/923915868 >> 172.21.15.18:0/923915868 conn(0x7fdcec0b0240 msgr2=0x7fdcec0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:06.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/923915868 shutdown_connections 2023-06-09T04:39:06.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/923915868 wait complete. 2023-06-09T04:39:06.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 Processor -- start 2023-06-09T04:39:06.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- start start 2023-06-09T04:39:06.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcec070270 0x7fdcec14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcec159320 0x7fdcec14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 0x7fdcec0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec0b26e0 con 0x7fdcec15d680 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec0b2ca0 con 0x7fdcec159320 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec1566b0 con 0x7fdcec070270 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 0x7fdcec0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 0x7fdcec0cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39900/0 (socket says 172.21.15.18:39900) 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 -- 172.21.15.18:0/2884536927 learned_addr learned my addr 172.21.15.18:0/2884536927 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcea59c640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcec070270 0x7fdcec14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce9d9b640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcec159320 0x7fdcec14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 -- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcec070270 msgr2=0x7fdcec14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcec070270 0x7fdcec14dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 -- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcec159320 msgr2=0x7fdcec14cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcec159320 0x7fdcec14cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:06.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 -- 172.21.15.18:0/2884536927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc009420 con 0x7fdcec15d680 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcea59c640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcec070270 0x7fdcec14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcead9d640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 0x7fdcec0cc8e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdce400c430 tx=0x7fdce400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40052d0 con 0x7fdcec15d680 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4005430 con 0x7fdcec15d680 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcec156990 con 0x7fdcec15d680 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4003800 con 0x7fdcec15d680 2023-06-09T04:39:06.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.910+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcec156380 con 0x7fdcec15d680 2023-06-09T04:39:06.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.914+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcec0ce690 con 0x7fdcec15d680 2023-06-09T04:39:06.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.914+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdce4003960 con 0x7fdcec15d680 2023-06-09T04:39:06.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.914+0000 7fdce2ffd640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdccc066280 0x7fdccc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:06.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.914+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdce4083440 con 0x7fdcec15d680 2023-06-09T04:39:06.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.914+0000 7fdcea59c640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdccc066280 0x7fdccc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:06.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.914+0000 7fdcea59c640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdccc066280 0x7fdccc068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0ad000 tx=0x7fdcdc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:06.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:06.918+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdce4050670 con 0x7fdcec15d680 2023-06-09T04:39:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.070+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcec0b2de0 con 0x7fdcec15d680 2023-06-09T04:39:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.070+0000 7fdce2ffd640 1 -- 172.21.15.18:0/2884536927 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fdce4053c90 con 0x7fdcec15d680 2023-06-09T04:39:07.074 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:07.074 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:07.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdccc066280 msgr2=0x7fdccc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdccc066280 0x7fdccc068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0ad000 tx=0x7fdcdc0a6000 comp rx=0 tx=0).stop 2023-06-09T04:39:07.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 msgr2=0x7fdcec0cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 0x7fdcec0cc8e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdce400c430 tx=0x7fdce400c8f0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 shutdown_connections 2023-06-09T04:39:07.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcec15d680 0x7fdcec0cc8e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcec159320 0x7fdcec14cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdccc066280 0x7fdccc068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 --2- 172.21.15.18:0/2884536927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdcec070270 0x7fdcec14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 >> 172.21.15.18:0/2884536927 conn(0x7fdcec0b0240 msgr2=0x7fdcec06bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 shutdown_connections 2023-06-09T04:39:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.074+0000 7fdcf0ec6640 1 -- 172.21.15.18:0/2884536927 wait complete. 2023-06-09T04:39:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:07.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:07.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 Processor -- start 2023-06-09T04:39:07.204 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 -- start start 2023-06-09T04:39:07.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5ec155b80 0x7fd5ec15c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5ec155f50 0x7fd5ec0d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ec0cdd60 con 0x7fd5ec0cd8e0 2023-06-09T04:39:07.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec0ce040 con 0x7fd5ec155b80 2023-06-09T04:39:07.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5f1745640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec06ac50 con 0x7fd5ec155f50 2023-06-09T04:39:07.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5ec155b80 0x7fd5ec15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5ec155b80 0x7fd5ec15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39914/0 (socket says 172.21.15.18:39914) 2023-06-09T04:39:07.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 -- 172.21.15.18:0/735090948 learned_addr learned my addr 172.21.15.18:0/735090948 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:07.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5ea7fc640 1 --1- 172.21.15.18:0/735090948 >> v1:172.21.15.18:6789/0 conn(0x7fd5ec0cd8e0 0x7fd5ec0cfac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52428/0 (socket says 172.21.15.18:52428) 2023-06-09T04:39:07.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eb7fe640 1 --2- 172.21.15.18:0/735090948 >> v2:172.21.15.81:3300/0 conn(0x7fd5ec155f50 0x7fd5ec0d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 -- 172.21.15.18:0/735090948 >> v2:172.21.15.81:3300/0 conn(0x7fd5ec155f50 msgr2=0x7fd5ec0d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 --2- 172.21.15.18:0/735090948 >> v2:172.21.15.81:3300/0 conn(0x7fd5ec155f50 0x7fd5ec0d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 -- 172.21.15.18:0/735090948 >> v1:172.21.15.18:6789/0 conn(0x7fd5ec0cd8e0 legacy=0x7fd5ec0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 -- 172.21.15.18:0/735090948 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec06af30 con 0x7fd5ec155b80 2023-06-09T04:39:07.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.202+0000 7fd5eaffd640 1 --2- 172.21.15.18:0/735090948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec155b80 0x7fd5ec15c630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0cebf0 tx=0x7fd5dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fce30db94b8c4b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5e9ffb640 1 -- 172.21.15.18:0/735090948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0aa650 con 0x7fd5ec155b80 2023-06-09T04:39:07.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5e9ffb640 1 -- 172.21.15.18:0/735090948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc0aa7b0 con 0x7fd5ec155b80 2023-06-09T04:39:07.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5e9ffb640 1 -- 172.21.15.18:0/735090948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0aab40 con 0x7fd5ec155b80 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/735090948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec155b80 msgr2=0x7fd5ec15c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 --2- 172.21.15.18:0/735090948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec155b80 0x7fd5ec15c630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0cebf0 tx=0x7fd5dc01c4d0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/735090948 shutdown_connections 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 --2- 172.21.15.18:0/735090948 >> v2:172.21.15.81:3300/0 conn(0x7fd5ec155f50 0x7fd5ec0d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 --2- 172.21.15.18:0/735090948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec155b80 0x7fd5ec15c630 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/735090948 >> 172.21.15.18:0/735090948 conn(0x7fd5ec06ce60 msgr2=0x7fd5ec06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/735090948 shutdown_connections 2023-06-09T04:39:07.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/735090948 wait complete. 2023-06-09T04:39:07.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 Processor -- start 2023-06-09T04:39:07.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- start start 2023-06-09T04:39:07.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5ec155b80 0x7fd5ec0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5ec155f50 0x7fd5ec15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 0x7fd5ec1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec150180 con 0x7fd5ec15e780 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0b2b40 con 0x7fd5ec155f50 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec14f570 con 0x7fd5ec155b80 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 0x7fd5ec1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 0x7fd5ec1407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39928/0 (socket says 172.21.15.18:39928) 2023-06-09T04:39:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 -- 172.21.15.18:0/3974105529 learned_addr learned my addr 172.21.15.18:0/3974105529 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5ea7fc640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5ec155f50 0x7fd5ec15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eaffd640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5ec155b80 0x7fd5ec0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 -- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5ec155b80 msgr2=0x7fd5ec0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5ec155b80 0x7fd5ec0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 -- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5ec155f50 msgr2=0x7fd5ec15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5ec155f50 0x7fd5ec15e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 -- 172.21.15.18:0/3974105529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0094d0 con 0x7fd5ec15e780 2023-06-09T04:39:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5eb7fe640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 0x7fd5ec1407d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007e60 tx=0x7fd5e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4014420 con 0x7fd5ec15e780 2023-06-09T04:39:07.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e40145a0 con 0x7fd5ec15e780 2023-06-09T04:39:07.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec14f850 con 0x7fd5ec15e780 2023-06-09T04:39:07.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4014950 con 0x7fd5ec15e780 2023-06-09T04:39:07.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.206+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec14fe10 con 0x7fd5ec15e780 2023-06-09T04:39:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.210+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec073380 con 0x7fd5ec15e780 2023-06-09T04:39:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.210+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5e4014ab0 con 0x7fd5ec15e780 2023-06-09T04:39:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.210+0000 7fd5d37fe640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd5d80662b0 0x7fd5d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.210+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5e4084870 con 0x7fd5ec15e780 2023-06-09T04:39:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.210+0000 7fd5eaffd640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd5d80662b0 0x7fd5d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.210+0000 7fd5eaffd640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd5d80662b0 0x7fd5d8068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0ae000 tx=0x7fd5dc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.214+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5e4055520 con 0x7fd5ec15e780 2023-06-09T04:39:07.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.366+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5ec06ecb0 con 0x7fd5ec15e780 2023-06-09T04:39:07.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.366+0000 7fd5d37fe640 1 -- 172.21.15.18:0/3974105529 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5e40550b0 con 0x7fd5ec15e780 2023-06-09T04:39:07.370 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:07.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd5d80662b0 msgr2=0x7fd5d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd5d80662b0 0x7fd5d8068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0ae000 tx=0x7fd5dc0a7000 comp rx=0 tx=0).stop 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 msgr2=0x7fd5ec1407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 0x7fd5ec1407d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007e60 tx=0x7fd5e400e4b0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 shutdown_connections 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5ec15e780 0x7fd5ec1407d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5ec155f50 0x7fd5ec15e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd5d80662b0 0x7fd5d8068760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 --2- 172.21.15.18:0/3974105529 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5ec155b80 0x7fd5ec0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 >> 172.21.15.18:0/3974105529 conn(0x7fd5ec06ce60 msgr2=0x7fd5ec0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 shutdown_connections 2023-06-09T04:39:07.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.370+0000 7fd5f1745640 1 -- 172.21.15.18:0/3974105529 wait complete. 2023-06-09T04:39:07.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:07.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb5b7ab640 1 Processor -- start 2023-06-09T04:39:07.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb5b7ab640 1 -- start start 2023-06-09T04:39:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb5b7ab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 0x7fdb540b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb5b7ab640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb54159980 con 0x7fdb540ccb70 2023-06-09T04:39:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb5b7ab640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540cabb0 con 0x7fdb541595b0 2023-06-09T04:39:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb5b7ab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540cbfc0 con 0x7fdb540cf890 2023-06-09T04:39:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb59d48640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdb540ccb70 0x7fdb5415d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52442/0 (socket says 172.21.15.18:52442) 2023-06-09T04:39:07.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb59d48640 1 -- 172.21.15.18:0/456996624 learned_addr learned my addr 172.21.15.18:0/456996624 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:07.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.502+0000 7fdb58d46640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 0x7fdb540b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965113763 0 0) 0x7fdb54159980 con 0x7fdb540ccb70 2023-06-09T04:39:07.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb44003530 con 0x7fdb540ccb70 2023-06-09T04:39:07.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645842324 0 0) 0x7fdb44003530 con 0x7fdb540ccb70 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 msgr2=0x7fdb540b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 0x7fdb540b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 >> v1:172.21.15.81:6789/0 conn(0x7fdb541595b0 legacy=0x7fdb540cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540ce9f0 con 0x7fdb540ccb70 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fdb4c001680 con 0x7fdb540ccb70 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 >> v1:172.21.15.18:6789/0 conn(0x7fdb540ccb70 legacy=0x7fdb5415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 0x7fdb440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb44003f30 0x7fdb440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb44004d10 0x7fdb44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540cbfc0 con 0x7fdb44004d10 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400ba70 con 0x7fdb44003f30 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400bc30 con 0x7fdb540cf890 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb44004d10 0x7fdb44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59547640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 0x7fdb440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb58d46640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb44003f30 0x7fdb440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 -- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 msgr2=0x7fdb440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb540cf890 0x7fdb440039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 -- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb44003f30 msgr2=0x7fdb440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb44003f30 0x7fdb440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 -- 172.21.15.18:0/456996624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44003530 con 0x7fdb44004d10 2023-06-09T04:39:07.512 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb58d46640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb44003f30 0x7fdb440047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:07.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb44004d10 0x7fdb44005180 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00c210 tx=0x7fdb4c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6023564ddf6245c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0a5b20 con 0x7fdb44004d10 2023-06-09T04:39:07.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0a5ca0 con 0x7fdb44004d10 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb53fff640 1 -- 172.21.15.18:0/456996624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c005b20 con 0x7fdb44004d10 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/456996624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb44004d10 msgr2=0x7fdb44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/456996624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb44004d10 0x7fdb44005180 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00c210 tx=0x7fdb4c01cc20 comp rx=0 tx=0).stop 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb59d48640 1 -- 172.21.15.18:0/456996624 reap_dead start 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/456996624 shutdown_connections 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/456996624 >> 172.21.15.18:0/456996624 conn(0x7fdb5406ce60 msgr2=0x7fdb5406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/456996624 shutdown_connections 2023-06-09T04:39:07.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.506+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/456996624 wait complete. 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 Processor -- start 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- start start 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5415c2f0 0x7fdb540c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 0x7fdb540b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb540b4e40 0x7fdb540af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540b52e0 con 0x7fdb540b1e40 2023-06-09T04:39:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5406b860 con 0x7fdb540b4e40 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5406ac50 con 0x7fdb5415c2f0 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 0x7fdb540b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 0x7fdb540b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39948/0 (socket says 172.21.15.18:39948) 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 -- 172.21.15.18:0/3358572374 learned_addr learned my addr 172.21.15.18:0/3358572374 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb59547640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5415c2f0 0x7fdb540c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb59d48640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb540b4e40 0x7fdb540af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 -- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5415c2f0 msgr2=0x7fdb540c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5415c2f0 0x7fdb540c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 -- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb540b4e40 msgr2=0x7fdb540af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb540b4e40 0x7fdb540af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 -- 172.21.15.18:0/3358572374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5406af30 con 0x7fdb540b1e40 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb58d46640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 0x7fdb540b4900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdb480101c0 tx=0x7fdb48010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800e050 con 0x7fdb540b1e40 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800f040 con 0x7fdb540b1e40 2023-06-09T04:39:07.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5406b210 con 0x7fdb540b1e40 2023-06-09T04:39:07.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48003bc0 con 0x7fdb540b1e40 2023-06-09T04:39:07.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5415c6c0 con 0x7fdb540b1e40 2023-06-09T04:39:07.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5406b9a0 con 0x7fdb540b1e40 2023-06-09T04:39:07.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.510+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb48003d20 con 0x7fdb540b1e40 2023-06-09T04:39:07.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.514+0000 7fdb51ffb640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb380662b0 0x7fdb38068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.514+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb48084e30 con 0x7fdb540b1e40 2023-06-09T04:39:07.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.514+0000 7fdb59547640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb380662b0 0x7fdb38068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.514+0000 7fdb59547640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb380662b0 0x7fdb38068760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb40007fd0 tx=0x7fdb40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.518+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb48055a50 con 0x7fdb540b1e40 2023-06-09T04:39:07.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.666+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb5406ecb0 con 0x7fdb540b1e40 2023-06-09T04:39:07.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.666+0000 7fdb51ffb640 1 -- 172.21.15.18:0/3358572374 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb48015650 con 0x7fdb540b1e40 2023-06-09T04:39:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:07.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb380662b0 msgr2=0x7fdb38068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb380662b0 0x7fdb38068760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb40007fd0 tx=0x7fdb40009040 comp rx=0 tx=0).stop 2023-06-09T04:39:07.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 msgr2=0x7fdb540b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 0x7fdb540b4900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdb480101c0 tx=0x7fdb48010680 comp rx=0 tx=0).stop 2023-06-09T04:39:07.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 shutdown_connections 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb540b4e40 0x7fdb540af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb540b1e40 0x7fdb540b4900 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb380662b0 0x7fdb38068760 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 --2- 172.21.15.18:0/3358572374 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5415c2f0 0x7fdb540c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 >> 172.21.15.18:0/3358572374 conn(0x7fdb5406ce60 msgr2=0x7fdb541531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 shutdown_connections 2023-06-09T04:39:07.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.670+0000 7fdb5b7ab640 1 -- 172.21.15.18:0/3358572374 wait complete. 2023-06-09T04:39:07.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.802+0000 7f0c5526f640 1 Processor -- start 2023-06-09T04:39:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.802+0000 7f0c5526f640 1 -- start start 2023-06-09T04:39:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c5526f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c5015b600 0x7f0c500b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c5526f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 0x7f0c5015f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c5526f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5015fd40 con 0x7f0c5015f280 2023-06-09T04:39:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c5526f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500cfce0 con 0x7f0c5015b600 2023-06-09T04:39:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c5526f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50160020 con 0x7f0c500b40e0 2023-06-09T04:39:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0c5015f280 0x7f0c500b39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52444/0 (socket says 172.21.15.18:52444) 2023-06-09T04:39:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4e7fc640 1 -- 172.21.15.18:0/1889978152 learned_addr learned my addr 172.21.15.18:0/1889978152 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 0x7f0c5015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4effd640 1 --2- 172.21.15.18:0/1889978152 >> v2:172.21.15.81:3300/0 conn(0x7f0c5015b600 0x7f0c500b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159103551 0 0) 0x7f0c5015fd40 con 0x7f0c5015f280 2023-06-09T04:39:07.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c003530 con 0x7f0c5015f280 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037138640 0 0) 0x7f0c3c003530 con 0x7f0c5015f280 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 msgr2=0x7f0c5015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 0x7f0c5015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 >> v2:172.21.15.81:3300/0 conn(0x7f0c5015b600 msgr2=0x7f0c500b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 --2- 172.21.15.18:0/1889978152 >> v2:172.21.15.81:3300/0 conn(0x7f0c5015b600 0x7f0c500b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500cfef0 con 0x7f0c5015f280 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f0c38001680 con 0x7f0c5015f280 2023-06-09T04:39:07.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 >> v1:172.21.15.18:6789/0 conn(0x7f0c5015f280 legacy=0x7f0c500b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c003980 0x7f0c3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 0x7f0c3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500cfce0 con 0x7f0c3c004d10 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50160020 con 0x7f0c3c003980 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00b990 con 0x7f0c500b40e0 2023-06-09T04:39:07.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4effd640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c003980 0x7f0c3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4e7fc640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 0x7f0c3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 -- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 msgr2=0x7f0c3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500b40e0 0x7f0c3c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 -- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c003980 msgr2=0x7f0c3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c003980 0x7f0c3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 -- 172.21.15.18:0/1889978152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c003530 con 0x7f0c3c004d10 2023-06-09T04:39:07.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4f7fe640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c3c005180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009ae0 tx=0x7f0c4001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc20d6242f156237 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400a5640 con 0x7f0c3c004d10 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c400a57a0 con 0x7f0c3c004d10 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.806+0000 7f0c4dffb640 1 -- 172.21.15.18:0/1889978152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400a5b50 con 0x7f0c3c004d10 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- 172.21.15.18:0/1889978152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 msgr2=0x7f0c3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 --2- 172.21.15.18:0/1889978152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c3c005180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009ae0 tx=0x7f0c4001ca50 comp rx=0 tx=0).stop 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4f7fe640 1 -- 172.21.15.18:0/1889978152 reap_dead start 2023-06-09T04:39:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- 172.21.15.18:0/1889978152 shutdown_connections 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- 172.21.15.18:0/1889978152 >> 172.21.15.18:0/1889978152 conn(0x7f0c500d2120 msgr2=0x7f0c500d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- 172.21.15.18:0/1889978152 shutdown_connections 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- 172.21.15.18:0/1889978152 wait complete. 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 Processor -- start 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- start start 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c5014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500c8a20 0x7f0c501f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c501f0c70 0x7f0c500cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5014c930 con 0x7f0c3c004d10 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500cb0e0 con 0x7f0c501f0c70 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c5526f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500c59f0 con 0x7f0c500c8a20 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c5014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c5014c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39972/0 (socket says 172.21.15.18:39972) 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 -- 172.21.15.18:0/4187381697 learned_addr learned my addr 172.21.15.18:0/4187381697 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4e7fc640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500c8a20 0x7f0c501f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4f7fe640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c501f0c70 0x7f0c500cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 -- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500c8a20 msgr2=0x7f0c501f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500c8a20 0x7f0c501f0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 -- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c501f0c70 msgr2=0x7f0c500cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c501f0c70 0x7f0c500cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 -- 172.21.15.18:0/4187381697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500c5cd0 con 0x7f0c3c004d10 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c4effd640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c5014c3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009fb0 tx=0x7f0c480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800e030 con 0x7f0c3c004d10 2023-06-09T04:39:07.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48016470 con 0x7f0c3c004d10 2023-06-09T04:39:07.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.810+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48016800 con 0x7f0c3c004d10 2023-06-09T04:39:07.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c500caa90 con 0x7f0c3c004d10 2023-06-09T04:39:07.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c500c5fb0 con 0x7f0c3c004d10 2023-06-09T04:39:07.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5006a7d0 con 0x7f0c3c004d10 2023-06-09T04:39:07.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c48016960 con 0x7f0c3c004d10 2023-06-09T04:39:07.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c477fe640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c300662b0 0x7f0c30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:07.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0c4800f070 con 0x7f0c3c004d10 2023-06-09T04:39:07.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c4e7fc640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c300662b0 0x7f0c30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:07.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.814+0000 7f0c4e7fc640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c300662b0 0x7f0c30068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c50157dd0 tx=0x7f0c38007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:07.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.818+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c48052090 con 0x7f0c3c004d10 2023-06-09T04:39:07.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.962+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c50159900 con 0x7f0c3c004d10 2023-06-09T04:39:07.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c477fe640 1 -- 172.21.15.18:0/4187381697 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c480556b0 con 0x7f0c3c004d10 2023-06-09T04:39:07.968 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c300662b0 msgr2=0x7f0c30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c300662b0 0x7f0c30068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c50157dd0 tx=0x7f0c38007040 comp rx=0 tx=0).stop 2023-06-09T04:39:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 msgr2=0x7f0c5014c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c5014c3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009fb0 tx=0x7f0c480115a0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 shutdown_connections 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c501f0c70 0x7f0c500cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c300662b0 0x7f0c30068760 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c500c8a20 0x7f0c501f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 --2- 172.21.15.18:0/4187381697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3c004d10 0x7f0c5014c3f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 >> 172.21.15.18:0/4187381697 conn(0x7f0c500d2120 msgr2=0x7f0c50158490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 shutdown_connections 2023-06-09T04:39:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:07.966+0000 7f0c5526f640 1 -- 172.21.15.18:0/4187381697 wait complete. 2023-06-09T04:39:07.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:08.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 Processor -- start 2023-06-09T04:39:08.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 -- start start 2023-06-09T04:39:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb53c0acdf0 0x7fb53c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c15de50 con 0x7fb53c159590 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c15d2d0 con 0x7fb53c0acdf0 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb5418b4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c15d5b0 con 0x7fb53c1591c0 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb53b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb53c0acdf0 0x7fb53c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb53b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb53c0acdf0 0x7fb53c0cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39978/0 (socket says 172.21.15.18:39978) 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.098+0000 7fb53b7fe640 1 -- 172.21.15.18:0/2788274193 learned_addr learned my addr 172.21.15.18:0/2788274193 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53affd640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53b7fe640 1 -- 172.21.15.18:0/2788274193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 msgr2=0x7fb53c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53b7fe640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53b7fe640 1 -- 172.21.15.18:0/2788274193 >> v1:172.21.15.81:6789/0 conn(0x7fb53c159590 legacy=0x7fb53c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53b7fe640 1 -- 172.21.15.18:0/2788274193 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c15d890 con 0x7fb53c0acdf0 2023-06-09T04:39:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53affd640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb53b7fe640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c0acdf0 0x7fb53c0cbb70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb534009e50 tx=0x7fb53401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648d519be19dd8d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb539ffb640 1 -- 172.21.15.18:0/2788274193 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340a5780 con 0x7fb53c0acdf0 2023-06-09T04:39:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb539ffb640 1 -- 172.21.15.18:0/2788274193 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5340a58e0 con 0x7fb53c0acdf0 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb539ffb640 1 -- 172.21.15.18:0/2788274193 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340a5c70 con 0x7fb53c0acdf0 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 -- 172.21.15.18:0/2788274193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c0acdf0 msgr2=0x7fb53c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c0acdf0 0x7fb53c0cbb70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb534009e50 tx=0x7fb53401c9a0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 -- 172.21.15.18:0/2788274193 shutdown_connections 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c0acdf0 0x7fb53c0cbb70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 --2- 172.21.15.18:0/2788274193 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 -- 172.21.15.18:0/2788274193 >> 172.21.15.18:0/2788274193 conn(0x7fb53c0afa90 msgr2=0x7fb53c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 -- 172.21.15.18:0/2788274193 shutdown_connections 2023-06-09T04:39:08.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.102+0000 7fb5418b4640 1 -- 172.21.15.18:0/2788274193 wait complete. 2023-06-09T04:39:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 Processor -- start 2023-06-09T04:39:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- start start 2023-06-09T04:39:08.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0acdf0 0x7fb53c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 0x7fb53c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0b2d20 con 0x7fb53c159590 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c151470 con 0x7fb53c0acdf0 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c15ee40 con 0x7fb53c1591c0 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 0x7fb53c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 0x7fb53c151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39982/0 (socket says 172.21.15.18:39982) 2023-06-09T04:39:08.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 -- 172.21.15.18:0/1509778277 learned_addr learned my addr 172.21.15.18:0/1509778277 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53affd640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0acdf0 0x7fb53c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53a7fc640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 -- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 msgr2=0x7fb53c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c15e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 -- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0acdf0 msgr2=0x7fb53c150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0acdf0 0x7fb53c150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 -- 172.21.15.18:0/1509778277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb534009b30 con 0x7fb53c159590 2023-06-09T04:39:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53b7fe640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 0x7fb53c151670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb5340af040 tx=0x7fb534019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b8670 con 0x7fb53c159590 2023-06-09T04:39:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5340b87f0 con 0x7fb53c159590 2023-06-09T04:39:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c0b2f90 con 0x7fb53c159590 2023-06-09T04:39:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340b8ba0 con 0x7fb53c159590 2023-06-09T04:39:08.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c15ea80 con 0x7fb53c159590 2023-06-09T04:39:08.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c073380 con 0x7fb53c159590 2023-06-09T04:39:08.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5340b8d00 con 0x7fb53c159590 2023-06-09T04:39:08.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb523fff640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb528066280 0x7fb528068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb53411f750 con 0x7fb53c159590 2023-06-09T04:39:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.106+0000 7fb53affd640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb528066280 0x7fb528068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.110+0000 7fb53affd640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb528066280 0x7fb528068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb53c163750 tx=0x7fb52c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.110+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5340ec960 con 0x7fb53c159590 2023-06-09T04:39:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.258+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb53c073380 con 0x7fb53c159590 2023-06-09T04:39:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb523fff640 1 -- 172.21.15.18:0/1509778277 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5340eff80 con 0x7fb53c159590 2023-06-09T04:39:08.264 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb528066280 msgr2=0x7fb528068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb528066280 0x7fb528068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb53c163750 tx=0x7fb52c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 msgr2=0x7fb53c151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 0x7fb53c151670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb5340af040 tx=0x7fb534019740 comp rx=0 tx=0).stop 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 shutdown_connections 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb53c159590 0x7fb53c151670 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb528066280 0x7fb528068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb53c1591c0 0x7fb53c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 --2- 172.21.15.18:0/1509778277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb53c0acdf0 0x7fb53c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 >> 172.21.15.18:0/1509778277 conn(0x7fb53c0afa90 msgr2=0x7fb53c0ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 shutdown_connections 2023-06-09T04:39:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.262+0000 7fb5418b4640 1 -- 172.21.15.18:0/1509778277 wait complete. 2023-06-09T04:39:08.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 Processor -- start 2023-06-09T04:39:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 -- start start 2023-06-09T04:39:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe63015b7e0 0x7fe63015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6300cce90 0x7fe6300cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63015bbb0 con 0x7fe63015f800 2023-06-09T04:39:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300ca3c0 con 0x7fe6300cce90 2023-06-09T04:39:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe635c50640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63015fd80 con 0x7fe63015b7e0 2023-06-09T04:39:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6300cce90 0x7fe6300cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6300cce90 0x7fe6300cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39986/0 (socket says 172.21.15.18:39986) 2023-06-09T04:39:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 -- 172.21.15.18:0/2548918325 learned_addr learned my addr 172.21.15.18:0/2548918325 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62f7fe640 1 --2- 172.21.15.18:0/2548918325 >> v2:172.21.15.81:3300/0 conn(0x7fe63015b7e0 0x7fe63015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 -- 172.21.15.18:0/2548918325 >> v2:172.21.15.81:3300/0 conn(0x7fe63015b7e0 msgr2=0x7fe63015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 --2- 172.21.15.18:0/2548918325 >> v2:172.21.15.81:3300/0 conn(0x7fe63015b7e0 0x7fe63015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 -- 172.21.15.18:0/2548918325 >> v1:172.21.15.81:6789/0 conn(0x7fe63015f800 legacy=0x7fe6300cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.398+0000 7fe62ffff640 1 -- 172.21.15.18:0/2548918325 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630160060 con 0x7fe6300cce90 2023-06-09T04:39:08.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe62ffff640 1 --2- 172.21.15.18:0/2548918325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6300cadd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe63006de40 tx=0x7fe62001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214d4e84af872542 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe62e7fc640 1 -- 172.21.15.18:0/2548918325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200aa5f0 con 0x7fe6300cce90 2023-06-09T04:39:08.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe62e7fc640 1 -- 172.21.15.18:0/2548918325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6200aa750 con 0x7fe6300cce90 2023-06-09T04:39:08.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe62e7fc640 1 -- 172.21.15.18:0/2548918325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200aaae0 con 0x7fe6300cce90 2023-06-09T04:39:08.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 -- 172.21.15.18:0/2548918325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 msgr2=0x7fe6300cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 --2- 172.21.15.18:0/2548918325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6300cadd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe63006de40 tx=0x7fe62001c490 comp rx=0 tx=0).stop 2023-06-09T04:39:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 -- 172.21.15.18:0/2548918325 shutdown_connections 2023-06-09T04:39:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 --2- 172.21.15.18:0/2548918325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6300cadd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 --2- 172.21.15.18:0/2548918325 >> v2:172.21.15.81:3300/0 conn(0x7fe63015b7e0 0x7fe63015f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 -- 172.21.15.18:0/2548918325 >> 172.21.15.18:0/2548918325 conn(0x7fe63006ce60 msgr2=0x7fe63006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 -- 172.21.15.18:0/2548918325 shutdown_connections 2023-06-09T04:39:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 -- 172.21.15.18:0/2548918325 wait complete. 2023-06-09T04:39:08.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 Processor -- start 2023-06-09T04:39:08.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.402+0000 7fe635c50640 1 -- start start 2023-06-09T04:39:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6301532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe63015b7e0 0x7fe6300b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63015f800 0x7fe6300b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63015cc50 con 0x7fe6300cce90 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63015cf30 con 0x7fe63015f800 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63015d210 con 0x7fe63015b7e0 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6301532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6301532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39996/0 (socket says 172.21.15.18:39996) 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 -- 172.21.15.18:0/4029473008 learned_addr learned my addr 172.21.15.18:0/4029473008 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62effd640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe63015b7e0 0x7fe6300b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62ffff640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63015f800 0x7fe6300b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 -- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe63015b7e0 msgr2=0x7fe6300b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe63015b7e0 0x7fe6300b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 -- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63015f800 msgr2=0x7fe6300b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63015f800 0x7fe6300b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 -- 172.21.15.18:0/4029473008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200094d0 con 0x7fe6300cce90 2023-06-09T04:39:08.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62ffff640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63015f800 0x7fe6300b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:08.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62f7fe640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6301532a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe628007ef0 tx=0x7fe62800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628014620 con 0x7fe6300cce90 2023-06-09T04:39:08.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe628014780 con 0x7fe6300cce90 2023-06-09T04:39:08.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628014b30 con 0x7fe6300cce90 2023-06-09T04:39:08.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63015d4f0 con 0x7fe6300cce90 2023-06-09T04:39:08.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6301537e0 con 0x7fe6300cce90 2023-06-09T04:39:08.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630073380 con 0x7fe6300cce90 2023-06-09T04:39:08.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe628014c90 con 0x7fe6300cce90 2023-06-09T04:39:08.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe617fff640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe61c0662b0 0x7fe61c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe628084a60 con 0x7fe6300cce90 2023-06-09T04:39:08.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.406+0000 7fe62effd640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe61c0662b0 0x7fe61c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.410+0000 7fe62effd640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe61c0662b0 0x7fe61c068760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6300c6990 tx=0x7fe624008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.410+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe628051b70 con 0x7fe6300cce90 2023-06-09T04:39:08.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.562+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe63006ecb0 con 0x7fe6300cce90 2023-06-09T04:39:08.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.562+0000 7fe617fff640 1 -- 172.21.15.18:0/4029473008 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe628055190 con 0x7fe6300cce90 2023-06-09T04:39:08.567 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:08.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe61c0662b0 msgr2=0x7fe61c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe61c0662b0 0x7fe61c068760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe6300c6990 tx=0x7fe624008040 comp rx=0 tx=0).stop 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 msgr2=0x7fe6301532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6301532a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe628007ef0 tx=0x7fe62800e4b0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 shutdown_connections 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63015f800 0x7fe6300b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe61c0662b0 0x7fe61c068760 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe63015b7e0 0x7fe6300b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.569 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 --2- 172.21.15.18:0/4029473008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6300cce90 0x7fe6301532a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 >> 172.21.15.18:0/4029473008 conn(0x7fe63006ce60 msgr2=0x7fe6300b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 shutdown_connections 2023-06-09T04:39:08.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.566+0000 7fe635c50640 1 -- 172.21.15.18:0/4029473008 wait complete. 2023-06-09T04:39:08.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd459b1f640 1 Processor -- start 2023-06-09T04:39:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd459b1f640 1 -- start start 2023-06-09T04:39:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd459b1f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 0x7fd4540ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd459b1f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45406a900 con 0x7fd45406c3c0 2023-06-09T04:39:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd459b1f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45415ceb0 con 0x7fd4541586e0 2023-06-09T04:39:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd459b1f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540cd0f0 con 0x7fd454158310 2023-06-09T04:39:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd453fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd45406c3c0 0x7fd45415bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52446/0 (socket says 172.21.15.18:52446) 2023-06-09T04:39:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd453fff640 1 -- 172.21.15.18:0/3898798911 learned_addr learned my addr 172.21.15.18:0/3898798911 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd4537fe640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 0x7fd4540ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189380133 0 0) 0x7fd45406a900 con 0x7fd45406c3c0 2023-06-09T04:39:08.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd440003530 con 0x7fd45406c3c0 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311994528 0 0) 0x7fd440003530 con 0x7fd45406c3c0 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 msgr2=0x7fd4540ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 0x7fd4540ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 >> v1:172.21.15.81:6789/0 conn(0x7fd4541586e0 legacy=0x7fd45406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45415cbd0 con 0x7fd45406c3c0 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fd44c001a00 con 0x7fd45406c3c0 2023-06-09T04:39:08.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 >> v1:172.21.15.18:6789/0 conn(0x7fd45406c3c0 legacy=0x7fd45415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd440003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.702+0000 7fd452ffd640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 0x7fd4400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440004d10 0x7fd440005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540cd0f0 con 0x7fd4400039b0 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44000ba40 con 0x7fd440004d10 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44000bbd0 con 0x7fd454158310 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd440003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd44affd640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 0x7fd4400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd453fff640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440004d10 0x7fd440005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 -- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 msgr2=0x7fd4400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd454158310 0x7fd4400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 -- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440004d10 msgr2=0x7fd440005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440004d10 0x7fd440005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 -- 172.21.15.18:0/3898798911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440003530 con 0x7fd4400039b0 2023-06-09T04:39:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd4537fe640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd440003dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd444009ae0 tx=0x7fd44401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8529230e8ea039 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440a6500 con 0x7fd4400039b0 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4440a6660 con 0x7fd4400039b0 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd452ffd640 1 -- 172.21.15.18:0/3898798911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440a6a10 con 0x7fd4400039b0 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd459b1f640 1 -- 172.21.15.18:0/3898798911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 msgr2=0x7fd440003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd459b1f640 1 --2- 172.21.15.18:0/3898798911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd440003dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd444009ae0 tx=0x7fd44401ca20 comp rx=0 tx=0).stop 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd453fff640 1 -- 172.21.15.18:0/3898798911 reap_dead start 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd459b1f640 1 -- 172.21.15.18:0/3898798911 shutdown_connections 2023-06-09T04:39:08.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd459b1f640 1 -- 172.21.15.18:0/3898798911 >> 172.21.15.18:0/3898798911 conn(0x7fd4540b0240 msgr2=0x7fd4540cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd459b1f640 1 -- 172.21.15.18:0/3898798911 shutdown_connections 2023-06-09T04:39:08.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.706+0000 7fd459b1f640 1 -- 172.21.15.18:0/3898798911 wait complete. 2023-06-09T04:39:08.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 Processor -- start 2023-06-09T04:39:08.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- start start 2023-06-09T04:39:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd4541664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd45414ae70 0x7fd454147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4540c93e0 0x7fd4540c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540c9d90 con 0x7fd4400039b0 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4541524b0 con 0x7fd4540c93e0 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4541476d0 con 0x7fd45414ae70 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd4541664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd4541664a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40028/0 (socket says 172.21.15.18:40028) 2023-06-09T04:39:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 -- 172.21.15.18:0/2164966597 learned_addr learned my addr 172.21.15.18:0/2164966597 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd44affd640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd45414ae70 0x7fd454147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd453fff640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4540c93e0 0x7fd4540c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 -- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd45414ae70 msgr2=0x7fd454147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd45414ae70 0x7fd454147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 -- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4540c93e0 msgr2=0x7fd4540c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4540c93e0 0x7fd4540c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 -- 172.21.15.18:0/2164966597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454150aa0 con 0x7fd4400039b0 2023-06-09T04:39:08.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd4537fe640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd4541664a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd44401c850 tx=0x7fd440005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400f0c0 con 0x7fd4400039b0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4440a67d0 con 0x7fd4400039b0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440a6b80 con 0x7fd4400039b0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd454150d80 con 0x7fd4400039b0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd454152a30 con 0x7fd4400039b0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.710+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45406a390 con 0x7fd4400039b0 2023-06-09T04:39:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.714+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4440a6ce0 con 0x7fd4400039b0 2023-06-09T04:39:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.714+0000 7fd450ff9640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4340662b0 0x7fd434068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.714+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd4440aa070 con 0x7fd4400039b0 2023-06-09T04:39:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.714+0000 7fd44affd640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4340662b0 0x7fd434068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.714+0000 7fd44affd640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4340662b0 0x7fd434068760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fd0 tx=0x7fd43c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.718+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4440ebcb0 con 0x7fd4400039b0 2023-06-09T04:39:08.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.878+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd45406be50 con 0x7fd4400039b0 2023-06-09T04:39:08.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.878+0000 7fd450ff9640 1 -- 172.21.15.18:0/2164966597 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd4440ef2d0 con 0x7fd4400039b0 2023-06-09T04:39:08.883 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:08.884 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4340662b0 msgr2=0x7fd434068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4340662b0 0x7fd434068760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fd0 tx=0x7fd43c009040 comp rx=0 tx=0).stop 2023-06-09T04:39:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 msgr2=0x7fd4541664a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd4541664a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd44401c850 tx=0x7fd440005800 comp rx=0 tx=0).stop 2023-06-09T04:39:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 shutdown_connections 2023-06-09T04:39:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4540c93e0 0x7fd4540c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.885 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd4340662b0 0x7fd434068760 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd45414ae70 0x7fd454147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 --2- 172.21.15.18:0/2164966597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400039b0 0x7fd4541664a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 >> 172.21.15.18:0/2164966597 conn(0x7fd4540b0240 msgr2=0x7fd45406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 shutdown_connections 2023-06-09T04:39:08.886 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:08.882+0000 7fd459b1f640 1 -- 172.21.15.18:0/2164966597 wait complete. 2023-06-09T04:39:08.900 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:39:08.900 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:08.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 Processor -- start 2023-06-09T04:39:09.064 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 -- start start 2023-06-09T04:39:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700cc970 0x7f4b700cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4b700ca2a0 0x7f4b7006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7015fb70 con 0x7f4b7015b770 2023-06-09T04:39:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b700ca720 con 0x7f4b700ca2a0 2023-06-09T04:39:09.066 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b76e66640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700cdf60 con 0x7f4b700cc970 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4b700ca2a0 0x7f4b7006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4b700ca2a0 0x7f4b7006ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40032/0 (socket says 172.21.15.18:40032) 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 -- 172.21.15.18:0/1820377151 learned_addr learned my addr 172.21.15.18:0/1820377151 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b74c02640 1 --1- 172.21.15.18:0/1820377151 >> v1:172.21.15.18:6789/0 conn(0x7f4b7015b770 0x7f4b700cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52460/0 (socket says 172.21.15.18:52460) 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b6ffff640 1 --2- 172.21.15.18:0/1820377151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700cc970 0x7f4b700cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 -- 172.21.15.18:0/1820377151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700cc970 msgr2=0x7f4b700cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 --2- 172.21.15.18:0/1820377151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700cc970 0x7f4b700cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 -- 172.21.15.18:0/1820377151 >> v1:172.21.15.18:6789/0 conn(0x7f4b7015b770 legacy=0x7f4b700cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b6f7fe640 1 -- 172.21.15.18:0/1820377151 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267901215 0 0) 0x7f4b7015fb70 con 0x7f4b7015b770 2023-06-09T04:39:09.068 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.062+0000 7f4b75403640 1 -- 172.21.15.18:0/1820377151 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b701600a0 con 0x7f4b700ca2a0 2023-06-09T04:39:09.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 --2- 172.21.15.18:0/1820377151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b700ca2a0 0x7f4b7006ed40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009e50 tx=0x7f4b6801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5398dc6662f9857a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b6f7fe640 1 -- 172.21.15.18:0/1820377151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680a5730 con 0x7f4b700ca2a0 2023-06-09T04:39:09.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b6f7fe640 1 -- 172.21.15.18:0/1820377151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680a5890 con 0x7f4b700ca2a0 2023-06-09T04:39:09.069 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b6f7fe640 1 -- 172.21.15.18:0/1820377151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680a5c20 con 0x7f4b700ca2a0 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- 172.21.15.18:0/1820377151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b700ca2a0 msgr2=0x7f4b7006ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1820377151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b700ca2a0 0x7f4b7006ed40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009e50 tx=0x7f4b6801c980 comp rx=0 tx=0).stop 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- 172.21.15.18:0/1820377151 shutdown_connections 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1820377151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b700ca2a0 0x7f4b7006ed40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1820377151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700cc970 0x7f4b700cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- 172.21.15.18:0/1820377151 >> 172.21.15.18:0/1820377151 conn(0x7f4b7006f850 msgr2=0x7f4b7006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- 172.21.15.18:0/1820377151 shutdown_connections 2023-06-09T04:39:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- 172.21.15.18:0/1820377151 wait complete. 2023-06-09T04:39:09.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 Processor -- start 2023-06-09T04:39:09.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- start start 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700ca2a0 0x7f4b700c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b700cc970 0x7f4b7014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 0x7f4b700b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700c9a60 con 0x7f4b7015b770 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700b5480 con 0x7f4b700cc970 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b76e66640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700b5760 con 0x7f4b700ca2a0 2023-06-09T04:39:09.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 0x7f4b700b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 0x7f4b700b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40040/0 (socket says 172.21.15.18:40040) 2023-06-09T04:39:09.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 -- 172.21.15.18:0/1969079042 learned_addr learned my addr 172.21.15.18:0/1969079042 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b74c02640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700ca2a0 0x7f4b700c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b6ffff640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b700cc970 0x7f4b7014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 -- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700ca2a0 msgr2=0x7f4b700c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700ca2a0 0x7f4b700c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 -- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b700cc970 msgr2=0x7f4b7014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b700cc970 0x7f4b7014e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.066+0000 7f4b75403640 1 -- 172.21.15.18:0/1969079042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68009b30 con 0x7f4b7015b770 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b75403640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 0x7f4b700b2a80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4b680af040 tx=0x7f4b68019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680b8670 con 0x7f4b7015b770 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680b87d0 con 0x7f4b7015b770 2023-06-09T04:39:09.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b700c7380 con 0x7f4b7015b770 2023-06-09T04:39:09.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680b8b60 con 0x7f4b7015b770 2023-06-09T04:39:09.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b700b2fc0 con 0x7f4b7015b770 2023-06-09T04:39:09.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b700b3150 con 0x7f4b7015b770 2023-06-09T04:39:09.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b680b8cc0 con 0x7f4b7015b770 2023-06-09T04:39:09.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b6d7fa640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b5c066280 0x7f4b5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b6811f4d0 con 0x7f4b7015b770 2023-06-09T04:39:09.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b74c02640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b5c066280 0x7f4b5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.070+0000 7f4b74c02640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b5c066280 0x7f4b5c068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000f70 tx=0x7f4b60007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.074+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b700b3150 con 0x7f4b7015b770 2023-06-09T04:39:09.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.222+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b700b3150 con 0x7f4b7015b770 2023-06-09T04:39:09.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b6d7fa640 1 -- 172.21.15.18:0/1969079042 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f4b700b3150 con 0x7f4b7015b770 2023-06-09T04:39:09.229 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:09.229 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b5c066280 msgr2=0x7f4b5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b5c066280 0x7f4b5c068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000f70 tx=0x7f4b60007c10 comp rx=0 tx=0).stop 2023-06-09T04:39:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 msgr2=0x7f4b700b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 0x7f4b700b2a80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4b680af040 tx=0x7f4b68019720 comp rx=0 tx=0).stop 2023-06-09T04:39:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 shutdown_connections 2023-06-09T04:39:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b7015b770 0x7f4b700b2a80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b700cc970 0x7f4b7014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b5c066280 0x7f4b5c068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 --2- 172.21.15.18:0/1969079042 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b700ca2a0 0x7f4b700c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 >> 172.21.15.18:0/1969079042 conn(0x7f4b7006f850 msgr2=0x7f4b7015d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 shutdown_connections 2023-06-09T04:39:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.226+0000 7f4b76e66640 1 -- 172.21.15.18:0/1969079042 wait complete. 2023-06-09T04:39:09.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:09.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 Processor -- start 2023-06-09T04:39:09.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 -- start start 2023-06-09T04:39:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7d401595b0 0x7f7d400b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400ccb70 0x7f7d4015d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d40159980 con 0x7f7d400cf890 2023-06-09T04:39:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400cbfc0 con 0x7f7d401595b0 2023-06-09T04:39:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d4548b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ce710 con 0x7f7d400ccb70 2023-06-09T04:39:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7d401595b0 0x7f7d400b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7d401595b0 0x7f7d400b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40044/0 (socket says 172.21.15.18:40044) 2023-06-09T04:39:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 -- 172.21.15.18:0/3711392086 learned_addr learned my addr 172.21.15.18:0/3711392086 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3e7fc640 1 --1- 172.21.15.18:0/3711392086 >> v1:172.21.15.18:6789/0 conn(0x7f7d400cf890 0x7f7d400cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52468/0 (socket says 172.21.15.18:52468) 2023-06-09T04:39:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3f7fe640 1 --2- 172.21.15.18:0/3711392086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400ccb70 0x7f7d4015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 -- 172.21.15.18:0/3711392086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400ccb70 msgr2=0x7f7d4015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 --2- 172.21.15.18:0/3711392086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400ccb70 0x7f7d4015d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 -- 172.21.15.18:0/3711392086 >> v1:172.21.15.18:6789/0 conn(0x7f7d400cf890 legacy=0x7f7d400cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.370+0000 7f7d3effd640 1 -- 172.21.15.18:0/3711392086 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400cabb0 con 0x7f7d401595b0 2023-06-09T04:39:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3effd640 1 --2- 172.21.15.18:0/3711392086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d401595b0 0x7f7d400b2bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009e50 tx=0x7f7d3001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c39c484d86bd0f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3dffb640 1 -- 172.21.15.18:0/3711392086 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300a5520 con 0x7f7d401595b0 2023-06-09T04:39:09.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3dffb640 1 -- 172.21.15.18:0/3711392086 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300a5680 con 0x7f7d401595b0 2023-06-09T04:39:09.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3dffb640 1 -- 172.21.15.18:0/3711392086 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300a5a10 con 0x7f7d401595b0 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- 172.21.15.18:0/3711392086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d401595b0 msgr2=0x7f7d400b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 --2- 172.21.15.18:0/3711392086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d401595b0 0x7f7d400b2bc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009e50 tx=0x7f7d3001c750 comp rx=0 tx=0).stop 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- 172.21.15.18:0/3711392086 shutdown_connections 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 --2- 172.21.15.18:0/3711392086 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400ccb70 0x7f7d4015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 --2- 172.21.15.18:0/3711392086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d401595b0 0x7f7d400b2bc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- 172.21.15.18:0/3711392086 >> 172.21.15.18:0/3711392086 conn(0x7f7d4006ce60 msgr2=0x7f7d4006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- 172.21.15.18:0/3711392086 shutdown_connections 2023-06-09T04:39:09.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- 172.21.15.18:0/3711392086 wait complete. 2023-06-09T04:39:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 Processor -- start 2023-06-09T04:39:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- start start 2023-06-09T04:39:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 0x7f7d4014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400cf890 0x7f7d400c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d401595b0 0x7f7d40157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c7750 con 0x7f7d400ccb70 2023-06-09T04:39:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c7a30 con 0x7f7d401595b0 2023-06-09T04:39:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d4548b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c7d10 con 0x7f7d400cf890 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 0x7f7d4014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 0x7f7d4014e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40052/0 (socket says 172.21.15.18:40052) 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.374+0000 7f7d3effd640 1 -- 172.21.15.18:0/1813423912 learned_addr learned my addr 172.21.15.18:0/1813423912 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3e7fc640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400cf890 0x7f7d400c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3f7fe640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d401595b0 0x7f7d40157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3effd640 1 -- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400cf890 msgr2=0x7f7d400c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3effd640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400cf890 0x7f7d400c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3effd640 1 -- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d401595b0 msgr2=0x7f7d40157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3effd640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d401595b0 0x7f7d40157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3effd640 1 -- 172.21.15.18:0/1813423912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30009b30 con 0x7f7d400ccb70 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3effd640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 0x7f7d4014e4e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7d3001a380 tx=0x7f7d300194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300a5520 con 0x7f7d400ccb70 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300b8670 con 0x7f7d400ccb70 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400ce9f0 con 0x7f7d400ccb70 2023-06-09T04:39:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b8a20 con 0x7f7d400ccb70 2023-06-09T04:39:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4006af30 con 0x7f7d400ccb70 2023-06-09T04:39:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d40073380 con 0x7f7d400ccb70 2023-06-09T04:39:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d300b8b80 con 0x7f7d400ccb70 2023-06-09T04:39:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d377fe640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7d20066280 0x7f7d20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7d3011f1d0 con 0x7f7d400ccb70 2023-06-09T04:39:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3e7fc640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7d20066280 0x7f7d20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.378+0000 7f7d3e7fc640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7d20066280 0x7f7d20068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d40158320 tx=0x7f7d28007c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.382+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d300ec3f0 con 0x7f7d400ccb70 2023-06-09T04:39:09.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.530+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d4006ecb0 con 0x7f7d400ccb70 2023-06-09T04:39:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.530+0000 7f7d377fe640 1 -- 172.21.15.18:0/1813423912 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d30009510 con 0x7f7d400ccb70 2023-06-09T04:39:09.534 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7d20066280 msgr2=0x7f7d20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7d20066280 0x7f7d20068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d40158320 tx=0x7f7d28007c30 comp rx=0 tx=0).stop 2023-06-09T04:39:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 msgr2=0x7f7d4014e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 0x7f7d4014e4e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7d3001a380 tx=0x7f7d300194f0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 shutdown_connections 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d401595b0 0x7f7d40157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7d20066280 0x7f7d20068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d400cf890 0x7f7d400c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 --2- 172.21.15.18:0/1813423912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d400ccb70 0x7f7d4014e4e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 >> 172.21.15.18:0/1813423912 conn(0x7f7d4006ce60 msgr2=0x7f7d4014ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 shutdown_connections 2023-06-09T04:39:09.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.534+0000 7f7d4548b640 1 -- 172.21.15.18:0/1813423912 wait complete. 2023-06-09T04:39:09.551 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:09.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4aaa67640 1 Processor -- start 2023-06-09T04:39:09.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4aaa67640 1 -- start start 2023-06-09T04:39:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4aaa67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4a41595d0 0x7ff4a406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4aaa67640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a415c620 con 0x7ff4a4155d20 2023-06-09T04:39:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4aaa67640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a40cc450 con 0x7ff4a406c310 2023-06-09T04:39:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4aaa67640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a415ce40 con 0x7ff4a41595d0 2023-06-09T04:39:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4a41595d0 0x7ff4a406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4a41595d0 0x7ff4a406bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40056/0 (socket says 172.21.15.18:40056) 2023-06-09T04:39:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a3fff640 1 -- 172.21.15.18:0/2400313034 learned_addr learned my addr 172.21.15.18:0/2400313034 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a3fff640 1 -- 172.21.15.18:0/2400313034 >> v1:172.21.15.81:6789/0 conn(0x7ff4a406c310 legacy=0x7ff4a40c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a3fff640 1 -- 172.21.15.18:0/2400313034 >> v1:172.21.15.18:6789/0 conn(0x7ff4a4155d20 legacy=0x7ff4a415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a37fe640 1 -- 172.21.15.18:0/2400313034 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979136418 0 0) 0x7ff4a415c620 con 0x7ff4a4155d20 2023-06-09T04:39:09.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.674+0000 7ff4a3fff640 1 -- 172.21.15.18:0/2400313034 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a415c880 con 0x7ff4a41595d0 2023-06-09T04:39:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a3fff640 1 --2- 172.21.15.18:0/2400313034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a41595d0 0x7ff4a406bdd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff49800bb10 tx=0x7ff49801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8d2bbe1e36b0f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a37fe640 1 -- 172.21.15.18:0/2400313034 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980a7cb0 con 0x7ff4a41595d0 2023-06-09T04:39:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a37fe640 1 -- 172.21.15.18:0/2400313034 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4980a7e10 con 0x7ff4a41595d0 2023-06-09T04:39:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a37fe640 1 -- 172.21.15.18:0/2400313034 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980af660 con 0x7ff4a41595d0 2023-06-09T04:39:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- 172.21.15.18:0/2400313034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a41595d0 msgr2=0x7ff4a406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/2400313034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a41595d0 0x7ff4a406bdd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff49800bb10 tx=0x7ff49801ebe0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- 172.21.15.18:0/2400313034 shutdown_connections 2023-06-09T04:39:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/2400313034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a41595d0 0x7ff4a406bdd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- 172.21.15.18:0/2400313034 >> 172.21.15.18:0/2400313034 conn(0x7ff4a40afa90 msgr2=0x7ff4a40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- 172.21.15.18:0/2400313034 shutdown_connections 2023-06-09T04:39:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- 172.21.15.18:0/2400313034 wait complete. 2023-06-09T04:39:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 Processor -- start 2023-06-09T04:39:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- start start 2023-06-09T04:39:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff4a406c310 0x7ff4a41f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 0x7ff4a40aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a41595d0 0x7ff4a40aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4153d30 con 0x7ff4a4155d20 2023-06-09T04:39:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41530b0 con 0x7ff4a41595d0 2023-06-09T04:39:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4aaa67640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4153390 con 0x7ff4a406c310 2023-06-09T04:39:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 0x7ff4a40aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 0x7ff4a40aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40070/0 (socket says 172.21.15.18:40070) 2023-06-09T04:39:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a3fff640 1 -- 172.21.15.18:0/242341815 learned_addr learned my addr 172.21.15.18:0/242341815 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a8803640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff4a406c310 0x7ff4a41f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a3fff640 1 -- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff4a406c310 msgr2=0x7ff4a41f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.678+0000 7ff4a3fff640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff4a406c310 0x7ff4a41f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a3fff640 1 -- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a41595d0 msgr2=0x7ff4a40aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a9004640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a41595d0 0x7ff4a40aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a3fff640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a41595d0 0x7ff4a40aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a3fff640 1 -- 172.21.15.18:0/242341815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49800b770 con 0x7ff4a4155d20 2023-06-09T04:39:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a8803640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff4a406c310 0x7ff4a41f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a3fff640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 0x7ff4a40aea90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff49800b2c0 tx=0x7ff49801d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980afe00 con 0x7ff4a4155d20 2023-06-09T04:39:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498004020 con 0x7ff4a4155d20 2023-06-09T04:39:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4153670 con 0x7ff4a4155d20 2023-06-09T04:39:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980043b0 con 0x7ff4a4155d20 2023-06-09T04:39:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a41f3a00 con 0x7ff4a4155d20 2023-06-09T04:39:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a4153e70 con 0x7ff4a4155d20 2023-06-09T04:39:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4980b6040 con 0x7ff4a4155d20 2023-06-09T04:39:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a17fa640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff490066280 0x7ff490068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff49811ee60 con 0x7ff4a4155d20 2023-06-09T04:39:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a8803640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff490066280 0x7ff490068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.682+0000 7ff4a8803640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff490066280 0x7ff490068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff494000fe0 tx=0x7ff494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.690 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.686+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4a4153e70 con 0x7ff4a4155d20 2023-06-09T04:39:09.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.834+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff4a4153e70 con 0x7ff4a4155d20 2023-06-09T04:39:09.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.834+0000 7ff4a17fa640 1 -- 172.21.15.18:0/242341815 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff4a4153e70 con 0x7ff4a4155d20 2023-06-09T04:39:09.839 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:09.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff490066280 msgr2=0x7ff490068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff490066280 0x7ff490068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff494000fe0 tx=0x7ff494009040 comp rx=0 tx=0).stop 2023-06-09T04:39:09.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 msgr2=0x7ff4a40aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 0x7ff4a40aea90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff49800b2c0 tx=0x7ff49801d420 comp rx=0 tx=0).stop 2023-06-09T04:39:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 shutdown_connections 2023-06-09T04:39:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a41595d0 0x7ff4a40aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a4155d20 0x7ff4a40aea90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff490066280 0x7ff490068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 --2- 172.21.15.18:0/242341815 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff4a406c310 0x7ff4a41f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 >> 172.21.15.18:0/242341815 conn(0x7ff4a40afa90 msgr2=0x7ff4a4155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 shutdown_connections 2023-06-09T04:39:09.843 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.838+0000 7ff4aaa67640 1 -- 172.21.15.18:0/242341815 wait complete. 2023-06-09T04:39:09.856 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:09.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab997f640 1 Processor -- start 2023-06-09T04:39:09.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab997f640 1 -- start start 2023-06-09T04:39:09.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab997f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7ab40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab997f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab415bbb0 con 0x7f7ab415b7e0 2023-06-09T04:39:09.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab997f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40cd110 con 0x7f7ab40cadd0 2023-06-09T04:39:09.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab997f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ca3c0 con 0x7f7ab40cc780 2023-06-09T04:39:09.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab2ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7ab415b7e0 0x7f7ab415f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52498/0 (socket says 172.21.15.18:52498) 2023-06-09T04:39:09.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab2ffd640 1 -- 172.21.15.18:0/2093478434 learned_addr learned my addr 172.21.15.18:0/2093478434 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:09.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7ab40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426583158 0 0) 0x7f7ab415bbb0 con 0x7f7ab415b7e0 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa0003530 con 0x7f7ab415b7e0 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133250577 0 0) 0x7f7aa0003530 con 0x7f7ab415b7e0 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 msgr2=0x7f7ab40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7ab40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 >> v1:172.21.15.81:6789/0 conn(0x7f7ab40cadd0 legacy=0x7f7ab40cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab415fd80 con 0x7f7ab415b7e0 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f7aa4001a00 con 0x7f7ab415b7e0 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 >> v1:172.21.15.18:6789/0 conn(0x7f7ab415b7e0 legacy=0x7f7ab415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7aa00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7aa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ca3c0 con 0x7f7aa0004d10 2023-06-09T04:39:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa000ba70 con 0x7f7aa00039b0 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa000bc30 con 0x7f7ab40cc780 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab37fe640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7aa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab2ffd640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7aa00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab37fe640 1 -- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 msgr2=0x7f7aa00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab37fe640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7aa00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab37fe640 1 -- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aa00039b0 msgr2=0x7f7aa0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab37fe640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aa00039b0 0x7f7aa0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab37fe640 1 -- 172.21.15.18:0/2093478434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0003530 con 0x7f7aa0004d10 2023-06-09T04:39:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.966+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40cc780 0x7f7aa00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab37fe640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7aa0005180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0015b0 tx=0x7f7aac01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc1d30eb50cab3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0052d0 con 0x7f7aa0004d10 2023-06-09T04:39:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0a7050 con 0x7f7aa0004d10 2023-06-09T04:39:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab1ffb640 1 -- 172.21.15.18:0/2093478434 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac003600 con 0x7f7aa0004d10 2023-06-09T04:39:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 -- 172.21.15.18:0/2093478434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 msgr2=0x7f7aa0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.977 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 --2- 172.21.15.18:0/2093478434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7aa0005180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0015b0 tx=0x7f7aac01c220 comp rx=0 tx=0).stop 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab37fe640 1 -- 172.21.15.18:0/2093478434 reap_dead start 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 -- 172.21.15.18:0/2093478434 shutdown_connections 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 -- 172.21.15.18:0/2093478434 >> 172.21.15.18:0/2093478434 conn(0x7f7ab406ce60 msgr2=0x7f7ab406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 -- 172.21.15.18:0/2093478434 shutdown_connections 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 -- 172.21.15.18:0/2093478434 wait complete. 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 Processor -- start 2023-06-09T04:39:09.978 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.970+0000 7f7ab997f640 1 -- start start 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7ab40c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40c96d0 0x7f7ab40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab40c9b40 0x7f7ab40b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40c92b0 con 0x7f7aa0004d10 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40c36e0 con 0x7f7ab40c9b40 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40c8630 con 0x7f7ab40c96d0 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7ab40c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7ab40c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40078/0 (socket says 172.21.15.18:40078) 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 -- 172.21.15.18:0/3580995151 learned_addr learned my addr 172.21.15.18:0/3580995151 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab37fe640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab40c9b40 0x7f7ab40b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40c96d0 0x7f7ab40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 -- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40c96d0 msgr2=0x7f7ab40b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40c96d0 0x7f7ab40b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 -- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab40c9b40 msgr2=0x7f7ab40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab40c9b40 0x7f7ab40b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 -- 172.21.15.18:0/3580995151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40c8910 con 0x7f7aa0004d10 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40c96d0 0x7f7ab40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab2ffd640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7ab40c31a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4007a80 tx=0x7f7aa400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400eeb0 con 0x7f7aa0004d10 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4013420 con 0x7f7aa0004d10 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40137f0 con 0x7f7aa0004d10 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40c8bf0 con 0x7f7aa0004d10 2023-06-09T04:39:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40c5920 con 0x7f7aa0004d10 2023-06-09T04:39:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4158ba0 con 0x7f7aa0004d10 2023-06-09T04:39:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7aa4013950 con 0x7f7aa0004d10 2023-06-09T04:39:09.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7aabfff640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7a940662b0 0x7f7a94068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:09.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7aa40847a0 con 0x7f7aa0004d10 2023-06-09T04:39:09.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.974+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7a940662b0 0x7f7a94068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:09.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.978+0000 7f7ab27fc640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7a940662b0 0x7f7a94068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40c63e0 tx=0x7f7a9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:09.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:09.978+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7aa4051930 con 0x7f7aa0004d10 2023-06-09T04:39:10.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.130+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ab406ecb0 con 0x7f7aa0004d10 2023-06-09T04:39:10.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7aabfff640 1 -- 172.21.15.18:0/3580995151 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7aa4054f50 con 0x7f7aa0004d10 2023-06-09T04:39:10.136 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:10.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7a940662b0 msgr2=0x7f7a94068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7a940662b0 0x7f7a94068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40c63e0 tx=0x7f7a9c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:10.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 msgr2=0x7f7ab40c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.138 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7ab40c31a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4007a80 tx=0x7f7aa400e530 comp rx=0 tx=0).stop 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 shutdown_connections 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab40c9b40 0x7f7ab40b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7a940662b0 0x7f7a94068760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7ab40c96d0 0x7f7ab40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 --2- 172.21.15.18:0/3580995151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa0004d10 0x7f7ab40c31a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 >> 172.21.15.18:0/3580995151 conn(0x7f7ab406ce60 msgr2=0x7f7ab406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 shutdown_connections 2023-06-09T04:39:10.139 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.134+0000 7f7ab997f640 1 -- 172.21.15.18:0/3580995151 wait complete. 2023-06-09T04:39:10.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 Processor -- start 2023-06-09T04:39:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 -- start start 2023-06-09T04:39:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26280b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26280ccb70 0x7f262815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2628159980 con 0x7f26280cf890 2023-06-09T04:39:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280cbfc0 con 0x7f26280ccb70 2023-06-09T04:39:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262ee58640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280ce710 con 0x7f26281595b0 2023-06-09T04:39:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26280ccb70 0x7f262815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26280ccb70 0x7f262815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40080/0 (socket says 172.21.15.18:40080) 2023-06-09T04:39:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 -- 172.21.15.18:0/3150233169 learned_addr learned my addr 172.21.15.18:0/3150233169 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262cbf4640 1 --2- 172.21.15.18:0/3150233169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26280b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 -- 172.21.15.18:0/3150233169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 msgr2=0x7f26280b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 --2- 172.21.15.18:0/3150233169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26280b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 -- 172.21.15.18:0/3150233169 >> v1:172.21.15.81:6789/0 conn(0x7f26280cf890 legacy=0x7f26280cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.278+0000 7f262d3f5640 1 -- 172.21.15.18:0/3150233169 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280cabb0 con 0x7f26280ccb70 2023-06-09T04:39:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262d3f5640 1 --2- 172.21.15.18:0/3150233169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262815d030 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2620009e50 tx=0x7f262001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e074c564a2eb1bc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f26277fe640 1 -- 172.21.15.18:0/3150233169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200a5520 con 0x7f26280ccb70 2023-06-09T04:39:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f26277fe640 1 -- 172.21.15.18:0/3150233169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200a5680 con 0x7f26280ccb70 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f26277fe640 1 -- 172.21.15.18:0/3150233169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200a5a10 con 0x7f26280ccb70 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/3150233169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 msgr2=0x7f262815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 --2- 172.21.15.18:0/3150233169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262815d030 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2620009e50 tx=0x7f262001c750 comp rx=0 tx=0).stop 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/3150233169 shutdown_connections 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 --2- 172.21.15.18:0/3150233169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262815d030 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 --2- 172.21.15.18:0/3150233169 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26280b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/3150233169 >> 172.21.15.18:0/3150233169 conn(0x7f262806ce60 msgr2=0x7f262806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/3150233169 shutdown_connections 2023-06-09T04:39:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/3150233169 wait complete. 2023-06-09T04:39:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 Processor -- start 2023-06-09T04:39:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- start start 2023-06-09T04:39:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26280cf890 0x7f26280c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26281f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c9820 con 0x7f26280ccb70 2023-06-09T04:39:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628146940 con 0x7f26280cf890 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26281f2a90 con 0x7f26281595b0 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262814e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40090/0 (socket says 172.21.15.18:40090) 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 -- 172.21.15.18:0/778437720 learned_addr learned my addr 172.21.15.18:0/778437720 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262d3f5640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26281f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f2627fff640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26280cf890 0x7f26280c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 -- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 msgr2=0x7f26281f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26281f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 -- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26280cf890 msgr2=0x7f26280c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26280cf890 0x7f26280c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 -- 172.21.15.18:0/778437720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620009b30 con 0x7f26280ccb70 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262d3f5640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26281f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f2627fff640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26280cf890 0x7f26280c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262cbf4640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262814e5d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f261c00d5f0 tx=0x7f261c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c0125f0 con 0x7f26280ccb70 2023-06-09T04:39:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c012750 con 0x7f26280ccb70 2023-06-09T04:39:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280ce9f0 con 0x7f26280ccb70 2023-06-09T04:39:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c012ae0 con 0x7f26280ccb70 2023-06-09T04:39:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.282+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280c8ba0 con 0x7f26280ccb70 2023-06-09T04:39:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.286+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280b42a0 con 0x7f26280ccb70 2023-06-09T04:39:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.286+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f261c012c40 con 0x7f26280ccb70 2023-06-09T04:39:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.286+0000 7f26257fa640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2614066280 0x7f2614068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.286+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f261c084530 con 0x7f26280ccb70 2023-06-09T04:39:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.286+0000 7f2627fff640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2614066280 0x7f2614068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.286+0000 7f2627fff640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2614066280 0x7f2614068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f26281ef4c0 tx=0x7f2618009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.290+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f261c0516c0 con 0x7f26280ccb70 2023-06-09T04:39:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.442+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2628073380 con 0x7f26280ccb70 2023-06-09T04:39:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.442+0000 7f26257fa640 1 -- 172.21.15.18:0/778437720 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f261c007380 con 0x7f26280ccb70 2023-06-09T04:39:10.447 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2614066280 msgr2=0x7f2614068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2614066280 0x7f2614068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f26281ef4c0 tx=0x7f2618009040 comp rx=0 tx=0).stop 2023-06-09T04:39:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 msgr2=0x7f262814e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262814e5d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f261c00d5f0 tx=0x7f261c00dab0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 shutdown_connections 2023-06-09T04:39:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2614066280 0x7f2614068730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f26281595b0 0x7f26281f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26280cf890 0x7f26280c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 --2- 172.21.15.18:0/778437720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26280ccb70 0x7f262814e5d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 >> 172.21.15.18:0/778437720 conn(0x7f262806ce60 msgr2=0x7f2628152110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 shutdown_connections 2023-06-09T04:39:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.446+0000 7f262ee58640 1 -- 172.21.15.18:0/778437720 wait complete. 2023-06-09T04:39:10.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 Processor -- start 2023-06-09T04:39:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 -- start start 2023-06-09T04:39:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 0x7f13f415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13f40c3940 0x7f13f40c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40cc450 con 0x7f13f41595d0 2023-06-09T04:39:10.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f415ce40 con 0x7f13f40c3940 2023-06-09T04:39:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13fad54640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40c42f0 con 0x7f13f4155d20 2023-06-09T04:39:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f13f41595d0 0x7f13f406bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52500/0 (socket says 172.21.15.18:52500) 2023-06-09T04:39:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 -- 172.21.15.18:0/287943287 learned_addr learned my addr 172.21.15.18:0/287943287 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:10.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f8af0640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 0x7f13f415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f92f1640 1 --2- 172.21.15.18:0/287943287 >> v2:172.21.15.81:3300/0 conn(0x7f13f40c3940 0x7f13f40c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993064699 0 0) 0x7f13f40cc450 con 0x7f13f41595d0 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13dc003530 con 0x7f13f41595d0 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164099716 0 0) 0x7f13dc003530 con 0x7f13f41595d0 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 msgr2=0x7f13f415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 0x7f13f415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 >> v2:172.21.15.81:3300/0 conn(0x7f13f40c3940 msgr2=0x7f13f40c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 --2- 172.21.15.18:0/287943287 >> v2:172.21.15.81:3300/0 conn(0x7f13f40c3940 0x7f13f40c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f415c880 con 0x7f13f41595d0 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f13e8001680 con 0x7f13f41595d0 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 >> v1:172.21.15.18:6789/0 conn(0x7f13f41595d0 legacy=0x7f13f406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc003980 0x7f13dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13dc0043b0 0x7f13dc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 0x7f13dc004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f415ce40 con 0x7f13dc0043b0 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40c42f0 con 0x7f13dc003980 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc00b990 con 0x7f13f4155d20 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13dc0043b0 0x7f13dc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f92f1640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 0x7f13dc004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 -- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 msgr2=0x7f13dc004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4155d20 0x7f13dc004f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 -- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc003980 msgr2=0x7f13dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc003980 0x7f13dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.650+0000 7f13f3fff640 1 -- 172.21.15.18:0/287943287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc003530 con 0x7f13dc0043b0 2023-06-09T04:39:10.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13f3fff640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13dc0043b0 0x7f13dc004870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13f4159a20 tx=0x7f13e80215a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9510ae319ff81341 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8005ae0 con 0x7f13dc0043b0 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e80ad070 con 0x7f13dc0043b0 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13f37fe640 1 -- 172.21.15.18:0/287943287 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8005ea0 con 0x7f13dc0043b0 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- 172.21.15.18:0/287943287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13dc0043b0 msgr2=0x7f13dc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 --2- 172.21.15.18:0/287943287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13dc0043b0 0x7f13dc004870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13f4159a20 tx=0x7f13e80215a0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13f92f1640 1 -- 172.21.15.18:0/287943287 reap_dead start 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- 172.21.15.18:0/287943287 shutdown_connections 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- 172.21.15.18:0/287943287 >> 172.21.15.18:0/287943287 conn(0x7f13f40afa90 msgr2=0x7f13f40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- 172.21.15.18:0/287943287 shutdown_connections 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- 172.21.15.18:0/287943287 wait complete. 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 Processor -- start 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- start start 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc0043b0 0x7f13f4157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 0x7f13f4157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4159a90 0x7f13f4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f41ed840 con 0x7f13f4150b40 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f41ecc70 con 0x7f13dc0043b0 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.654+0000 7f13fad54640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f41ecf10 con 0x7f13f4159a90 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 0x7f13f4157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 0x7f13f4157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40106/0 (socket says 172.21.15.18:40106) 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 -- 172.21.15.18:0/3513973188 learned_addr learned my addr 172.21.15.18:0/3513973188 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f92f1640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4159a90 0x7f13f4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f8af0640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc0043b0 0x7f13f4157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 -- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4159a90 msgr2=0x7f13f4159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4159a90 0x7f13f4159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 -- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc0043b0 msgr2=0x7f13f4157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc0043b0 0x7f13f4157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 -- 172.21.15.18:0/3513973188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f41ed1f0 con 0x7f13f4150b40 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f3fff640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 0x7f13f4157ca0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000c10 tx=0x7f13dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e80b9070 con 0x7f13f4150b40 2023-06-09T04:39:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e80048b0 con 0x7f13f4150b40 2023-06-09T04:39:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f41ed4d0 con 0x7f13f4150b40 2023-06-09T04:39:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8004c60 con 0x7f13f4150b40 2023-06-09T04:39:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f4150ff0 con 0x7f13f4150b40 2023-06-09T04:39:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40af470 con 0x7f13f4150b40 2023-06-09T04:39:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13e80af020 con 0x7f13f4150b40 2023-06-09T04:39:10.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f17fa640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f13e0066280 0x7f13e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f13e8122740 con 0x7f13f4150b40 2023-06-09T04:39:10.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f8af0640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f13e0066280 0x7f13e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.658+0000 7f13f8af0640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f13e0066280 0x7f13e0068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009970 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.662+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13e80f3360 con 0x7f13f4150b40 2023-06-09T04:39:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.814+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13f4158f50 con 0x7f13f4150b40 2023-06-09T04:39:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13f17fa640 1 -- 172.21.15.18:0/3513973188 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13e80f2ef0 con 0x7f13f4150b40 2023-06-09T04:39:10.820 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f13e0066280 msgr2=0x7f13e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f13e0066280 0x7f13e0068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009970 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2023-06-09T04:39:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 msgr2=0x7f13f4157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 0x7f13f4157ca0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000c10 tx=0x7f13dc005800 comp rx=0 tx=0).stop 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 shutdown_connections 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f13e0066280 0x7f13e0068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f13f4159a90 0x7f13f4159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13f4150b40 0x7f13f4157ca0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 --2- 172.21.15.18:0/3513973188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13dc0043b0 0x7f13f4157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 >> 172.21.15.18:0/3513973188 conn(0x7f13f40afa90 msgr2=0x7f13f415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 shutdown_connections 2023-06-09T04:39:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.818+0000 7f13fad54640 1 -- 172.21.15.18:0/3513973188 wait complete. 2023-06-09T04:39:10.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:10.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 Processor -- start 2023-06-09T04:39:10.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 -- start start 2023-06-09T04:39:10.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff558159300 0x7ff55815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580cbe00 0x7ff5580cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff5580ccba0 0x7ff5580b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5580ca2a0 con 0x7ff5580ccba0 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55815dee0 con 0x7ff558159300 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff55dde2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580cd820 con 0x7ff5580cbe00 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff557fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff5580ccba0 0x7ff5580b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff557fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff5580ccba0 0x7ff5580b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40112/0 (socket says 172.21.15.18:40112) 2023-06-09T04:39:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff557fff640 1 -- 172.21.15.18:0/2224323872 learned_addr learned my addr 172.21.15.18:0/2224323872 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff54ffff640 1 --2- 172.21.15.18:0/2224323872 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580cbe00 0x7ff5580cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.954+0000 7ff5577fe640 1 --2- 172.21.15.18:0/2224323872 >> v2:172.21.15.81:3300/0 conn(0x7ff558159300 0x7ff55815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff557fff640 1 -- 172.21.15.18:0/2224323872 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580cbe00 msgr2=0x7ff5580cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff557fff640 1 --2- 172.21.15.18:0/2224323872 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580cbe00 0x7ff5580cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff557fff640 1 -- 172.21.15.18:0/2224323872 >> v2:172.21.15.81:3300/0 conn(0x7ff558159300 msgr2=0x7ff55815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff557fff640 1 --2- 172.21.15.18:0/2224323872 >> v2:172.21.15.81:3300/0 conn(0x7ff558159300 0x7ff55815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff557fff640 1 -- 172.21.15.18:0/2224323872 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580ccfd0 con 0x7ff5580ccba0 2023-06-09T04:39:10.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff557fff640 1 --2- 172.21.15.18:0/2224323872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5580ccba0 0x7ff5580b16d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff5580cc630 tx=0x7ff55001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9ae281f2b1704d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff556ffd640 1 -- 172.21.15.18:0/2224323872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500a8400 con 0x7ff5580ccba0 2023-06-09T04:39:10.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff556ffd640 1 -- 172.21.15.18:0/2224323872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5500a8560 con 0x7ff5580ccba0 2023-06-09T04:39:10.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff556ffd640 1 -- 172.21.15.18:0/2224323872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500a88f0 con 0x7ff5580ccba0 2023-06-09T04:39:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff55dde2640 1 -- 172.21.15.18:0/2224323872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5580ccba0 msgr2=0x7ff5580b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff55dde2640 1 --2- 172.21.15.18:0/2224323872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5580ccba0 0x7ff5580b16d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff5580cc630 tx=0x7ff55001c710 comp rx=0 tx=0).stop 2023-06-09T04:39:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.958+0000 7ff55dde2640 1 -- 172.21.15.18:0/2224323872 shutdown_connections 2023-06-09T04:39:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 --2- 172.21.15.18:0/2224323872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5580ccba0 0x7ff5580b16d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 --2- 172.21.15.18:0/2224323872 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580cbe00 0x7ff5580cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 --2- 172.21.15.18:0/2224323872 >> v2:172.21.15.81:3300/0 conn(0x7ff558159300 0x7ff55815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- 172.21.15.18:0/2224323872 >> 172.21.15.18:0/2224323872 conn(0x7ff55806f850 msgr2=0x7ff55806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- 172.21.15.18:0/2224323872 shutdown_connections 2023-06-09T04:39:10.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- 172.21.15.18:0/2224323872 wait complete. 2023-06-09T04:39:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 Processor -- start 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- start start 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5580cbe00 0x7ff55814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580ccba0 0x7ff5580b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 0x7ff5581538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55814b9f0 con 0x7ff558159300 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55814bcd0 con 0x7ff5580cbe00 2023-06-09T04:39:10.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55814bfb0 con 0x7ff5580ccba0 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 0x7ff5581538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 0x7ff5581538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40126/0 (socket says 172.21.15.18:40126) 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 -- 172.21.15.18:0/1410908150 learned_addr learned my addr 172.21.15.18:0/1410908150 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff54ffff640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580ccba0 0x7ff5580b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff5577fe640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5580cbe00 0x7ff55814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 -- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580ccba0 msgr2=0x7ff5580b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580ccba0 0x7ff5580b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 -- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5580cbe00 msgr2=0x7ff55814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5580cbe00 0x7ff55814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 -- 172.21.15.18:0/1410908150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550009b30 con 0x7ff558159300 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff557fff640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 0x7ff5581538e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff55001adc0 tx=0x7ff5500194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500b6070 con 0x7ff558159300 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550009150 con 0x7ff558159300 2023-06-09T04:39:10.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55814c290 con 0x7ff558159300 2023-06-09T04:39:10.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500a8930 con 0x7ff558159300 2023-06-09T04:39:10.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55814b660 con 0x7ff558159300 2023-06-09T04:39:10.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.962+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff558073380 con 0x7ff558159300 2023-06-09T04:39:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.966+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5500ba070 con 0x7ff558159300 2023-06-09T04:39:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.966+0000 7ff554ff9640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff538066280 0x7ff538068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.966+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff55011e070 con 0x7ff558159300 2023-06-09T04:39:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.966+0000 7ff5577fe640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff538066280 0x7ff538068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.966+0000 7ff5577fe640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff538066280 0x7ff538068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff5580b0920 tx=0x7ff548008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:10.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:10.970+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5500eb160 con 0x7ff558159300 2023-06-09T04:39:11.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff55814c740 con 0x7ff558159300 2023-06-09T04:39:11.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff554ff9640 1 -- 172.21.15.18:0/1410908150 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff5500ee780 con 0x7ff558159300 2023-06-09T04:39:11.132 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:11.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff538066280 msgr2=0x7ff538068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff538066280 0x7ff538068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff5580b0920 tx=0x7ff548008040 comp rx=0 tx=0).stop 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 msgr2=0x7ff5581538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 0x7ff5581538e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff55001adc0 tx=0x7ff5500194b0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 shutdown_connections 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff558159300 0x7ff5581538e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff538066280 0x7ff538068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5580ccba0 0x7ff5580b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 --2- 172.21.15.18:0/1410908150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5580cbe00 0x7ff55814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 >> 172.21.15.18:0/1410908150 conn(0x7ff55806f850 msgr2=0x7ff55815d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 shutdown_connections 2023-06-09T04:39:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.130+0000 7ff55dde2640 1 -- 172.21.15.18:0/1410908150 wait complete. 2023-06-09T04:39:11.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2023-06-09T04:39:11.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:11.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:11.163 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:11.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:39:11.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:11.164 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T04:39:11.216 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:39:11.217 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:11.223 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:39:11.223 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:11.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:11.399 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 Processor -- start 2023-06-09T04:39:11.400 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 -- start start 2023-06-09T04:39:11.401 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f734c15ba50 0x7f734c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b44c0 0x7f734c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0cb460 con 0x7f734c0b4050 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c0cf800 con 0x7f734c15ba50 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7353df4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0cd0c0 con 0x7f734c0b44c0 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f735138f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f734c0b4050 0x7f734c0b05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52512/0 (socket says 172.21.15.18:52512) 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f735138f640 1 -- 172.21.15.18:0/296786308 learned_addr learned my addr 172.21.15.18:0/296786308 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:11.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7351b90640 1 --2- 172.21.15.18:0/296786308 >> v2:172.21.15.81:3300/0 conn(0x7f734c15ba50 0x7f734c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7352391640 1 --2- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b44c0 0x7f734c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7350b8e640 1 -- 172.21.15.18:0/296786308 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626979931 0 0) 0x7f734c0cb460 con 0x7f734c0b4050 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7350b8e640 1 -- 172.21.15.18:0/296786308 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7338003530 con 0x7f734c0b4050 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7351b90640 1 -- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b44c0 msgr2=0x7f734c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7351b90640 1 --2- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b44c0 0x7f734c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7350b8e640 1 -- 172.21.15.18:0/296786308 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299250513 0 0) 0x7f7338003530 con 0x7f734c0b4050 2023-06-09T04:39:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7351b90640 1 -- 172.21.15.18:0/296786308 >> v1:172.21.15.18:6789/0 conn(0x7f734c0b4050 legacy=0x7f734c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.398+0000 7f7351b90640 1 -- 172.21.15.18:0/296786308 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c06e290 con 0x7f734c15ba50 2023-06-09T04:39:11.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7351b90640 1 --2- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c15ba50 0x7f734c0b3b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73480097c0 tx=0x7f734801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e5b2d2dee7c0746 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7350b8e640 1 -- 172.21.15.18:0/296786308 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c001680 con 0x7f734c15ba50 2023-06-09T04:39:11.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7350b8e640 1 -- 172.21.15.18:0/296786308 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73480a7050 con 0x7f734c15ba50 2023-06-09T04:39:11.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7350b8e640 1 -- 172.21.15.18:0/296786308 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73480ab600 con 0x7f734c15ba50 2023-06-09T04:39:11.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c15ba50 msgr2=0x7f734c0b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 --2- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c15ba50 0x7f734c0b3b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73480097c0 tx=0x7f734801c2e0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- 172.21.15.18:0/296786308 shutdown_connections 2023-06-09T04:39:11.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 --2- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b44c0 0x7f734c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 --2- 172.21.15.18:0/296786308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c15ba50 0x7f734c0b3b10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- 172.21.15.18:0/296786308 >> 172.21.15.18:0/296786308 conn(0x7f734c0b2720 msgr2=0x7f734c0ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- 172.21.15.18:0/296786308 shutdown_connections 2023-06-09T04:39:11.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- 172.21.15.18:0/296786308 wait complete. 2023-06-09T04:39:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 Processor -- start 2023-06-09T04:39:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- start start 2023-06-09T04:39:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b4050 0x7f734c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 0x7f734c1485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c150840 0x7f734c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c15e9b0 con 0x7f734c0b44c0 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c14d4a0 con 0x7f734c150840 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7353df4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c150db0 con 0x7f734c0b4050 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 0x7f734c1485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 0x7f734c1485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40130/0 (socket says 172.21.15.18:40130) 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 -- 172.21.15.18:0/2365212203 learned_addr learned my addr 172.21.15.18:0/2365212203 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:11.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7351b90640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b4050 0x7f734c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7352391640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c150840 0x7f734c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 -- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b4050 msgr2=0x7f734c15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b4050 0x7f734c15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 -- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c150840 msgr2=0x7f734c152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c150840 0x7f734c152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 -- 172.21.15.18:0/2365212203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348009420 con 0x7f734c0b44c0 2023-06-09T04:39:11.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f7352391640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c150840 0x7f734c152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f735138f640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 0x7f734c1485c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c750 tx=0x7f733c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c005ae0 con 0x7f734c0b44c0 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.402+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c005c40 con 0x7f734c0b44c0 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c151090 con 0x7f734c0b44c0 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c007070 con 0x7f734c0b44c0 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c151650 con 0x7f734c0b44c0 2023-06-09T04:39:11.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c073380 con 0x7f734c0b44c0 2023-06-09T04:39:11.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f733c0071d0 con 0x7f734c0b44c0 2023-06-09T04:39:11.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f73427fc640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7330066280 0x7f7330068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f733c083680 con 0x7f734c0b44c0 2023-06-09T04:39:11.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f7351b90640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7330066280 0x7f7330068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.406+0000 7f7351b90640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7330066280 0x7f7330068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73480ad000 tx=0x7f73480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.410+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f733c0508a0 con 0x7f734c0b44c0 2023-06-09T04:39:11.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.558+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f734c150620 con 0x7f734c0b44c0 2023-06-09T04:39:11.564 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f73427fc640 1 -- 172.21.15.18:0/2365212203 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f733c053ec0 con 0x7f734c0b44c0 2023-06-09T04:39:11.564 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:11.565 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:11.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7330066280 msgr2=0x7f7330068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7330066280 0x7f7330068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73480ad000 tx=0x7f73480a6000 comp rx=0 tx=0).stop 2023-06-09T04:39:11.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 msgr2=0x7f734c1485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 0x7f734c1485c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c750 tx=0x7f733c00cc10 comp rx=0 tx=0).stop 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 shutdown_connections 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f734c150840 0x7f734c152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f734c0b44c0 0x7f734c1485c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7330066280 0x7f7330068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 --2- 172.21.15.18:0/2365212203 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f734c0b4050 0x7f734c15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 >> 172.21.15.18:0/2365212203 conn(0x7f734c0b2720 msgr2=0x7f734c15c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 shutdown_connections 2023-06-09T04:39:11.568 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.562+0000 7f7353df4640 1 -- 172.21.15.18:0/2365212203 wait complete. 2023-06-09T04:39:11.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:11.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 Processor -- start 2023-06-09T04:39:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 -- start start 2023-06-09T04:39:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa36c15b600 0x7fa36c0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15f280 0x7fa36c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa36c0b39d0 0x7fa36c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c0cfce0 con 0x7fa36c15b600 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c0b4390 con 0x7fa36c0b39d0 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa371e28640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c15fd40 con 0x7fa36c15f280 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa36c15b600 0x7fa36c0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa36c15b600 0x7fa36c0b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40146/0 (socket says 172.21.15.18:40146) 2023-06-09T04:39:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 -- 172.21.15.18:0/1252298485 learned_addr learned my addr 172.21.15.18:0/1252298485 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36bfff640 1 --2- 172.21.15.18:0/1252298485 >> v2:172.21.15.81:3300/0 conn(0x7fa36c0b39d0 0x7fa36c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36affd640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15f280 0x7fa36c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 -- 172.21.15.18:0/1252298485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15f280 msgr2=0x7fa36c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15f280 0x7fa36c15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 -- 172.21.15.18:0/1252298485 >> v2:172.21.15.81:3300/0 conn(0x7fa36c0b39d0 msgr2=0x7fa36c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 --2- 172.21.15.18:0/1252298485 >> v2:172.21.15.81:3300/0 conn(0x7fa36c0b39d0 0x7fa36c0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 -- 172.21.15.18:0/1252298485 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c160020 con 0x7fa36c15b600 2023-06-09T04:39:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36bfff640 1 --2- 172.21.15.18:0/1252298485 >> v2:172.21.15.81:3300/0 conn(0x7fa36c0b39d0 0x7fa36c0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36affd640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15f280 0x7fa36c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.710+0000 7fa36b7fe640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15b600 0x7fa36c0b4da0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa36c08b2f0 tx=0x7fa35c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ca2c46ef1c9897 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36a7fc640 1 -- 172.21.15.18:0/1252298485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0ab600 con 0x7fa36c15b600 2023-06-09T04:39:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36a7fc640 1 -- 172.21.15.18:0/1252298485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c0ab760 con 0x7fa36c15b600 2023-06-09T04:39:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36a7fc640 1 -- 172.21.15.18:0/1252298485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0abaf0 con 0x7fa36c15b600 2023-06-09T04:39:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1252298485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15b600 msgr2=0x7fa36c0b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15b600 0x7fa36c0b4da0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa36c08b2f0 tx=0x7fa35c01c440 comp rx=0 tx=0).stop 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1252298485 shutdown_connections 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- 172.21.15.18:0/1252298485 >> v2:172.21.15.81:3300/0 conn(0x7fa36c0b39d0 0x7fa36c0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15f280 0x7fa36c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- 172.21.15.18:0/1252298485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15b600 0x7fa36c0b4da0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1252298485 >> 172.21.15.18:0/1252298485 conn(0x7fa36c0d2120 msgr2=0x7fa36c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1252298485 shutdown_connections 2023-06-09T04:39:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1252298485 wait complete. 2023-06-09T04:39:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 Processor -- start 2023-06-09T04:39:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- start start 2023-06-09T04:39:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa36c0b39d0 0x7fa36c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15b600 0x7fa36c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 0x7fa36c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c15e6b0 con 0x7fa36c15f280 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c14f3d0 con 0x7fa36c0b39d0 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c147900 con 0x7fa36c15b600 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 0x7fa36c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 0x7fa36c0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40154/0 (socket says 172.21.15.18:40154) 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 -- 172.21.15.18:0/1474728053 learned_addr learned my addr 172.21.15.18:0/1474728053 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36affd640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15b600 0x7fa36c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36b7fe640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa36c0b39d0 0x7fa36c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 -- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15b600 msgr2=0x7fa36c0b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15b600 0x7fa36c0b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 -- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa36c0b39d0 msgr2=0x7fa36c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa36c0b39d0 0x7fa36c1473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 -- 172.21.15.18:0/1474728053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0094d0 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa36bfff640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 0x7fa36c0b52c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa36400cf20 tx=0x7fa36400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36400d840 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36400d9a0 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c15d610 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36400dd50 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.714+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c15dbd0 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.718+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c073380 con 0x7fa36c15f280 2023-06-09T04:39:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.718+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa36401e3b0 con 0x7fa36c15f280 2023-06-09T04:39:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.718+0000 7fa353fff640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa3580662b0 0x7fa358068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.718+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa364084a10 con 0x7fa36c15f280 2023-06-09T04:39:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.718+0000 7fa36b7fe640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa3580662b0 0x7fa358068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.718+0000 7fa36b7fe640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa3580662b0 0x7fa358068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0af000 tx=0x7fa35c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.722+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa364051ba0 con 0x7fa36c15f280 2023-06-09T04:39:11.877 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.874+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa36c06a7d0 con 0x7fa36c15f280 2023-06-09T04:39:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.874+0000 7fa353fff640 1 -- 172.21.15.18:0/1474728053 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa36401a020 con 0x7fa36c15f280 2023-06-09T04:39:11.878 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:11.880 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa3580662b0 msgr2=0x7fa358068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.880 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa3580662b0 0x7fa358068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0af000 tx=0x7fa35c0a7000 comp rx=0 tx=0).stop 2023-06-09T04:39:11.880 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 msgr2=0x7fa36c0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 0x7fa36c0b52c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa36400cf20 tx=0x7fa36400a710 comp rx=0 tx=0).stop 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 shutdown_connections 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa36c15f280 0x7fa36c0b52c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa3580662b0 0x7fa358068760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa36c15b600 0x7fa36c0b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 --2- 172.21.15.18:0/1474728053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa36c0b39d0 0x7fa36c1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 >> 172.21.15.18:0/1474728053 conn(0x7fa36c0d2120 msgr2=0x7fa36c0b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 shutdown_connections 2023-06-09T04:39:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:11.878+0000 7fa371e28640 1 -- 172.21.15.18:0/1474728053 wait complete. 2023-06-09T04:39:11.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:12.028 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ecf6640 1 Processor -- start 2023-06-09T04:39:12.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ecf6640 1 -- start start 2023-06-09T04:39:12.029 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ecf6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97681591c0 0x7f97680cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ecf6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976815de50 con 0x7f9768159590 2023-06-09T04:39:12.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ecf6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976806cbf0 con 0x7f97680acdf0 2023-06-09T04:39:12.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ecf6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976815d2d0 con 0x7f97681591c0 2023-06-09T04:39:12.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9768159590 0x7f976806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52528/0 (socket says 172.21.15.18:52528) 2023-06-09T04:39:12.030 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 -- 172.21.15.18:0/1641309901 learned_addr learned my addr 172.21.15.18:0/1641309901 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:12.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ca92640 1 --2- 172.21.15.18:0/1641309901 >> v2:172.21.15.81:3300/0 conn(0x7f97681591c0 0x7f97680cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712639736 0 0) 0x7f976815de50 con 0x7f9768159590 2023-06-09T04:39:12.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9750003530 con 0x7f9768159590 2023-06-09T04:39:12.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4185770482 0 0) 0x7f9750003530 con 0x7f9768159590 2023-06-09T04:39:12.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 >> v2:172.21.15.81:3300/0 conn(0x7f97681591c0 msgr2=0x7f97680cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 --2- 172.21.15.18:0/1641309901 >> v2:172.21.15.81:3300/0 conn(0x7f97681591c0 0x7f97680cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 >> v1:172.21.15.81:6789/0 conn(0x7f97680acdf0 legacy=0x7f976806c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976815d5b0 con 0x7f9768159590 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f975c001680 con 0x7f9768159590 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 >> v1:172.21.15.18:6789/0 conn(0x7f9768159590 legacy=0x7f976806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9750003980 0x7f9750003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500047d0 0x7f9750004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9750005180 0x7f975000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976815d2d0 con 0x7f97500047d0 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975000c000 con 0x7f9750005180 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975000c1c0 con 0x7f9750003980 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500047d0 0x7f9750004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ca92640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9750003980 0x7f9750003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976d293640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9750005180 0x7f975000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 -- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9750003980 msgr2=0x7f9750003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9750003980 0x7f9750003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 -- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9750005180 msgr2=0x7f975000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9750005180 0x7f975000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f9767fff640 1 -- 172.21.15.18:0/1641309901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750003530 con 0x7f97500047d0 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976ca92640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9750003980 0x7f9750003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976d293640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9750005180 0x7f975000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.026+0000 7f976d293640 1 -- 172.21.15.18:0/1641309901 reap_dead start 2023-06-09T04:39:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f9767fff640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500047d0 0x7f9750004c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f975c001060 tx=0x7f975c01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe3b47d3530e0a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0a8c50 con 0x7f97500047d0 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c0a8db0 con 0x7f97500047d0 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f97677fe640 1 -- 172.21.15.18:0/1641309901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c005b20 con 0x7f97500047d0 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 -- 172.21.15.18:0/1641309901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500047d0 msgr2=0x7f9750004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500047d0 0x7f9750004c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f975c001060 tx=0x7f975c01f330 comp rx=0 tx=0).stop 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 -- 172.21.15.18:0/1641309901 shutdown_connections 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1641309901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500047d0 0x7f9750004c40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 -- 172.21.15.18:0/1641309901 >> 172.21.15.18:0/1641309901 conn(0x7f97680afa90 msgr2=0x7f97680afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 -- 172.21.15.18:0/1641309901 shutdown_connections 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 -- 172.21.15.18:0/1641309901 wait complete. 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 Processor -- start 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.030+0000 7f976ecf6640 1 -- start start 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97500047d0 0x7f97681546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 0x7f9768148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97681573b0 0x7f97680c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b0990 con 0x7f97680b1730 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768157900 con 0x7f97681573b0 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b0c50 con 0x7f97500047d0 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 0x7f9768148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 0x7f9768148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40164/0 (socket says 172.21.15.18:40164) 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 -- 172.21.15.18:0/1347495496 learned_addr learned my addr 172.21.15.18:0/1347495496 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976d293640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97681573b0 0x7f97680c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ca92640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97500047d0 0x7f97681546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 -- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97500047d0 msgr2=0x7f97681546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97500047d0 0x7f97681546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 -- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97681573b0 msgr2=0x7f97680c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97681573b0 0x7f97680c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 -- 172.21.15.18:0/1347495496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680b0f30 con 0x7f97680b1730 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ca92640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97500047d0 0x7f97681546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f9767fff640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 0x7f9768148520 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f975c0ae040 tx=0x7f9750005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c004ab0 con 0x7f97680b1730 2023-06-09T04:39:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c004c10 con 0x7f97680b1730 2023-06-09T04:39:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c0070d0 con 0x7f97680b1730 2023-06-09T04:39:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680b1210 con 0x7f97680b1730 2023-06-09T04:39:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9768150cc0 con 0x7f97680b1730 2023-06-09T04:39:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97680b13a0 con 0x7f97680b1730 2023-06-09T04:39:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f975c007230 con 0x7f97680b1730 2023-06-09T04:39:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f97657fa640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9754066280 0x7f9754068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f975c0b7030 con 0x7f97680b1730 2023-06-09T04:39:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.034+0000 7f976ca92640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9754066280 0x7f9754068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.038+0000 7f976ca92640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9754066280 0x7f9754068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9758009b20 tx=0x7f9758008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.038+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f975c0edef0 con 0x7f97680b1730 2023-06-09T04:39:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.202+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97680adfd0 con 0x7f97680b1730 2023-06-09T04:39:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.202+0000 7f97657fa640 1 -- 172.21.15.18:0/1347495496 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f975c0c10a0 con 0x7f97680b1730 2023-06-09T04:39:12.207 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9754066280 msgr2=0x7f9754068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9754066280 0x7f9754068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9758009b20 tx=0x7f9758008040 comp rx=0 tx=0).stop 2023-06-09T04:39:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 msgr2=0x7f9768148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 0x7f9768148520 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f975c0ae040 tx=0x7f9750005800 comp rx=0 tx=0).stop 2023-06-09T04:39:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 shutdown_connections 2023-06-09T04:39:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97681573b0 0x7f97680c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97680b1730 0x7f9768148520 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9754066280 0x7f9754068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 --2- 172.21.15.18:0/1347495496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97500047d0 0x7f97681546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 >> 172.21.15.18:0/1347495496 conn(0x7f97680afa90 msgr2=0x7f976806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 shutdown_connections 2023-06-09T04:39:12.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.206+0000 7f976ecf6640 1 -- 172.21.15.18:0/1347495496 wait complete. 2023-06-09T04:39:12.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:12.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 Processor -- start 2023-06-09T04:39:12.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 -- start start 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9288155d20 0x7f928815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92881595d0 0x7f928806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92880cc450 con 0x7f928806c310 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928815ce40 con 0x7f9288155d20 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928ffc6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928815c880 con 0x7f92881595d0 2023-06-09T04:39:12.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928dd62640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9288155d20 0x7f928815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928dd62640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9288155d20 0x7f928815bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40166/0 (socket says 172.21.15.18:40166) 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928dd62640 1 -- 172.21.15.18:0/2281505462 learned_addr learned my addr 172.21.15.18:0/2281505462 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928d561640 1 --2- 172.21.15.18:0/2281505462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92881595d0 0x7f928806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928dd62640 1 -- 172.21.15.18:0/2281505462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92881595d0 msgr2=0x7f928806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928dd62640 1 --2- 172.21.15.18:0/2281505462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92881595d0 0x7f928806bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.354+0000 7f928dd62640 1 -- 172.21.15.18:0/2281505462 >> v1:172.21.15.81:6789/0 conn(0x7f928806c310 legacy=0x7f92880c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928dd62640 1 -- 172.21.15.18:0/2281505462 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928815cb60 con 0x7f9288155d20 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928dd62640 1 --2- 172.21.15.18:0/2281505462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928815bf10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9284006fd0 tx=0x7f928401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790444fcaa8b2c83 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928cd60640 1 -- 172.21.15.18:0/2281505462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840ab670 con 0x7f9288155d20 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928cd60640 1 -- 172.21.15.18:0/2281505462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840ab7d0 con 0x7f9288155d20 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928cd60640 1 -- 172.21.15.18:0/2281505462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840abb60 con 0x7f9288155d20 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 -- 172.21.15.18:0/2281505462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 msgr2=0x7f928815bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 --2- 172.21.15.18:0/2281505462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928815bf10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9284006fd0 tx=0x7f928401c4b0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 -- 172.21.15.18:0/2281505462 shutdown_connections 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 --2- 172.21.15.18:0/2281505462 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92881595d0 0x7f928806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 --2- 172.21.15.18:0/2281505462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928815bf10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 -- 172.21.15.18:0/2281505462 >> 172.21.15.18:0/2281505462 conn(0x7f92880afa90 msgr2=0x7f92880afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:12.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 -- 172.21.15.18:0/2281505462 shutdown_connections 2023-06-09T04:39:12.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.358+0000 7f928ffc6640 1 -- 172.21.15.18:0/2281505462 wait complete. 2023-06-09T04:39:12.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 Processor -- start 2023-06-09T04:39:12.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- start start 2023-06-09T04:39:12.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f928806c310 0x7f9288150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92881595d0 0x7f92880c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928814db20 con 0x7f9288155d20 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288154f90 con 0x7f92881595d0 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92881549d0 con 0x7f928806c310 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928814d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40184/0 (socket says 172.21.15.18:40184) 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 -- 172.21.15.18:0/3086840612 learned_addr learned my addr 172.21.15.18:0/3086840612 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928dd62640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f928806c310 0x7f9288150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928e563640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92881595d0 0x7f92880c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 -- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f928806c310 msgr2=0x7f9288150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f928806c310 0x7f9288150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 -- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92881595d0 msgr2=0x7f92880c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92881595d0 0x7f92880c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 -- 172.21.15.18:0/3086840612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009480 con 0x7f9288155d20 2023-06-09T04:39:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928d561640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928814d5e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f927800d5d0 tx=0x7f927800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278004240 con 0x7f9288155d20 2023-06-09T04:39:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780043a0 con 0x7f9288155d20 2023-06-09T04:39:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9288154cb0 con 0x7f9288155d20 2023-06-09T04:39:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278003840 con 0x7f9288155d20 2023-06-09T04:39:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92880c33e0 con 0x7f9288155d20 2023-06-09T04:39:12.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.362+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9288073380 con 0x7f9288155d20 2023-06-09T04:39:12.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.366+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92780039a0 con 0x7f9288155d20 2023-06-09T04:39:12.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.366+0000 7f927e7fc640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f926c066280 0x7f926c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.366+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9278084be0 con 0x7f9288155d20 2023-06-09T04:39:12.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.366+0000 7f928dd62640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f926c066280 0x7f926c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.366+0000 7f928dd62640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f926c066280 0x7f926c068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f92840af000 tx=0x7f9284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.370+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9278051ee0 con 0x7f9288155d20 2023-06-09T04:39:12.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92880710a0 con 0x7f9288155d20 2023-06-09T04:39:12.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f927e7fc640 1 -- 172.21.15.18:0/3086840612 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9278055500 con 0x7f9288155d20 2023-06-09T04:39:12.521 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f926c066280 msgr2=0x7f926c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f926c066280 0x7f926c068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f92840af000 tx=0x7f9284009040 comp rx=0 tx=0).stop 2023-06-09T04:39:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 msgr2=0x7f928814d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928814d5e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f927800d5d0 tx=0x7f927800da90 comp rx=0 tx=0).stop 2023-06-09T04:39:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 shutdown_connections 2023-06-09T04:39:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92881595d0 0x7f92880c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9288155d20 0x7f928814d5e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f926c066280 0x7f926c068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 --2- 172.21.15.18:0/3086840612 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f928806c310 0x7f9288150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 >> 172.21.15.18:0/3086840612 conn(0x7f92880afa90 msgr2=0x7f928815b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 shutdown_connections 2023-06-09T04:39:12.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.518+0000 7f928ffc6640 1 -- 172.21.15.18:0/3086840612 wait complete. 2023-06-09T04:39:12.538 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 Processor -- start 2023-06-09T04:39:12.695 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 -- start start 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59bc1591c0 0x7f59bc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc159590 0x7f59bc0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59bc0acdf0 0x7f59bc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc15de50 con 0x7f59bc0acdf0 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc15d2d0 con 0x7f59bc1591c0 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59c1018640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15d5b0 con 0x7f59bc159590 2023-06-09T04:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59bc0acdf0 0x7f59bc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59bc0acdf0 0x7f59bc06bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40186/0 (socket says 172.21.15.18:40186) 2023-06-09T04:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 -- 172.21.15.18:0/3461649186 learned_addr learned my addr 172.21.15.18:0/3461649186 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59ba59c640 1 --2- 172.21.15.18:0/3461649186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc159590 0x7f59bc0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bad9d640 1 --2- 172.21.15.18:0/3461649186 >> v2:172.21.15.81:3300/0 conn(0x7f59bc1591c0 0x7f59bc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 -- 172.21.15.18:0/3461649186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc159590 msgr2=0x7f59bc0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 --2- 172.21.15.18:0/3461649186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc159590 0x7f59bc0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 -- 172.21.15.18:0/3461649186 >> v2:172.21.15.81:3300/0 conn(0x7f59bc1591c0 msgr2=0x7f59bc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 --2- 172.21.15.18:0/3461649186 >> v2:172.21.15.81:3300/0 conn(0x7f59bc1591c0 0x7f59bc0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.694+0000 7f59bb59e640 1 -- 172.21.15.18:0/3461649186 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc15d890 con 0x7f59bc0acdf0 2023-06-09T04:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bb59e640 1 --2- 172.21.15.18:0/3461649186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc06bdd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06de60 tx=0x7f59b401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345318cd25b6cb3a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59b9d9b640 1 -- 172.21.15.18:0/3461649186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a5780 con 0x7f59bc0acdf0 2023-06-09T04:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59b9d9b640 1 -- 172.21.15.18:0/3461649186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40a58e0 con 0x7f59bc0acdf0 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59b9d9b640 1 -- 172.21.15.18:0/3461649186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a5c70 con 0x7f59bc0acdf0 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/3461649186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 msgr2=0x7f59bc06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- 172.21.15.18:0/3461649186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc06bdd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06de60 tx=0x7f59b401c9a0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/3461649186 shutdown_connections 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- 172.21.15.18:0/3461649186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc06bdd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- 172.21.15.18:0/3461649186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc159590 0x7f59bc0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- 172.21.15.18:0/3461649186 >> v2:172.21.15.81:3300/0 conn(0x7f59bc1591c0 0x7f59bc0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/3461649186 >> 172.21.15.18:0/3461649186 conn(0x7f59bc0afa90 msgr2=0x7f59bc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/3461649186 shutdown_connections 2023-06-09T04:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/3461649186 wait complete. 2023-06-09T04:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 Processor -- start 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- start start 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc14f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc1591c0 0x7f59bc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59bc159590 0x7f59bc15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0b13a0 con 0x7f59bc0acdf0 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15ade0 con 0x7f59bc159590 2023-06-09T04:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15b030 con 0x7f59bc1591c0 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc14f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc14f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40198/0 (socket says 172.21.15.18:40198) 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 -- 172.21.15.18:0/433890396 learned_addr learned my addr 172.21.15.18:0/433890396 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bb59e640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59bc159590 0x7f59bc15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59ba59c640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc1591c0 0x7f59bc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 -- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc1591c0 msgr2=0x7f59bc15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc1591c0 0x7f59bc15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 -- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59bc159590 msgr2=0x7f59bc15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59bc159590 0x7f59bc15a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 -- 172.21.15.18:0/433890396 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4009b30 con 0x7f59bc0acdf0 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bb59e640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59bc159590 0x7f59bc15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59bad9d640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc14f570 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00d830 tx=0x7f59ac00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac009640 con 0x7f59bc0acdf0 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac0097a0 con 0x7f59bc0acdf0 2023-06-09T04:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc15b310 con 0x7f59bc0acdf0 2023-06-09T04:39:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac009b10 con 0x7f59bc0acdf0 2023-06-09T04:39:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.698+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc0b18d0 con 0x7f59bc0acdf0 2023-06-09T04:39:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.702+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc073380 con 0x7f59bc0acdf0 2023-06-09T04:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.702+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59ac009c70 con 0x7f59bc0acdf0 2023-06-09T04:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.702+0000 7f59b37fe640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f599c066280 0x7f599c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.702+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f59ac084760 con 0x7f59bc0acdf0 2023-06-09T04:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.702+0000 7f59ba59c640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f599c066280 0x7f599c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.702+0000 7f59ba59c640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f599c066280 0x7f599c068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0adb00 tx=0x7f59a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.706+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59ac051980 con 0x7f59bc0acdf0 2023-06-09T04:39:12.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.854+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59bc0ad850 con 0x7f59bc0acdf0 2023-06-09T04:39:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.854+0000 7f59b37fe640 1 -- 172.21.15.18:0/433890396 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59ac00b420 con 0x7f59bc0acdf0 2023-06-09T04:39:12.858 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f599c066280 msgr2=0x7f599c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f599c066280 0x7f599c068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0adb00 tx=0x7f59a4008040 comp rx=0 tx=0).stop 2023-06-09T04:39:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 msgr2=0x7f59bc14f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc14f570 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00d830 tx=0x7f59ac00dcf0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 shutdown_connections 2023-06-09T04:39:12.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59bc159590 0x7f59bc15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f599c066280 0x7f599c068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59bc1591c0 0x7f59bc15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 --2- 172.21.15.18:0/433890396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59bc0acdf0 0x7f59bc14f570 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 >> 172.21.15.18:0/433890396 conn(0x7f59bc0afa90 msgr2=0x7f59bc0cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 shutdown_connections 2023-06-09T04:39:12.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.858+0000 7f59c1018640 1 -- 172.21.15.18:0/433890396 wait complete. 2023-06-09T04:39:12.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 Processor -- start 2023-06-09T04:39:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 -- start start 2023-06-09T04:39:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86e8155d20 0x7f86e815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e81595d0 0x7f86e806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86e806c310 0x7f86e80c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e815ce40 con 0x7f86e8155d20 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80cc450 con 0x7f86e806c310 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ef252640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e815c880 con 0x7f86e81595d0 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86e8155d20 0x7f86e815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86e8155d20 0x7f86e815bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40208/0 (socket says 172.21.15.18:40208) 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 -- 172.21.15.18:0/3957194527 learned_addr learned my addr 172.21.15.18:0/3957194527 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86e7fff640 1 --2- 172.21.15.18:0/3957194527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e81595d0 0x7f86e806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ed7ef640 1 --2- 172.21.15.18:0/3957194527 >> v2:172.21.15.81:3300/0 conn(0x7f86e806c310 0x7f86e80c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 -- 172.21.15.18:0/3957194527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e81595d0 msgr2=0x7f86e806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 --2- 172.21.15.18:0/3957194527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e81595d0 0x7f86e806bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 -- 172.21.15.18:0/3957194527 >> v2:172.21.15.81:3300/0 conn(0x7f86e806c310 msgr2=0x7f86e80c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:12.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 --2- 172.21.15.18:0/3957194527 >> v2:172.21.15.81:3300/0 conn(0x7f86e806c310 0x7f86e80c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.986+0000 7f86ecfee640 1 -- 172.21.15.18:0/3957194527 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e815cb60 con 0x7f86e8155d20 2023-06-09T04:39:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ecfee640 1 --2- 172.21.15.18:0/3957194527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e815bf10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f86e80c4ab0 tx=0x7f86d801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d8623cd8d565d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86e77fe640 1 -- 172.21.15.18:0/3957194527 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80a7b20 con 0x7f86e8155d20 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86e77fe640 1 -- 172.21.15.18:0/3957194527 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d80a7c80 con 0x7f86e8155d20 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86e77fe640 1 -- 172.21.15.18:0/3957194527 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80af440 con 0x7f86e8155d20 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 -- 172.21.15.18:0/3957194527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 msgr2=0x7f86e815bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 --2- 172.21.15.18:0/3957194527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e815bf10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f86e80c4ab0 tx=0x7f86d801eb80 comp rx=0 tx=0).stop 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 -- 172.21.15.18:0/3957194527 shutdown_connections 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 --2- 172.21.15.18:0/3957194527 >> v2:172.21.15.81:3300/0 conn(0x7f86e806c310 0x7f86e80c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 --2- 172.21.15.18:0/3957194527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e81595d0 0x7f86e806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 --2- 172.21.15.18:0/3957194527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e815bf10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 -- 172.21.15.18:0/3957194527 >> 172.21.15.18:0/3957194527 conn(0x7f86e80afa90 msgr2=0x7f86e80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 -- 172.21.15.18:0/3957194527 shutdown_connections 2023-06-09T04:39:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 -- 172.21.15.18:0/3957194527 wait complete. 2023-06-09T04:39:12.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 Processor -- start 2023-06-09T04:39:12.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 -- start start 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e806c310 0x7f86e81514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.990+0000 7f86ef252640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e81495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e81595d0 0x7f86e80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8149ae0 con 0x7f86e8155d20 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8151b90 con 0x7f86e81595d0 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8151e70 con 0x7f86e806c310 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e81495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e81495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40224/0 (socket says 172.21.15.18:40224) 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 -- 172.21.15.18:0/2267884674 learned_addr learned my addr 172.21.15.18:0/2267884674 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ecfee640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e806c310 0x7f86e81514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ed7ef640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e81595d0 0x7f86e80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 -- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e806c310 msgr2=0x7f86e81514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e806c310 0x7f86e81514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 -- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e81595d0 msgr2=0x7f86e80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:12.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e81595d0 0x7f86e80ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 -- 172.21.15.18:0/2267884674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d800b720 con 0x7f86e8155d20 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e7fff640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e81495a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d7d0 tx=0x7f86d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0018070 con 0x7f86e8155d20 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0004020 con 0x7f86e8155d20 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e8152150 con 0x7f86e8155d20 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00041d0 con 0x7f86e8155d20 2023-06-09T04:39:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e8152710 con 0x7f86e8155d20 2023-06-09T04:39:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e8073380 con 0x7f86e8155d20 2023-06-09T04:39:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86d0004330 con 0x7f86e8155d20 2023-06-09T04:39:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e57fa640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f86c8066280 0x7f86c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f86d0083f60 con 0x7f86e8155d20 2023-06-09T04:39:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ecfee640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f86c8066280 0x7f86c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.994+0000 7f86ecfee640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f86c8066280 0x7f86c8068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b1000 tx=0x7f86d80a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:12.998+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86d0054b80 con 0x7f86e8155d20 2023-06-09T04:39:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86e8162e30 con 0x7f86e8155d20 2023-06-09T04:39:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86e57fa640 1 -- 172.21.15.18:0/2267884674 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f86d0054710 con 0x7f86e8155d20 2023-06-09T04:39:13.148 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f86c8066280 msgr2=0x7f86c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f86c8066280 0x7f86c8068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b1000 tx=0x7f86d80a9070 comp rx=0 tx=0).stop 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 msgr2=0x7f86e81495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e81495a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d7d0 tx=0x7f86d000dc90 comp rx=0 tx=0).stop 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 shutdown_connections 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e81595d0 0x7f86e80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86e8155d20 0x7f86e81495a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f86c8066280 0x7f86c8068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 --2- 172.21.15.18:0/2267884674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f86e806c310 0x7f86e81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 >> 172.21.15.18:0/2267884674 conn(0x7f86e80afa90 msgr2=0x7f86e806a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 shutdown_connections 2023-06-09T04:39:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.146+0000 7f86ef252640 1 -- 172.21.15.18:0/2267884674 wait complete. 2023-06-09T04:39:13.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 Processor -- start 2023-06-09T04:39:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 -- start start 2023-06-09T04:39:13.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f049c159320 0x7f049c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f049c070270 0x7f049c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c15cf10 con 0x7f049c15d680 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c15a920 con 0x7f049c070270 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a3173640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0c81b0 con 0x7f049c159320 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f049c070270 0x7f049c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f049c070270 0x7f049c06bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40230/0 (socket says 172.21.15.18:40230) 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 -- 172.21.15.18:0/64926307 learned_addr learned my addr 172.21.15.18:0/64926307 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a0f0f640 1 --2- 172.21.15.18:0/64926307 >> v2:172.21.15.81:3300/0 conn(0x7f049c159320 0x7f049c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 -- 172.21.15.18:0/64926307 >> v2:172.21.15.81:3300/0 conn(0x7f049c159320 msgr2=0x7f049c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 --2- 172.21.15.18:0/64926307 >> v2:172.21.15.81:3300/0 conn(0x7f049c159320 0x7f049c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 -- 172.21.15.18:0/64926307 >> v1:172.21.15.81:6789/0 conn(0x7f049c15d680 legacy=0x7f049c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.278+0000 7f04a1710640 1 -- 172.21.15.18:0/64926307 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0c8490 con 0x7f049c070270 2023-06-09T04:39:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 --2- 172.21.15.18:0/64926307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c070270 0x7f049c06bcb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f049c06f610 tx=0x7f049401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a829d2e806da02 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f049b7fe640 1 -- 172.21.15.18:0/64926307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940a5790 con 0x7f049c070270 2023-06-09T04:39:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f049b7fe640 1 -- 172.21.15.18:0/64926307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940a58f0 con 0x7f049c070270 2023-06-09T04:39:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f049b7fe640 1 -- 172.21.15.18:0/64926307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940a5c80 con 0x7f049c070270 2023-06-09T04:39:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- 172.21.15.18:0/64926307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c070270 msgr2=0x7f049c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 --2- 172.21.15.18:0/64926307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c070270 0x7f049c06bcb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f049c06f610 tx=0x7f049401c8d0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- 172.21.15.18:0/64926307 shutdown_connections 2023-06-09T04:39:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 --2- 172.21.15.18:0/64926307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c070270 0x7f049c06bcb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 --2- 172.21.15.18:0/64926307 >> v2:172.21.15.81:3300/0 conn(0x7f049c159320 0x7f049c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- 172.21.15.18:0/64926307 >> 172.21.15.18:0/64926307 conn(0x7f049c0b0240 msgr2=0x7f049c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- 172.21.15.18:0/64926307 shutdown_connections 2023-06-09T04:39:13.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- 172.21.15.18:0/64926307 wait complete. 2023-06-09T04:39:13.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 Processor -- start 2023-06-09T04:39:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- start start 2023-06-09T04:39:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f049c070270 0x7f049c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f049c159320 0x7f049c0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 0x7f049c0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c14bd00 con 0x7f049c15d680 2023-06-09T04:39:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c5740 con 0x7f049c159320 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b1d40 con 0x7f049c070270 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 0x7f049c0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 0x7f049c0b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40244/0 (socket says 172.21.15.18:40244) 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 -- 172.21.15.18:0/1625694654 learned_addr learned my addr 172.21.15.18:0/1625694654 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f049bfff640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f049c159320 0x7f049c0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 -- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f049c070270 msgr2=0x7f049c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f049c070270 0x7f049c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 -- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f049c159320 msgr2=0x7f049c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f049c159320 0x7f049c0b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 -- 172.21.15.18:0/1625694654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009b30 con 0x7f049c15d680 2023-06-09T04:39:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a1710640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 0x7f049c0b1800 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f04940af040 tx=0x7f0494019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940b8670 con 0x7f049c15d680 2023-06-09T04:39:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940b87d0 con 0x7f049c15d680 2023-06-09T04:39:13.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940b8b60 con 0x7f049c15d680 2023-06-09T04:39:13.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.282+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0c4b30 con 0x7f049c15d680 2023-06-09T04:39:13.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c0c50f0 con 0x7f049c15d680 2023-06-09T04:39:13.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c0ce690 con 0x7f049c15d680 2023-06-09T04:39:13.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04940b8cc0 con 0x7f049c15d680 2023-06-09T04:39:13.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04997fa640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f04880662b0 0x7f0488068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f049411f650 con 0x7f049c15d680 2023-06-09T04:39:13.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04a0f0f640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f04880662b0 0x7f0488068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.286+0000 7f04a0f0f640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f04880662b0 0x7f0488068760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f049c15c9f0 tx=0x7f048c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.290+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04940ec940 con 0x7f049c15d680 2023-06-09T04:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.454+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f049c0c58b0 con 0x7f049c15d680 2023-06-09T04:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.454+0000 7f04997fa640 1 -- 172.21.15.18:0/1625694654 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f04940eff60 con 0x7f049c15d680 2023-06-09T04:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:13.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f04880662b0 msgr2=0x7f0488068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f04880662b0 0x7f0488068760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f049c15c9f0 tx=0x7f048c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 msgr2=0x7f049c0b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 0x7f049c0b1800 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f04940af040 tx=0x7f0494019670 comp rx=0 tx=0).stop 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 shutdown_connections 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049c15d680 0x7f049c0b1800 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f049c159320 0x7f049c0b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f04880662b0 0x7f0488068760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 --2- 172.21.15.18:0/1625694654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f049c070270 0x7f049c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 >> 172.21.15.18:0/1625694654 conn(0x7f049c0b0240 msgr2=0x7f049c15b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 shutdown_connections 2023-06-09T04:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.458+0000 7f04a3173640 1 -- 172.21.15.18:0/1625694654 wait complete. 2023-06-09T04:39:13.477 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:39:13.478 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:13.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.598+0000 7fe6a2e2b640 1 Processor -- start 2023-06-09T04:39:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.598+0000 7fe6a2e2b640 1 -- start start 2023-06-09T04:39:13.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a2e2b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe69c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a2e2b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c06a900 con 0x7fe69c158310 2023-06-09T04:39:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a2e2b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c15ceb0 con 0x7fe69c06c3c0 2023-06-09T04:39:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a2e2b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0cd0f0 con 0x7fe69c1586e0 2023-06-09T04:39:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a0bc7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe69c158310 0x7fe69c06bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52542/0 (socket says 172.21.15.18:52542) 2023-06-09T04:39:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a0bc7640 1 -- 172.21.15.18:0/3068916186 learned_addr learned my addr 172.21.15.18:0/3068916186 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69bfff640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe69c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282041183 0 0) 0x7fe69c06a900 con 0x7fe69c158310 2023-06-09T04:39:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe684003530 con 0x7fe69c158310 2023-06-09T04:39:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299668614 0 0) 0x7fe684003530 con 0x7fe69c158310 2023-06-09T04:39:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 msgr2=0x7fe69c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe69c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 >> v1:172.21.15.81:6789/0 conn(0x7fe69c06c3c0 legacy=0x7fe69c15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c15cbd0 con 0x7fe69c158310 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fe68c001a00 con 0x7fe69c158310 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 >> v1:172.21.15.18:6789/0 conn(0x7fe69c158310 legacy=0x7fe69c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe6840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe684003f30 0x7fe6840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684004d10 0x7fe684005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0cd0f0 con 0x7fe684004d10 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400ba70 con 0x7fe684003f30 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68400bc30 con 0x7fe69c1586e0 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684004d10 0x7fe684005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69bfff640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe684003f30 0x7fe6840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a0bc7640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe6840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 -- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 msgr2=0x7fe6840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe6840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 -- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe684003f30 msgr2=0x7fe6840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe684003f30 0x7fe6840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 -- 172.21.15.18:0/3068916186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684003530 con 0x7fe684004d10 2023-06-09T04:39:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a0bc7640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c1586e0 0x7fe6840039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69bfff640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe684003f30 0x7fe6840047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:13.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe6a13c8640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684004d10 0x7fe684005180 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe69c15bf50 tx=0x7fe69401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42d3702783b985a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940052d0 con 0x7fe684004d10 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6940a7050 con 0x7fe684004d10 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.602+0000 7fe69b7fe640 1 -- 172.21.15.18:0/3068916186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694003600 con 0x7fe684004d10 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/3068916186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684004d10 msgr2=0x7fe684005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/3068916186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe684004d10 0x7fe684005180 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe69c15bf50 tx=0x7fe69401c3a0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a13c8640 1 -- 172.21.15.18:0/3068916186 reap_dead start 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/3068916186 shutdown_connections 2023-06-09T04:39:13.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/3068916186 >> 172.21.15.18:0/3068916186 conn(0x7fe69c0b0240 msgr2=0x7fe69c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/3068916186 shutdown_connections 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/3068916186 wait complete. 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 Processor -- start 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- start start 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 0x7fe69c0c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe69c14ee70 0x7fe69c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c0c7720 0x7fe69c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b2a70 con 0x7fe69c14eaa0 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b1df0 con 0x7fe69c14ee70 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b20d0 con 0x7fe69c0c7720 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 0x7fe69c0c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 0x7fe69c0c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40254/0 (socket says 172.21.15.18:40254) 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 -- 172.21.15.18:0/2626040218 learned_addr learned my addr 172.21.15.18:0/2626040218 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe69bfff640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe69c14ee70 0x7fe69c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a13c8640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c0c7720 0x7fe69c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 -- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c0c7720 msgr2=0x7fe69c1540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c0c7720 0x7fe69c1540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 -- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe69c14ee70 msgr2=0x7fe69c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe69c14ee70 0x7fe69c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 -- 172.21.15.18:0/2626040218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0b23b0 con 0x7fe69c14eaa0 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a0bc7640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 0x7fe69c0c71e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00b0d0 tx=0x7fe68c00b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0072d0 con 0x7fe69c14eaa0 2023-06-09T04:39:13.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c007450 con 0x7fe69c14eaa0 2023-06-09T04:39:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c0b2690 con 0x7fe69c14eaa0 2023-06-09T04:39:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c007800 con 0x7fe69c14eaa0 2023-06-09T04:39:13.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.606+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c14f3f0 con 0x7fe69c14eaa0 2023-06-09T04:39:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.610+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c0b2bb0 con 0x7fe69c14eaa0 2023-06-09T04:39:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.610+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe68c007960 con 0x7fe69c14eaa0 2023-06-09T04:39:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.610+0000 7fe6997fa640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe688066280 0x7fe688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.610+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe68c0849c0 con 0x7fe69c14eaa0 2023-06-09T04:39:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.610+0000 7fe69bfff640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe688066280 0x7fe688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.617 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.610+0000 7fe69bfff640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe688066280 0x7fe688068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe690009a30 tx=0x7fe690008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.618 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.614+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe68c051b40 con 0x7fe69c14eaa0 2023-06-09T04:39:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.770+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69c06a390 con 0x7fe69c14eaa0 2023-06-09T04:39:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.770+0000 7fe6997fa640 1 -- 172.21.15.18:0/2626040218 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fe68c055160 con 0x7fe69c14eaa0 2023-06-09T04:39:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:13.775 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe688066280 msgr2=0x7fe688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe688066280 0x7fe688068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe690009a30 tx=0x7fe690008040 comp rx=0 tx=0).stop 2023-06-09T04:39:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 msgr2=0x7fe69c0c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 0x7fe69c0c71e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00b0d0 tx=0x7fe68c00b590 comp rx=0 tx=0).stop 2023-06-09T04:39:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 shutdown_connections 2023-06-09T04:39:13.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe688066280 0x7fe688068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe69c0c7720 0x7fe69c1540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe69c14ee70 0x7fe69c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 --2- 172.21.15.18:0/2626040218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe69c14eaa0 0x7fe69c0c71e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 >> 172.21.15.18:0/2626040218 conn(0x7fe69c0b0240 msgr2=0x7fe69c1532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 shutdown_connections 2023-06-09T04:39:13.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.774+0000 7fe6a2e2b640 1 -- 172.21.15.18:0/2626040218 wait complete. 2023-06-09T04:39:13.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:13.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:13.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8c74b640 1 Processor -- start 2023-06-09T04:39:13.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8c74b640 1 -- start start 2023-06-09T04:39:13.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8c74b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 0x7f4b841609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8c74b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b841639a0 con 0x7f4b84156af0 2023-06-09T04:39:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8c74b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b84163c80 con 0x7f4b840ad170 2023-06-09T04:39:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8c74b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8406fbd0 con 0x7f4b84163530 2023-06-09T04:39:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8a4e7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4b84156af0 0x7f4b840aca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52544/0 (socket says 172.21.15.18:52544) 2023-06-09T04:39:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8a4e7640 1 -- 172.21.15.18:0/493271470 learned_addr learned my addr 172.21.15.18:0/493271470 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:13.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b89ce6640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 0x7f4b841609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215016429 0 0) 0x7f4b841639a0 con 0x7f4b84156af0 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b6c003530 con 0x7f4b84156af0 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3162686336 0 0) 0x7f4b6c003530 con 0x7f4b84156af0 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 msgr2=0x7f4b841609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 0x7f4b841609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 >> v1:172.21.15.81:6789/0 conn(0x7f4b840ad170 legacy=0x7f4b84070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84163f60 con 0x7f4b84156af0 2023-06-09T04:39:13.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4b74001800 con 0x7f4b84156af0 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 >> v1:172.21.15.18:6789/0 conn(0x7f4b84156af0 legacy=0x7f4b840aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 0x7f4b6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6c003ef0 0x7f4b6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8406fbd0 con 0x7f4b6c004d10 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c00b9c0 con 0x7f4b6c003ef0 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c00bb80 con 0x7f4b84163530 2023-06-09T04:39:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b89ce6640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6c003ef0 0x7f4b6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8a4e7640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 0x7f4b6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8ace8640 1 -- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 msgr2=0x7f4b6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84163530 0x7f4b6c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8ace8640 1 -- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6c003ef0 msgr2=0x7f4b6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6c003ef0 0x7f4b6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.914+0000 7f4b8ace8640 1 -- 172.21.15.18:0/493271470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c003530 con 0x7f4b6c004d10 2023-06-09T04:39:13.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b840cda30 tx=0x7f4b7c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87bc2d8c87e7a37 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0a66f0 con 0x7f4b6c004d10 2023-06-09T04:39:13.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0a6850 con 0x7f4b6c004d10 2023-06-09T04:39:13.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b894e5640 1 -- 172.21.15.18:0/493271470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0a6c40 con 0x7f4b6c004d10 2023-06-09T04:39:13.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 -- 172.21.15.18:0/493271470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6c004d10 msgr2=0x7f4b6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/493271470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6c004d10 0x7f4b6c005180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b840cda30 tx=0x7f4b7c01c820 comp rx=0 tx=0).stop 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8ace8640 1 -- 172.21.15.18:0/493271470 reap_dead start 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 -- 172.21.15.18:0/493271470 shutdown_connections 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 -- 172.21.15.18:0/493271470 >> 172.21.15.18:0/493271470 conn(0x7f4b840afa90 msgr2=0x7f4b840afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 -- 172.21.15.18:0/493271470 shutdown_connections 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 -- 172.21.15.18:0/493271470 wait complete. 2023-06-09T04:39:13.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 Processor -- start 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.918+0000 7f4b8c74b640 1 -- start start 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b84147b80 0x7f4b84154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84153710 0x7f4b840b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 0x7f4b840b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840b1340 con 0x7f4b840b0990 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84153c80 con 0x7f4b84147b80 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84153f60 con 0x7f4b84153710 2023-06-09T04:39:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 0x7f4b840b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 0x7f4b840b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40274/0 (socket says 172.21.15.18:40274) 2023-06-09T04:39:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 -- 172.21.15.18:0/2568601925 learned_addr learned my addr 172.21.15.18:0/2568601925 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8a4e7640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b84147b80 0x7f4b84154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b89ce6640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84153710 0x7f4b840b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.928 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 -- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84153710 msgr2=0x7f4b840b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84153710 0x7f4b840b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 -- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b84147b80 msgr2=0x7f4b84154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b84147b80 0x7f4b84154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 -- 172.21.15.18:0/2568601925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84154240 con 0x7f4b840b0990 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8a4e7640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b84147b80 0x7f4b84154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8ace8640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 0x7f4b840b0e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c01cd00 tx=0x7f4b6c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.929 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c003d90 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0a6e60 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84154520 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c005270 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84155260 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b840ca040 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b7c0053d0 con 0x7f4b840b0990 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b82ffd640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b70066280 0x7f4b70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:13.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b7c0aa070 con 0x7f4b840b0990 2023-06-09T04:39:13.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.922+0000 7f4b8a4e7640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b70066280 0x7f4b70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:13.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.926+0000 7f4b8a4e7640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b70066280 0x7f4b70068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b740011e0 tx=0x7f4b74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:13.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:13.926+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b7c0eb2f0 con 0x7f4b840b0990 2023-06-09T04:39:14.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.078+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b840acf50 con 0x7f4b840b0990 2023-06-09T04:39:14.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.078+0000 7f4b82ffd640 1 -- 172.21.15.18:0/2568601925 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b7c0bd020 con 0x7f4b840b0990 2023-06-09T04:39:14.082 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:14.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b70066280 msgr2=0x7f4b70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b70066280 0x7f4b70068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b740011e0 tx=0x7f4b74009040 comp rx=0 tx=0).stop 2023-06-09T04:39:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 msgr2=0x7f4b840b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 0x7f4b840b0e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c01cd00 tx=0x7f4b6c005800 comp rx=0 tx=0).stop 2023-06-09T04:39:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 shutdown_connections 2023-06-09T04:39:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b840b0990 0x7f4b840b0e00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4b70066280 0x7f4b70068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4b84153710 0x7f4b840b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 --2- 172.21.15.18:0/2568601925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b84147b80 0x7f4b84154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 >> 172.21.15.18:0/2568601925 conn(0x7f4b840afa90 msgr2=0x7f4b841628d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 shutdown_connections 2023-06-09T04:39:14.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.082+0000 7f4b8c74b640 1 -- 172.21.15.18:0/2568601925 wait complete. 2023-06-09T04:39:14.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.210+0000 7fa7db5ef640 1 Processor -- start 2023-06-09T04:39:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.210+0000 7fa7db5ef640 1 -- start start 2023-06-09T04:39:14.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa7d40cbd40 0x7fa7d4069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d4069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d415de50 con 0x7fa7d41591c0 2023-06-09T04:39:14.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d415d2d0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415d5b0 con 0x7fa7d4159590 2023-06-09T04:39:14.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa7d40cbd40 0x7fa7d4069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa7d40cbd40 0x7fa7d4069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40288/0 (socket says 172.21.15.18:40288) 2023-06-09T04:39:14.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 -- 172.21.15.18:0/1471619568 learned_addr learned my addr 172.21.15.18:0/1471619568 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:14.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d9b8c640 1 --2- 172.21.15.18:0/1471619568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d4069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 -- 172.21.15.18:0/1471619568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 msgr2=0x7fa7d4069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 --2- 172.21.15.18:0/1471619568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d4069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 -- 172.21.15.18:0/1471619568 >> v1:172.21.15.81:6789/0 conn(0x7fa7d41591c0 legacy=0x7fa7d40cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 -- 172.21.15.18:0/1471619568 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d415d890 con 0x7fa7d40cbd40 2023-06-09T04:39:14.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7d8b8a640 1 --2- 172.21.15.18:0/1471619568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d4069600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009870 tx=0x7fa7c401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f438d5e3ade50ae8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7cbfff640 1 -- 172.21.15.18:0/1471619568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40ab670 con 0x7fa7d40cbd40 2023-06-09T04:39:14.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7cbfff640 1 -- 172.21.15.18:0/1471619568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c40ab7d0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7cbfff640 1 -- 172.21.15.18:0/1471619568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40abb60 con 0x7fa7d40cbd40 2023-06-09T04:39:14.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1471619568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 msgr2=0x7fa7d4069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.214+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1471619568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d4069600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009870 tx=0x7fa7c401c510 comp rx=0 tx=0).stop 2023-06-09T04:39:14.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1471619568 shutdown_connections 2023-06-09T04:39:14.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1471619568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d4069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1471619568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d4069600 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1471619568 >> 172.21.15.18:0/1471619568 conn(0x7fa7d40afa90 msgr2=0x7fa7d40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1471619568 shutdown_connections 2023-06-09T04:39:14.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1471619568 wait complete. 2023-06-09T04:39:14.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 Processor -- start 2023-06-09T04:39:14.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- start start 2023-06-09T04:39:14.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d41591c0 0x7fa7d415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415a0f0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40b3350 con 0x7fa7d41591c0 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40b1d70 con 0x7fa7d4159590 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d415ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40300/0 (socket says 172.21.15.18:40300) 2023-06-09T04:39:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 -- 172.21.15.18:0/1203320230 learned_addr learned my addr 172.21.15.18:0/1203320230 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d9b8c640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d8b8a640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d41591c0 0x7fa7d415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 -- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 msgr2=0x7fa7d40b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d40b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 -- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d41591c0 msgr2=0x7fa7d415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d41591c0 0x7fa7d415c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 -- 172.21.15.18:0/1203320230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c40094d0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7d938b640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d415ac80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000c450 tx=0x7fa7d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00052d0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0005430 con 0x7fa7d40cbd40 2023-06-09T04:39:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d40b2050 con 0x7fa7d40cbd40 2023-06-09T04:39:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0003890 con 0x7fa7d40cbd40 2023-06-09T04:39:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d40b2610 con 0x7fa7d40cbd40 2023-06-09T04:39:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.218+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d4073380 con 0x7fa7d40cbd40 2023-06-09T04:39:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.222+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7d00039f0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.222+0000 7fa7c9ffb640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa7b8066280 0x7fa7b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.222+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7d0083640 con 0x7fa7d40cbd40 2023-06-09T04:39:14.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.222+0000 7fa7d8b8a640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa7b8066280 0x7fa7b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.222+0000 7fa7d8b8a640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa7b8066280 0x7fa7b8068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40af000 tx=0x7fa7c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.226+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7d00507d0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.370+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7d40ccbd0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.370+0000 7fa7c9ffb640 1 -- 172.21.15.18:0/1203320230 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7d0053df0 con 0x7fa7d40cbd40 2023-06-09T04:39:14.375 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:14.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa7b8066280 msgr2=0x7fa7b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa7b8066280 0x7fa7b8068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40af000 tx=0x7fa7c4008040 comp rx=0 tx=0).stop 2023-06-09T04:39:14.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 msgr2=0x7fa7d415ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d415ac80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000c450 tx=0x7fa7d000c910 comp rx=0 tx=0).stop 2023-06-09T04:39:14.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 shutdown_connections 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa7b8066280 0x7fa7b8068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa7d4159590 0x7fa7d40b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d41591c0 0x7fa7d415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 --2- 172.21.15.18:0/1203320230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7d40cbd40 0x7fa7d415ac80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 >> 172.21.15.18:0/1203320230 conn(0x7fa7d40afa90 msgr2=0x7fa7d4155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 shutdown_connections 2023-06-09T04:39:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.374+0000 7fa7db5ef640 1 -- 172.21.15.18:0/1203320230 wait complete. 2023-06-09T04:39:14.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:14.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 Processor -- start 2023-06-09T04:39:14.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 -- start start 2023-06-09T04:39:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f52fc1591c0 0x7f52fc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52fc159590 0x7f52fc0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc15de50 con 0x7f52fc1591c0 2023-06-09T04:39:14.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc15d2d0 con 0x7f52fc159590 2023-06-09T04:39:14.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f53035ed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc15d5b0 con 0x7f52fc0acdf0 2023-06-09T04:39:14.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f52fc1591c0 0x7f52fc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f52fc1591c0 0x7f52fc0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40308/0 (socket says 172.21.15.18:40308) 2023-06-09T04:39:14.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 -- 172.21.15.18:0/1997095932 learned_addr learned my addr 172.21.15.18:0/1997095932 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:14.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5300b88640 1 --2- 172.21.15.18:0/1997095932 >> v2:172.21.15.81:3300/0 conn(0x7f52fc159590 0x7f52fc0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301b8a640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 -- 172.21.15.18:0/1997095932 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 msgr2=0x7f52fc06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc06bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 -- 172.21.15.18:0/1997095932 >> v2:172.21.15.81:3300/0 conn(0x7f52fc159590 msgr2=0x7f52fc0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 --2- 172.21.15.18:0/1997095932 >> v2:172.21.15.81:3300/0 conn(0x7f52fc159590 0x7f52fc0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301389640 1 -- 172.21.15.18:0/1997095932 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc15d890 con 0x7f52fc1591c0 2023-06-09T04:39:14.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5300b88640 1 --2- 172.21.15.18:0/1997095932 >> v2:172.21.15.81:3300/0 conn(0x7f52fc159590 0x7f52fc0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:14.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.514+0000 7f5301b8a640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc06bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:14.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f5301389640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc0cb630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f52fc15dff0 tx=0x7f52f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cc7bc132702fc8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f52f3fff640 1 -- 172.21.15.18:0/1997095932 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f80ac630 con 0x7f52fc1591c0 2023-06-09T04:39:14.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f52f3fff640 1 -- 172.21.15.18:0/1997095932 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f80ac790 con 0x7f52fc1591c0 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f52f3fff640 1 -- 172.21.15.18:0/1997095932 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f80acb20 con 0x7f52fc1591c0 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- 172.21.15.18:0/1997095932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 msgr2=0x7f52fc0cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc0cb630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f52fc15dff0 tx=0x7f52f801c4b0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- 172.21.15.18:0/1997095932 shutdown_connections 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc06bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- 172.21.15.18:0/1997095932 >> v2:172.21.15.81:3300/0 conn(0x7f52fc159590 0x7f52fc0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- 172.21.15.18:0/1997095932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc0cb630 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- 172.21.15.18:0/1997095932 >> 172.21.15.18:0/1997095932 conn(0x7f52fc0afa90 msgr2=0x7f52fc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- 172.21.15.18:0/1997095932 shutdown_connections 2023-06-09T04:39:14.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- 172.21.15.18:0/1997095932 wait complete. 2023-06-09T04:39:14.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 Processor -- start 2023-06-09T04:39:14.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- start start 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52fc159590 0x7f52fc152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0c34f0 con 0x7f52fc1591c0 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc159f20 con 0x7f52fc159590 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f53035ed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0c2900 con 0x7f52fc0acdf0 2023-06-09T04:39:14.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f5300b88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f5300b88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc1507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40318/0 (socket says 172.21.15.18:40318) 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f5300b88640 1 -- 172.21.15.18:0/3429954335 learned_addr learned my addr 172.21.15.18:0/3429954335 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f5301389640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.518+0000 7f5301b8a640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52fc159590 0x7f52fc152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5300b88640 1 -- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 msgr2=0x7f52fc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5300b88640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5300b88640 1 -- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52fc159590 msgr2=0x7f52fc152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5300b88640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52fc159590 0x7f52fc152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5300b88640 1 -- 172.21.15.18:0/3429954335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f8009480 con 0x7f52fc1591c0 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5301b8a640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52fc159590 0x7f52fc152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5300b88640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc1507c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c7f0 tx=0x7f52ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec004220 con 0x7f52fc1591c0 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec004380 con 0x7f52fc1591c0 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc0c2b50 con 0x7f52fc1591c0 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec003840 con 0x7f52fc1591c0 2023-06-09T04:39:14.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc0c3110 con 0x7f52fc1591c0 2023-06-09T04:39:14.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc073380 con 0x7f52fc1591c0 2023-06-09T04:39:14.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52ec003bb0 con 0x7f52fc1591c0 2023-06-09T04:39:14.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f52f1ffb640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f52e0066280 0x7f52e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52ec083e40 con 0x7f52fc1591c0 2023-06-09T04:39:14.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5301389640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f52e0066280 0x7f52e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.522+0000 7f5301389640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f52e0066280 0x7f52e0068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52f80ae000 tx=0x7f52f80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.526+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52ec051110 con 0x7f52fc1591c0 2023-06-09T04:39:14.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.674+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52fc0cd190 con 0x7f52fc1591c0 2023-06-09T04:39:14.679 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f52f1ffb640 1 -- 172.21.15.18:0/3429954335 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52ec003e60 con 0x7f52fc1591c0 2023-06-09T04:39:14.680 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f52e0066280 msgr2=0x7f52e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f52e0066280 0x7f52e0068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52f80ae000 tx=0x7f52f80a7000 comp rx=0 tx=0).stop 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 msgr2=0x7f52fc1507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc1507c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c7f0 tx=0x7f52ec00ccb0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 shutdown_connections 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52fc159590 0x7f52fc152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.682 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52fc1591c0 0x7f52fc1507c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f52e0066280 0x7f52e0068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 --2- 172.21.15.18:0/3429954335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f52fc0acdf0 0x7f52fc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 >> 172.21.15.18:0/3429954335 conn(0x7f52fc0afa90 msgr2=0x7f52fc069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 shutdown_connections 2023-06-09T04:39:14.683 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.678+0000 7f53035ed640 1 -- 172.21.15.18:0/3429954335 wait complete. 2023-06-09T04:39:14.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:14.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 Processor -- start 2023-06-09T04:39:14.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 -- start start 2023-06-09T04:39:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa82415b600 0x7fa8240b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa82415f280 0x7fa82415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82415fd40 con 0x7fa8240b39d0 2023-06-09T04:39:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8240cfce0 con 0x7fa82415f280 2023-06-09T04:39:14.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa829aa5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa824160020 con 0x7fa82415b600 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa82415f280 0x7fa82415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa82415f280 0x7fa82415f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40330/0 (socket says 172.21.15.18:40330) 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 -- 172.21.15.18:0/1973935187 learned_addr learned my addr 172.21.15.18:0/1973935187 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa8237fe640 1 --2- 172.21.15.18:0/1973935187 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa82415b600 0x7fa8240b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 -- 172.21.15.18:0/1973935187 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa82415b600 msgr2=0x7fa8240b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 --2- 172.21.15.18:0/1973935187 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa82415b600 0x7fa8240b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 -- 172.21.15.18:0/1973935187 >> v1:172.21.15.81:6789/0 conn(0x7fa8240b39d0 legacy=0x7fa8240d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:14.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.806+0000 7fa822ffd640 1 -- 172.21.15.18:0/1973935187 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240cfef0 con 0x7fa82415f280 2023-06-09T04:39:14.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 --2- 172.21.15.18:0/1973935187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415f280 0x7fa82415f6d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa818009870 tx=0x7fa81801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1d72de304c8864 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa8227fc640 1 -- 172.21.15.18:0/1973935187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180a6040 con 0x7fa82415f280 2023-06-09T04:39:14.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa8227fc640 1 -- 172.21.15.18:0/1973935187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8180aa600 con 0x7fa82415f280 2023-06-09T04:39:14.812 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa8227fc640 1 -- 172.21.15.18:0/1973935187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180aa990 con 0x7fa82415f280 2023-06-09T04:39:14.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/1973935187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415f280 msgr2=0x7fa82415f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 --2- 172.21.15.18:0/1973935187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415f280 0x7fa82415f6d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa818009870 tx=0x7fa81801c480 comp rx=0 tx=0).stop 2023-06-09T04:39:14.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/1973935187 shutdown_connections 2023-06-09T04:39:14.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 --2- 172.21.15.18:0/1973935187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415f280 0x7fa82415f6d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 --2- 172.21.15.18:0/1973935187 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa82415b600 0x7fa8240b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/1973935187 >> 172.21.15.18:0/1973935187 conn(0x7fa8240d2120 msgr2=0x7fa8240d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/1973935187 shutdown_connections 2023-06-09T04:39:14.814 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/1973935187 wait complete. 2023-06-09T04:39:14.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 Processor -- start 2023-06-09T04:39:14.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- start start 2023-06-09T04:39:14.815 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa8240b39d0 0x7fa8241f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 0x7fa8240692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82415f280 0x7fa8240697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82414f780 con 0x7fa82415b600 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8241f5050 con 0x7fa82415f280 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82414eb70 con 0x7fa8240b39d0 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 0x7fa8240692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.816 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 0x7fa8240692b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40346/0 (socket says 172.21.15.18:40346) 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 -- 172.21.15.18:0/3074372458 learned_addr learned my addr 172.21.15.18:0/3074372458 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa823fff640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82415f280 0x7fa8240697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa8237fe640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa8240b39d0 0x7fa8241f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 -- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa8240b39d0 msgr2=0x7fa8241f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa8240b39d0 0x7fa8241f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 -- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82415f280 msgr2=0x7fa8240697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82415f280 0x7fa8240697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.817 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 -- 172.21.15.18:0/3074372458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180094d0 con 0x7fa82415b600 2023-06-09T04:39:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa822ffd640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 0x7fa8240692b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa81801a0b0 tx=0x7fa81801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180b3800 con 0x7fa82415b600 2023-06-09T04:39:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8180b39a0 con 0x7fa82415b600 2023-06-09T04:39:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82414ee50 con 0x7fa82415b600 2023-06-09T04:39:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180b3d50 con 0x7fa82415b600 2023-06-09T04:39:14.818 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.810+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82414f410 con 0x7fa82415b600 2023-06-09T04:39:14.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.814+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82414f930 con 0x7fa82415b600 2023-06-09T04:39:14.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.814+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8180b2380 con 0x7fa82415b600 2023-06-09T04:39:14.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.814+0000 7fa80bfff640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa810066280 0x7fa810068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:14.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.814+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa81811e3c0 con 0x7fa82415b600 2023-06-09T04:39:14.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.814+0000 7fa8237fe640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa810066280 0x7fa810068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:14.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.814+0000 7fa8237fe640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa810066280 0x7fa810068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c9be0 tx=0x7fa814008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:14.821 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.818+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa82414f930 con 0x7fa82415b600 2023-06-09T04:39:14.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.962+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa824073380 con 0x7fa82415b600 2023-06-09T04:39:14.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.962+0000 7fa80bfff640 1 -- 172.21.15.18:0/3074372458 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8180eb670 con 0x7fa82415b600 2023-06-09T04:39:14.966 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:14.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa810066280 msgr2=0x7fa810068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa810066280 0x7fa810068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c9be0 tx=0x7fa814008040 comp rx=0 tx=0).stop 2023-06-09T04:39:14.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 msgr2=0x7fa8240692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 0x7fa8240692b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa81801a0b0 tx=0x7fa81801acc0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 shutdown_connections 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82415f280 0x7fa8240697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa82415b600 0x7fa8240692b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa810066280 0x7fa810068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 --2- 172.21.15.18:0/3074372458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa8240b39d0 0x7fa8241f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 >> 172.21.15.18:0/3074372458 conn(0x7fa8240d2120 msgr2=0x7fa8240b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 shutdown_connections 2023-06-09T04:39:14.970 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:14.966+0000 7fa829aa5640 1 -- 172.21.15.18:0/3074372458 wait complete. 2023-06-09T04:39:14.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:15.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 Processor -- start 2023-06-09T04:39:15.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 -- start start 2023-06-09T04:39:15.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d80b75e0 0x7fe5d80ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5d806b800 0x7fe5d80cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d8069df0 con 0x7fe5d80b1530 2023-06-09T04:39:15.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d806a0d0 con 0x7fe5d806b800 2023-06-09T04:39:15.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5de7c2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80cc610 con 0x7fe5d80b75e0 2023-06-09T04:39:15.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d77fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe5d80b1530 0x7fe5d806b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52556/0 (socket says 172.21.15.18:52556) 2023-06-09T04:39:15.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d77fe640 1 -- 172.21.15.18:0/3685950026 learned_addr learned my addr 172.21.15.18:0/3685950026 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:15.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d7fff640 1 --2- 172.21.15.18:0/3685950026 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d80b75e0 0x7fe5d80ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5dcd5f640 1 --2- 172.21.15.18:0/3685950026 >> v2:172.21.15.81:3300/0 conn(0x7fe5d806b800 0x7fe5d80cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d6ffd640 1 -- 172.21.15.18:0/3685950026 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638524859 0 0) 0x7fe5d8069df0 con 0x7fe5d80b1530 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d6ffd640 1 -- 172.21.15.18:0/3685950026 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c0003530 con 0x7fe5d80b1530 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d6ffd640 1 -- 172.21.15.18:0/3685950026 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119390070 0 0) 0x7fe5c0003530 con 0x7fe5d80b1530 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d7fff640 1 -- 172.21.15.18:0/3685950026 >> v2:172.21.15.81:3300/0 conn(0x7fe5d806b800 msgr2=0x7fe5d80cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d7fff640 1 --2- 172.21.15.18:0/3685950026 >> v2:172.21.15.81:3300/0 conn(0x7fe5d806b800 0x7fe5d80cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d7fff640 1 -- 172.21.15.18:0/3685950026 >> v1:172.21.15.18:6789/0 conn(0x7fe5d80b1530 legacy=0x7fe5d806b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.102+0000 7fe5d7fff640 1 -- 172.21.15.18:0/3685950026 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80cc8f0 con 0x7fe5d80b75e0 2023-06-09T04:39:15.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5d7fff640 1 --2- 172.21.15.18:0/3685950026 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d80b75e0 0x7fe5d80ce170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097c0 tx=0x7fe5c801c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49e720c92297a781 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5d6ffd640 1 -- 172.21.15.18:0/3685950026 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc001680 con 0x7fe5d80b75e0 2023-06-09T04:39:15.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5d6ffd640 1 -- 172.21.15.18:0/3685950026 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c80a7050 con 0x7fe5d80b75e0 2023-06-09T04:39:15.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5d6ffd640 1 -- 172.21.15.18:0/3685950026 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80ab600 con 0x7fe5d80b75e0 2023-06-09T04:39:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3685950026 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d80b75e0 msgr2=0x7fe5d80ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3685950026 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d80b75e0 0x7fe5d80ce170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80097c0 tx=0x7fe5c801c340 comp rx=0 tx=0).stop 2023-06-09T04:39:15.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3685950026 shutdown_connections 2023-06-09T04:39:15.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3685950026 >> v2:172.21.15.81:3300/0 conn(0x7fe5d806b800 0x7fe5d80cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3685950026 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d80b75e0 0x7fe5d80ce170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3685950026 >> 172.21.15.18:0/3685950026 conn(0x7fe5d80b46c0 msgr2=0x7fe5d80d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3685950026 shutdown_connections 2023-06-09T04:39:15.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.106+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3685950026 wait complete. 2023-06-09T04:39:15.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 Processor -- start 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- start start 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d806b800 0x7fe5d8152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 0x7fe5d815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d80b75e0 0x7fe5d815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8152ba0 con 0x7fe5d80b1530 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80cbf40 con 0x7fe5d80b75e0 2023-06-09T04:39:15.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8152e10 con 0x7fe5d806b800 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 0x7fe5d815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 0x7fe5d815c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40362/0 (socket says 172.21.15.18:40362) 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 -- 172.21.15.18:0/3557180542 learned_addr learned my addr 172.21.15.18:0/3557180542 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d7fff640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d806b800 0x7fe5d8152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5dcd5f640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d80b75e0 0x7fe5d815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 -- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d806b800 msgr2=0x7fe5d8152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d806b800 0x7fe5d8152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 -- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d80b75e0 msgr2=0x7fe5d815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d80b75e0 0x7fe5d815e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 -- 172.21.15.18:0/3557180542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8009420 con 0x7fe5d80b1530 2023-06-09T04:39:15.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d77fe640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 0x7fe5d815c5d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c750 tx=0x7fe5cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc005ae0 con 0x7fe5d80b1530 2023-06-09T04:39:15.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc005c40 con 0x7fe5d80b1530 2023-06-09T04:39:15.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d81530f0 con 0x7fe5d80b1530 2023-06-09T04:39:15.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc007070 con 0x7fe5d80b1530 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d8154e10 con 0x7fe5d80b1530 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.110+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d8153610 con 0x7fe5d80b1530 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.114+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5cc0071d0 con 0x7fe5d80b1530 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.114+0000 7fe5d4ff9640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5c40662b0 0x7fe5c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.114+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5cc083e20 con 0x7fe5d80b1530 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.114+0000 7fe5d7fff640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5c40662b0 0x7fe5c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.114+0000 7fe5d7fff640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5c40662b0 0x7fe5c4068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80ad000 tx=0x7fe5c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.118+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5cc050fb0 con 0x7fe5d80b1530 2023-06-09T04:39:15.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.266+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe5d8073380 con 0x7fe5d80b1530 2023-06-09T04:39:15.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.270+0000 7fe5d4ff9640 1 -- 172.21.15.18:0/3557180542 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe5cc0545d0 con 0x7fe5d80b1530 2023-06-09T04:39:15.272 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:15.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5c40662b0 msgr2=0x7fe5c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5c40662b0 0x7fe5c4068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80ad000 tx=0x7fe5c80a6000 comp rx=0 tx=0).stop 2023-06-09T04:39:15.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 msgr2=0x7fe5d815c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 0x7fe5d815c5d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c750 tx=0x7fe5cc00cc10 comp rx=0 tx=0).stop 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 shutdown_connections 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5d80b75e0 0x7fe5d815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5d80b1530 0x7fe5d815c5d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe5c40662b0 0x7fe5c4068760 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 --2- 172.21.15.18:0/3557180542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe5d806b800 0x7fe5d8152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 >> 172.21.15.18:0/3557180542 conn(0x7fe5d80b46c0 msgr2=0x7fe5d80b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 shutdown_connections 2023-06-09T04:39:15.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.274+0000 7fe5de7c2640 1 -- 172.21.15.18:0/3557180542 wait complete. 2023-06-09T04:39:15.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 Processor -- start 2023-06-09T04:39:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 -- start start 2023-06-09T04:39:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 0x7fa6f40c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6f40acd10 0x7fa6f40cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40c9010 con 0x7fa6f4157dc0 2023-06-09T04:39:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40cbdc0 con 0x7fa6f40acd10 2023-06-09T04:39:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6fa70f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40ad190 con 0x7fa6f4070270 2023-06-09T04:39:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa6f4157dc0 0x7fa6f406fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52566/0 (socket says 172.21.15.18:52566) 2023-06-09T04:39:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f3fff640 1 -- 172.21.15.18:0/1823275769 learned_addr learned my addr 172.21.15.18:0/1823275769 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:15.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f8cac640 1 --2- 172.21.15.18:0/1823275769 >> v2:172.21.15.18:3300/0 conn(0x7fa6f40acd10 0x7fa6f40cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 0x7fa6f40c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942707591 0 0) 0x7fa6f40c9010 con 0x7fa6f4157dc0 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6dc003530 con 0x7fa6f4157dc0 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486444340 0 0) 0x7fa6dc003530 con 0x7fa6f4157dc0 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 msgr2=0x7fa6f40c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 0x7fa6f40c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 >> v2:172.21.15.18:3300/0 conn(0x7fa6f40acd10 msgr2=0x7fa6f40cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 --2- 172.21.15.18:0/1823275769 >> v2:172.21.15.18:3300/0 conn(0x7fa6f40acd10 0x7fa6f40cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40c8460 con 0x7fa6f4157dc0 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fa6e4001a00 con 0x7fa6f4157dc0 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 >> v1:172.21.15.18:6789/0 conn(0x7fa6f4157dc0 legacy=0x7fa6f406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 0x7fa6dc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6dc003f00 0x7fa6dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc004d10 0x7fa6dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40cbdc0 con 0x7fa6dc003f00 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40ad190 con 0x7fa6dc004d10 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc00b9c0 con 0x7fa6f4070270 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6dc003f00 0x7fa6dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f8cac640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc004d10 0x7fa6dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f3fff640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 0x7fa6dc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 -- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 msgr2=0x7fa6dc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f4070270 0x7fa6dc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 -- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc004d10 msgr2=0x7fa6dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc004d10 0x7fa6dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.406+0000 7fa6f37fe640 1 -- 172.21.15.18:0/1823275769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc003530 con 0x7fa6dc003f00 2023-06-09T04:39:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6f37fe640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6dc003f00 0x7fa6dc0047d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009ab0 tx=0x7fa6e801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbee9a0d6bd144f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80a5620 con 0x7fa6dc003f00 2023-06-09T04:39:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e80a5780 con 0x7fa6dc003f00 2023-06-09T04:39:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6f2ffd640 1 -- 172.21.15.18:0/1823275769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80a5b30 con 0x7fa6dc003f00 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 -- 172.21.15.18:0/1823275769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6dc003f00 msgr2=0x7fa6dc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/1823275769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6dc003f00 0x7fa6dc0047d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009ab0 tx=0x7fa6e801ca30 comp rx=0 tx=0).stop 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6f8cac640 1 -- 172.21.15.18:0/1823275769 reap_dead start 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 -- 172.21.15.18:0/1823275769 shutdown_connections 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 -- 172.21.15.18:0/1823275769 >> 172.21.15.18:0/1823275769 conn(0x7fa6f40b0240 msgr2=0x7fa6f40cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 -- 172.21.15.18:0/1823275769 shutdown_connections 2023-06-09T04:39:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 -- 172.21.15.18:0/1823275769 wait complete. 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 Processor -- start 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.410+0000 7fa6fa70f640 1 -- start start 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc003f00 0x7fa6f414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f40b26e0 0x7fa6f414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 0x7fa6f414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b2ec0 con 0x7fa6f414fa60 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f41549a0 con 0x7fa6dc003f00 2023-06-09T04:39:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4154c80 con 0x7fa6f40b26e0 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 0x7fa6f414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 0x7fa6f414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40392/0 (socket says 172.21.15.18:40392) 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 -- 172.21.15.18:0/2362463557 learned_addr learned my addr 172.21.15.18:0/2362463557 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f37fe640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f40b26e0 0x7fa6f414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f3fff640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc003f00 0x7fa6f414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 -- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f40b26e0 msgr2=0x7fa6f414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f40b26e0 0x7fa6f414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 -- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc003f00 msgr2=0x7fa6f414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc003f00 0x7fa6f414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 -- 172.21.15.18:0/2362463557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4154f60 con 0x7fa6f414fa60 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f8cac640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 0x7fa6f414ff00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406aba0 tx=0x7fa6ec011550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec004500 con 0x7fa6f414fa60 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec0118a0 con 0x7fa6f414fa60 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f4155240 con 0x7fa6f414fa60 2023-06-09T04:39:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec011c90 con 0x7fa6f414fa60 2023-06-09T04:39:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f414e640 con 0x7fa6f414fa60 2023-06-09T04:39:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f406ca40 con 0x7fa6f414fa60 2023-06-09T04:39:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6ec003620 con 0x7fa6f414fa60 2023-06-09T04:39:15.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f0ff9640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa6e00662b0 0x7fa6e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6ec084070 con 0x7fa6f414fa60 2023-06-09T04:39:15.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.414+0000 7fa6f3fff640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa6e00662b0 0x7fa6e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.418+0000 7fa6f3fff640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa6e00662b0 0x7fa6e0068760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4002240 tx=0x7fa6e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.418+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6ec0512e0 con 0x7fa6f414fa60 2023-06-09T04:39:15.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6f406c760 con 0x7fa6f414fa60 2023-06-09T04:39:15.588 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6f0ff9640 1 -- 172.21.15.18:0/2362463557 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6ec054900 con 0x7fa6f414fa60 2023-06-09T04:39:15.588 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:15.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa6e00662b0 msgr2=0x7fa6e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa6e00662b0 0x7fa6e0068760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4002240 tx=0x7fa6e4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:15.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 msgr2=0x7fa6f414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 0x7fa6f414ff00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406aba0 tx=0x7fa6ec011550 comp rx=0 tx=0).stop 2023-06-09T04:39:15.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 shutdown_connections 2023-06-09T04:39:15.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6f414fa60 0x7fa6f414ff00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa6e00662b0 0x7fa6e0068760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6f40b26e0 0x7fa6f414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 --2- 172.21.15.18:0/2362463557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6dc003f00 0x7fa6f414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 >> 172.21.15.18:0/2362463557 conn(0x7fa6f40b0240 msgr2=0x7fa6f406bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 shutdown_connections 2023-06-09T04:39:15.592 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.586+0000 7fa6fa70f640 1 -- 172.21.15.18:0/2362463557 wait complete. 2023-06-09T04:39:15.609 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-06-09T04:39:15.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:15.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-09T04:39:15.632 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:15.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:39:15.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:15.633 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T04:39:15.687 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:39:15.687 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:15.693 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:39:15.693 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:15.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:15.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.906+0000 7fc09f36c640 1 Processor -- start 2023-06-09T04:39:15.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.906+0000 7fc09f36c640 1 -- start start 2023-06-09T04:39:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09f36c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0980b4220 0x7fc0980c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09f36c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc0980c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09f36c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0980cb460 con 0x7fc09815ba50 2023-06-09T04:39:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09f36c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0980cf800 con 0x7fc0980b4220 2023-06-09T04:39:15.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09f36c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980cd0c0 con 0x7fc0980c9670 2023-06-09T04:39:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09d108640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc09815ba50 0x7fc0980b3b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52576/0 (socket says 172.21.15.18:52576) 2023-06-09T04:39:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09c907640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0980b4220 0x7fc0980c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09d108640 1 -- 172.21.15.18:0/3844833319 learned_addr learned my addr 172.21.15.18:0/3844833319 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09d909640 1 --2- 172.21.15.18:0/3844833319 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc0980c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc08ffff640 1 -- 172.21.15.18:0/3844833319 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541308655 0 0) 0x7fc0980cb460 con 0x7fc09815ba50 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc08ffff640 1 -- 172.21.15.18:0/3844833319 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc084003530 con 0x7fc09815ba50 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09c907640 1 -- 172.21.15.18:0/3844833319 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 msgr2=0x7fc0980c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09c907640 1 --2- 172.21.15.18:0/3844833319 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc0980c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09c907640 1 -- 172.21.15.18:0/3844833319 >> v1:172.21.15.18:6789/0 conn(0x7fc09815ba50 legacy=0x7fc0980b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.910+0000 7fc09c907640 1 -- 172.21.15.18:0/3844833319 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09806e290 con 0x7fc0980b4220 2023-06-09T04:39:15.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09c907640 1 --2- 172.21.15.18:0/3844833319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0980c9130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc0880097c0 tx=0x7fc08801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df73ad69c930d456 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc08ffff640 1 -- 172.21.15.18:0/3844833319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880ab600 con 0x7fc0980b4220 2023-06-09T04:39:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc08ffff640 1 -- 172.21.15.18:0/3844833319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880a7050 con 0x7fc0980b4220 2023-06-09T04:39:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc08ffff640 1 -- 172.21.15.18:0/3844833319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880ab980 con 0x7fc0980b4220 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- 172.21.15.18:0/3844833319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 msgr2=0x7fc0980c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 --2- 172.21.15.18:0/3844833319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0980c9130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc0880097c0 tx=0x7fc08801c3c0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- 172.21.15.18:0/3844833319 shutdown_connections 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 --2- 172.21.15.18:0/3844833319 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc0980c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 --2- 172.21.15.18:0/3844833319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0980c9130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- 172.21.15.18:0/3844833319 >> 172.21.15.18:0/3844833319 conn(0x7fc0980b2720 msgr2=0x7fc0980ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:15.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- 172.21.15.18:0/3844833319 shutdown_connections 2023-06-09T04:39:15.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- 172.21.15.18:0/3844833319 wait complete. 2023-06-09T04:39:15.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 Processor -- start 2023-06-09T04:39:15.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- start start 2023-06-09T04:39:15.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0981552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc098155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.919 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980c5bb0 0x7fc09815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098155830 con 0x7fc0980b4220 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980c60e0 con 0x7fc0980c5bb0 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09f36c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980c63c0 con 0x7fc0980c9670 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0981552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0981552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40416/0 (socket says 172.21.15.18:40416) 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 -- 172.21.15.18:0/1598482444 learned_addr learned my addr 172.21.15.18:0/1598482444 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09c907640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc098155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.920 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d909640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980c5bb0 0x7fc09815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 -- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 msgr2=0x7fc098155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc098155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 -- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980c5bb0 msgr2=0x7fc09815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980c5bb0 0x7fc09815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 -- 172.21.15.18:0/1598482444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009420 con 0x7fc0980b4220 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09c907640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc098155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:15.921 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.914+0000 7fc09d108640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0981552f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c4d0 tx=0x7fc09400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094005cf0 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094005e50 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094007270 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0980c66a0 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0980c6c60 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0980c6e50 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0940073d0 con 0x7fc0980b4220 2023-06-09T04:39:15.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc08dffb640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc07c0662b0 0x7fc07c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc094083460 con 0x7fc0980b4220 2023-06-09T04:39:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc09c907640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc07c0662b0 0x7fc07c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:15.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.918+0000 7fc09c907640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc07c0662b0 0x7fc07c068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0880ad000 tx=0x7fc088008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:15.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:15.922+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc094050730 con 0x7fc0980b4220 2023-06-09T04:39:16.073 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.070+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc098073380 con 0x7fc0980b4220 2023-06-09T04:39:16.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc08dffb640 1 -- 172.21.15.18:0/1598482444 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7fc094053d50 con 0x7fc0980b4220 2023-06-09T04:39:16.076 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:16.076 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:16.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc07c0662b0 msgr2=0x7fc07c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc07c0662b0 0x7fc07c068760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0880ad000 tx=0x7fc088008040 comp rx=0 tx=0).stop 2023-06-09T04:39:16.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 msgr2=0x7fc0981552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0981552f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c4d0 tx=0x7fc09400c990 comp rx=0 tx=0).stop 2023-06-09T04:39:16.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 shutdown_connections 2023-06-09T04:39:16.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0980c5bb0 0x7fc09815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc07c0662b0 0x7fc07c068760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0980c9670 0x7fc098155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 --2- 172.21.15.18:0/1598482444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0980b4220 0x7fc0981552f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 >> 172.21.15.18:0/1598482444 conn(0x7fc0980b2720 msgr2=0x7fc09815c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 shutdown_connections 2023-06-09T04:39:16.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.074+0000 7fc09f36c640 1 -- 172.21.15.18:0/1598482444 wait complete. 2023-06-09T04:39:16.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:16.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:16.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 Processor -- start 2023-06-09T04:39:16.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 -- start start 2023-06-09T04:39:16.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 0x7f9af40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9af406fbd0 0x7f9af4070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af415bcb0 con 0x7f9af41579a0 2023-06-09T04:39:16.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af4070590 con 0x7f9af406fbd0 2023-06-09T04:39:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9afa58b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40699a0 con 0x7f9af40ad220 2023-06-09T04:39:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af8b28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9af406fbd0 0x7f9af4070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 0x7f9af40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9af41579a0 0x7f9af415b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:57366/0 (socket says 172.21.15.18:57366) 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 0x7f9af40cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:46458/0 (socket says 172.21.15.18:46458) 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af3fff640 1 -- 172.21.15.18:0/1586425367 learned_addr learned my addr 172.21.15.18:0/1586425367 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af8b28640 1 -- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 msgr2=0x7f9af40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af8b28640 1 --2- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 0x7f9af40cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af8b28640 1 -- 172.21.15.18:0/1586425367 >> v1:172.21.15.81:6789/0 conn(0x7f9af41579a0 legacy=0x7f9af415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af8b28640 1 -- 172.21.15.18:0/1586425367 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af415bef0 con 0x7f9af406fbd0 2023-06-09T04:39:16.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.218+0000 7f9af37fe640 1 --2- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 0x7f9af40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:16.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9af8b28640 1 --2- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af4070050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009d90 tx=0x7f9aec01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4bcceab9c58eac7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9af2ffd640 1 -- 172.21.15.18:0/1586425367 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0a5960 con 0x7f9af406fbd0 2023-06-09T04:39:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9af2ffd640 1 -- 172.21.15.18:0/1586425367 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0a5ac0 con 0x7f9af406fbd0 2023-06-09T04:39:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9af2ffd640 1 -- 172.21.15.18:0/1586425367 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0a5e50 con 0x7f9af406fbd0 2023-06-09T04:39:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 -- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 msgr2=0x7f9af4070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 --2- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af4070050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009d90 tx=0x7f9aec01c920 comp rx=0 tx=0).stop 2023-06-09T04:39:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 -- 172.21.15.18:0/1586425367 shutdown_connections 2023-06-09T04:39:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 --2- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af4070050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 --2- 172.21.15.18:0/1586425367 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40ad220 0x7f9af40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 -- 172.21.15.18:0/1586425367 >> 172.21.15.18:0/1586425367 conn(0x7f9af40afa90 msgr2=0x7f9af40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 -- 172.21.15.18:0/1586425367 shutdown_connections 2023-06-09T04:39:16.227 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 -- 172.21.15.18:0/1586425367 wait complete. 2023-06-09T04:39:16.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 Processor -- start 2023-06-09T04:39:16.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.222+0000 7f9afa58b640 1 -- start start 2023-06-09T04:39:16.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af41579a0 0x7f9af40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.228 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 0x7f9af4158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af414cfd0 con 0x7f9af41501f0 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b1270 con 0x7f9af406fbd0 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b1550 con 0x7f9af41579a0 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 0x7f9af4158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 0x7f9af4158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40430/0 (socket says 172.21.15.18:40430) 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 -- 172.21.15.18:0/3213485270 learned_addr learned my addr 172.21.15.18:0/3213485270 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:16.229 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af37fe640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af41579a0 0x7f9af40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af3fff640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 -- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af41579a0 msgr2=0x7f9af40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af41579a0 0x7f9af40b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 -- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 msgr2=0x7f9af414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af414ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.230 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 -- 172.21.15.18:0/3213485270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae800a5c0 con 0x7f9af41501f0 2023-06-09T04:39:16.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af8b28640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 0x7f9af4158d50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009d90 tx=0x7f9aec0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.231 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0aedc0 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec009450 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0b7650 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec009a70 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af40b1b10 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af414d8e0 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9aec0b4050 con 0x7f9af41501f0 2023-06-09T04:39:16.232 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af0ff9640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9ae0066280 0x7f9ae0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.233 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9aec11f280 con 0x7f9af41501f0 2023-06-09T04:39:16.233 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.226+0000 7f9af3fff640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9ae0066280 0x7f9ae0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.233 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.230+0000 7f9af3fff640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9ae0066280 0x7f9ae0068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40058e0 tx=0x7f9ae4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.234 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.230+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9aec0ec380 con 0x7f9af41501f0 2023-06-09T04:39:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.382+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9af4073380 con 0x7f9af41501f0 2023-06-09T04:39:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9af0ff9640 1 -- 172.21.15.18:0/3213485270 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9aec0b20a0 con 0x7f9af41501f0 2023-06-09T04:39:16.388 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9ae0066280 msgr2=0x7f9ae0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9ae0066280 0x7f9ae0068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40058e0 tx=0x7f9ae4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 msgr2=0x7f9af4158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 0x7f9af4158d50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009d90 tx=0x7f9aec0196c0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 shutdown_connections 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9af41501f0 0x7f9af4158d50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9ae0066280 0x7f9ae0068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af41579a0 0x7f9af40b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 --2- 172.21.15.18:0/3213485270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af406fbd0 0x7f9af414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 >> 172.21.15.18:0/3213485270 conn(0x7f9af40afa90 msgr2=0x7f9af4157ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 shutdown_connections 2023-06-09T04:39:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.386+0000 7f9afa58b640 1 -- 172.21.15.18:0/3213485270 wait complete. 2023-06-09T04:39:16.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:16.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 Processor -- start 2023-06-09T04:39:16.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 -- start start 2023-06-09T04:39:16.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15f280 0x7f30bc15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30bc0b39d0 0x7f30bc0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30bc15fd40 con 0x7f30bc15b600 2023-06-09T04:39:16.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc0cfce0 con 0x7f30bc0b39d0 2023-06-09T04:39:16.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30c1ebd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0b4390 con 0x7f30bc15f280 2023-06-09T04:39:16.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bb7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f30bc15b600 0x7f30bc0b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52578/0 (socket says 172.21.15.18:52578) 2023-06-09T04:39:16.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30bc0b39d0 0x7f30bc0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bb7fe640 1 -- 172.21.15.18:0/1936787491 learned_addr learned my addr 172.21.15.18:0/1936787491 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:16.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bbfff640 1 -- 172.21.15.18:0/1936787491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15f280 msgr2=0x7f30bc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30b3fff640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15f280 0x7f30bc15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30baffd640 1 -- 172.21.15.18:0/1936787491 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207976418 0 0) 0x7f30bc15fd40 con 0x7f30bc15b600 2023-06-09T04:39:16.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bbfff640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15f280 0x7f30bc15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bbfff640 1 -- 172.21.15.18:0/1936787491 >> v1:172.21.15.18:6789/0 conn(0x7f30bc15b600 legacy=0x7f30bc0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30bbfff640 1 -- 172.21.15.18:0/1936787491 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc160020 con 0x7f30bc0b39d0 2023-06-09T04:39:16.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.526+0000 7f30b3fff640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15f280 0x7f30bc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30bbfff640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc0b3e50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009d90 tx=0x7f30b401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868938051b5715fd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30baffd640 1 -- 172.21.15.18:0/1936787491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40a5870 con 0x7f30bc0b39d0 2023-06-09T04:39:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30baffd640 1 -- 172.21.15.18:0/1936787491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b40a59d0 con 0x7f30bc0b39d0 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30baffd640 1 -- 172.21.15.18:0/1936787491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40a5d60 con 0x7f30bc0b39d0 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- 172.21.15.18:0/1936787491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 msgr2=0x7f30bc0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc0b3e50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009d90 tx=0x7f30b401c8c0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- 172.21.15.18:0/1936787491 shutdown_connections 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc0b3e50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/1936787491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15f280 0x7f30bc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- 172.21.15.18:0/1936787491 >> 172.21.15.18:0/1936787491 conn(0x7f30bc0d2120 msgr2=0x7f30bc0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- 172.21.15.18:0/1936787491 shutdown_connections 2023-06-09T04:39:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- 172.21.15.18:0/1936787491 wait complete. 2023-06-09T04:39:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 Processor -- start 2023-06-09T04:39:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- start start 2023-06-09T04:39:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15b600 0x7f30bc0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc15f280 0x7f30bc0b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0c83a0 con 0x7f30bc0b39d0 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc15e160 con 0x7f30bc15f280 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30c1ebd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc15e440 con 0x7f30bc15b600 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30bb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.530+0000 7f30bb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40446/0 (socket says 172.21.15.18:40446) 2023-06-09T04:39:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 -- 172.21.15.18:0/3445233355 learned_addr learned my addr 172.21.15.18:0/3445233355 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b3fff640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15b600 0x7f30bc0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bbfff640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc15f280 0x7f30bc0b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 -- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15b600 msgr2=0x7f30bc0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15b600 0x7f30bc0c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 -- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc15f280 msgr2=0x7f30bc0b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc15f280 0x7f30bc0b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 -- 172.21.15.18:0/3445233355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4009a70 con 0x7f30bc0b39d0 2023-06-09T04:39:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30bb7fe640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc1504a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0011f0 tx=0x7f30ac00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0074e0 con 0x7f30bc0b39d0 2023-06-09T04:39:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac007640 con 0x7f30bc0b39d0 2023-06-09T04:39:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc15e720 con 0x7f30bc0b39d0 2023-06-09T04:39:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac004a10 con 0x7f30bc0b39d0 2023-06-09T04:39:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc155c60 con 0x7f30bc0b39d0 2023-06-09T04:39:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc155e80 con 0x7f30bc0b39d0 2023-06-09T04:39:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30ac004b70 con 0x7f30bc0b39d0 2023-06-09T04:39:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b8ff9640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f309c066280 0x7f309c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f30ac0833a0 con 0x7f30bc0b39d0 2023-06-09T04:39:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b3fff640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f309c066280 0x7f309c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.534+0000 7f30b3fff640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f309c066280 0x7f309c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30a4006fd0 tx=0x7f30a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.538+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30ac050490 con 0x7f30bc0b39d0 2023-06-09T04:39:16.693 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.690+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30bc073380 con 0x7f30bc0b39d0 2023-06-09T04:39:16.694 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.690+0000 7f30b8ff9640 1 -- 172.21.15.18:0/3445233355 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30ac0180a0 con 0x7f30bc0b39d0 2023-06-09T04:39:16.694 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f309c066280 msgr2=0x7f309c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f309c066280 0x7f309c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30a4006fd0 tx=0x7f30a4008040 comp rx=0 tx=0).stop 2023-06-09T04:39:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 msgr2=0x7f30bc1504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc1504a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0011f0 tx=0x7f30ac00c9b0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 shutdown_connections 2023-06-09T04:39:16.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc15f280 0x7f30bc0b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f309c066280 0x7f309c068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30bc15b600 0x7f30bc0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 --2- 172.21.15.18:0/3445233355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0b39d0 0x7f30bc1504a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 >> 172.21.15.18:0/3445233355 conn(0x7f30bc0d2120 msgr2=0x7f30bc0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 shutdown_connections 2023-06-09T04:39:16.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.694+0000 7f30c1ebd640 1 -- 172.21.15.18:0/3445233355 wait complete. 2023-06-09T04:39:16.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 Processor -- start 2023-06-09T04:39:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 -- start start 2023-06-09T04:39:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 0x7fdef815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdef80b39d0 0x7fdef80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef815fd40 con 0x7fdef815b600 2023-06-09T04:39:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80cfce0 con 0x7fdef80b39d0 2023-06-09T04:39:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeff925640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b4390 con 0x7fdef815f280 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefd6c1640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdef815b600 0x7fdef80b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52582/0 (socket says 172.21.15.18:52582) 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefd6c1640 1 -- 172.21.15.18:0/3269267278 learned_addr learned my addr 172.21.15.18:0/3269267278 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 0x7fdef815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefdec2640 1 --2- 172.21.15.18:0/3269267278 >> v2:172.21.15.81:3300/0 conn(0x7fdef80b39d0 0x7fdef80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491283996 0 0) 0x7fdef815fd40 con 0x7fdef815b600 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee4003530 con 0x7fdef815b600 2023-06-09T04:39:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551574457 0 0) 0x7fdee4003530 con 0x7fdef815b600 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 msgr2=0x7fdef815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 0x7fdef815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 >> v2:172.21.15.81:3300/0 conn(0x7fdef80b39d0 msgr2=0x7fdef80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 --2- 172.21.15.18:0/3269267278 >> v2:172.21.15.81:3300/0 conn(0x7fdef80b39d0 0x7fdef80b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8160020 con 0x7fdef815b600 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fdef4001680 con 0x7fdef815b600 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 >> v1:172.21.15.18:6789/0 conn(0x7fdef815b600 legacy=0x7fdef80b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 0x7fdee4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdee4003f00 0x7fdee40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4004d10 0x7fdee4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80cfce0 con 0x7fdee4003f00 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b4390 con 0x7fdee4004d10 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee400b9c0 con 0x7fdef815f280 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdee4003f00 0x7fdee40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefdec2640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4004d10 0x7fdee4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefd6c1640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 0x7fdee4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 -- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 msgr2=0x7fdee4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef815f280 0x7fdee4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 -- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4004d10 msgr2=0x7fdee4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4004d10 0x7fdee4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.826+0000 7fdefcec0640 1 -- 172.21.15.18:0/3269267278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4003530 con 0x7fdee4003f00 2023-06-09T04:39:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefcec0640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdee4003f00 0x7fdee40047d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009ae0 tx=0x7fdee801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3de3075313379d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80a6430 con 0x7fdee4003f00 2023-06-09T04:39:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80a6590 con 0x7fdee4003f00 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeeffff640 1 -- 172.21.15.18:0/3269267278 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80a6940 con 0x7fdee4003f00 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- 172.21.15.18:0/3269267278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdee4003f00 msgr2=0x7fdee40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 --2- 172.21.15.18:0/3269267278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdee4003f00 0x7fdee40047d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009ae0 tx=0x7fdee801c9f0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 -- 172.21.15.18:0/3269267278 reap_dead start 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- 172.21.15.18:0/3269267278 shutdown_connections 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- 172.21.15.18:0/3269267278 >> 172.21.15.18:0/3269267278 conn(0x7fdef80d2120 msgr2=0x7fdef80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- 172.21.15.18:0/3269267278 shutdown_connections 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- 172.21.15.18:0/3269267278 wait complete. 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 Processor -- start 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- start start 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef81497d0 0x7fdef80cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef8149ba0 0x7fdef80cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 0x7fdef80ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef815c8c0 con 0x7fdef80c9eb0 2023-06-09T04:39:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef815bcd0 con 0x7fdef81497d0 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdeff925640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef815bf20 con 0x7fdef8149ba0 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 0x7fdef80ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 0x7fdef80ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52408/0 (socket says 172.21.15.18:52408) 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 -- 172.21.15.18:0/1386484195 learned_addr learned my addr 172.21.15.18:0/1386484195 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefcec0640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef8149ba0 0x7fdef80cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefd6c1640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef81497d0 0x7fdef80cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 -- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef8149ba0 msgr2=0x7fdef80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef8149ba0 0x7fdef80cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 -- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef81497d0 msgr2=0x7fdef80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef81497d0 0x7fdef80cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefdec2640 1 -- 172.21.15.18:0/1386484195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef815c200 con 0x7fdef80c9eb0 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.830+0000 7fdefd6c1640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef81497d0 0x7fdef80cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdefdec2640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 0x7fdef80ca320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdef80ce930 tx=0x7fdef0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000e070 con 0x7fdef80c9eb0 2023-06-09T04:39:16.840 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0003c70 con 0x7fdef80c9eb0 2023-06-09T04:39:16.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef815c4e0 con 0x7fdef80c9eb0 2023-06-09T04:39:16.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0003e60 con 0x7fdef80c9eb0 2023-06-09T04:39:16.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef80ca860 con 0x7fdef80c9eb0 2023-06-09T04:39:16.841 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef815ca00 con 0x7fdef80c9eb0 2023-06-09T04:39:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdef0004030 con 0x7fdef80c9eb0 2023-06-09T04:39:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeedffb640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdedc066280 0x7fdedc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdef0083f60 con 0x7fdef80c9eb0 2023-06-09T04:39:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdefd6c1640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdedc066280 0x7fdedc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.834+0000 7fdefd6c1640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdedc066280 0x7fdedc068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdef4000fc0 tx=0x7fdef4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.838+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdef815ca00 con 0x7fdef80c9eb0 2023-06-09T04:39:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.982+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdef815ca00 con 0x7fdef80c9eb0 2023-06-09T04:39:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeedffb640 1 -- 172.21.15.18:0/1386484195 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdef815ca00 con 0x7fdef80c9eb0 2023-06-09T04:39:16.987 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdedc066280 msgr2=0x7fdedc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdedc066280 0x7fdedc068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdef4000fc0 tx=0x7fdef4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 msgr2=0x7fdef80ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 0x7fdef80ca320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdef80ce930 tx=0x7fdef0007dd0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 shutdown_connections 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdef80c9eb0 0x7fdef80ca320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdedc066280 0x7fdedc068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdef8149ba0 0x7fdef80cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 --2- 172.21.15.18:0/1386484195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef81497d0 0x7fdef80cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 >> 172.21.15.18:0/1386484195 conn(0x7fdef80d2120 msgr2=0x7fdef80b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 shutdown_connections 2023-06-09T04:39:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:16.986+0000 7fdeff925640 1 -- 172.21.15.18:0/1386484195 wait complete. 2023-06-09T04:39:17.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fde00f40640 1 Processor -- start 2023-06-09T04:39:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fde00f40640 1 -- start start 2023-06-09T04:39:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fde00f40640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddfc159590 0x7fddfc069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fde00f40640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc15de50 con 0x7fddfc1591c0 2023-06-09T04:39:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fde00f40640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc15d2d0 con 0x7fddfc0cbd40 2023-06-09T04:39:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fde00f40640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc15d5b0 con 0x7fddfc159590 2023-06-09T04:39:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fddfa59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fddfc1591c0 0x7fddfc0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43410/0 (socket says 172.21.15.18:43410) 2023-06-09T04:39:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fddfa59c640 1 -- 172.21.15.18:0/1978370166 learned_addr learned my addr 172.21.15.18:0/1978370166 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.118+0000 7fddfad9d640 1 --2- 172.21.15.18:0/1978370166 >> v2:172.21.15.18:3300/0 conn(0x7fddfc159590 0x7fddfc069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddf959a640 1 -- 172.21.15.18:0/1978370166 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957966487 0 0) 0x7fddfc15de50 con 0x7fddfc1591c0 2023-06-09T04:39:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddf959a640 1 -- 172.21.15.18:0/1978370166 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde4003530 con 0x7fddfc1591c0 2023-06-09T04:39:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddfad9d640 1 -- 172.21.15.18:0/1978370166 >> v1:172.21.15.81:6789/0 conn(0x7fddfc0cbd40 legacy=0x7fddfc069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddfad9d640 1 -- 172.21.15.18:0/1978370166 >> v1:172.21.15.18:6789/0 conn(0x7fddfc1591c0 legacy=0x7fddfc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddfad9d640 1 -- 172.21.15.18:0/1978370166 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc15d890 con 0x7fddfc159590 2023-06-09T04:39:17.125 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddfad9d640 1 --2- 172.21.15.18:0/1978370166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc159590 0x7fddfc069d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009d90 tx=0x7fddf401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951af43e64c8fa0e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddf959a640 1 -- 172.21.15.18:0/1978370166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40a5940 con 0x7fddfc159590 2023-06-09T04:39:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddf959a640 1 -- 172.21.15.18:0/1978370166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf40a5aa0 con 0x7fddfc159590 2023-06-09T04:39:17.126 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fddf959a640 1 -- 172.21.15.18:0/1978370166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40a5e30 con 0x7fddfc159590 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 -- 172.21.15.18:0/1978370166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc159590 msgr2=0x7fddfc069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 --2- 172.21.15.18:0/1978370166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc159590 0x7fddfc069d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009d90 tx=0x7fddf401c920 comp rx=0 tx=0).stop 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 -- 172.21.15.18:0/1978370166 shutdown_connections 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 --2- 172.21.15.18:0/1978370166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc159590 0x7fddfc069d10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 -- 172.21.15.18:0/1978370166 >> 172.21.15.18:0/1978370166 conn(0x7fddfc0afa90 msgr2=0x7fddfc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 -- 172.21.15.18:0/1978370166 shutdown_connections 2023-06-09T04:39:17.127 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.122+0000 7fde00f40640 1 -- 172.21.15.18:0/1978370166 wait complete. 2023-06-09T04:39:17.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 Processor -- start 2023-06-09T04:39:17.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- start start 2023-06-09T04:39:17.129 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddfc0cbd40 0x7fddfc155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 0x7fddfc14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fddfc159590 0x7fddfc14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc154ac0 con 0x7fddfc1591c0 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc154da0 con 0x7fddfc0cbd40 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc155080 con 0x7fddfc159590 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 0x7fddfc14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 0x7fddfc14d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52430/0 (socket says 172.21.15.18:52430) 2023-06-09T04:39:17.130 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 -- 172.21.15.18:0/2507916107 learned_addr learned my addr 172.21.15.18:0/2507916107 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddfa59c640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddfc0cbd40 0x7fddfc155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddfad9d640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fddfc159590 0x7fddfc14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 -- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fddfc159590 msgr2=0x7fddfc14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fddfc159590 0x7fddfc14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 -- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddfc0cbd40 msgr2=0x7fddfc155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddfc0cbd40 0x7fddfc155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 -- 172.21.15.18:0/2507916107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4009a70 con 0x7fddfc1591c0 2023-06-09T04:39:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddf9d9b640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 0x7fddfc14d2b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c4d0 tx=0x7fddf000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00052d0 con 0x7fddfc1591c0 2023-06-09T04:39:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0005430 con 0x7fddfc1591c0 2023-06-09T04:39:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc15a440 con 0x7fddfc1591c0 2023-06-09T04:39:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0012830 con 0x7fddfc1591c0 2023-06-09T04:39:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc155f90 con 0x7fddfc1591c0 2023-06-09T04:39:17.133 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc15a8f0 con 0x7fddfc1591c0 2023-06-09T04:39:17.133 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddf0012990 con 0x7fddfc1591c0 2023-06-09T04:39:17.133 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddeaffd640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdddc0662b0 0x7fdddc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.133 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.126+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddf0083a70 con 0x7fddfc1591c0 2023-06-09T04:39:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.130+0000 7fddfa59c640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdddc0662b0 0x7fdddc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.130+0000 7fddfa59c640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdddc0662b0 0x7fdddc068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fddec007fd0 tx=0x7fddec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.134+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddf0050c90 con 0x7fddfc1591c0 2023-06-09T04:39:17.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.286+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddfc0ccbd0 con 0x7fddfc1591c0 2023-06-09T04:39:17.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.286+0000 7fddeaffd640 1 -- 172.21.15.18:0/2507916107 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fddf00542b0 con 0x7fddfc1591c0 2023-06-09T04:39:17.291 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:17.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdddc0662b0 msgr2=0x7fdddc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdddc0662b0 0x7fdddc068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fddec007fd0 tx=0x7fddec009040 comp rx=0 tx=0).stop 2023-06-09T04:39:17.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 msgr2=0x7fddfc14d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 0x7fddfc14d2b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c4d0 tx=0x7fddf000c990 comp rx=0 tx=0).stop 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 shutdown_connections 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdddc0662b0 0x7fdddc068760 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fddfc159590 0x7fddfc14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddfc1591c0 0x7fddfc14d2b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 --2- 172.21.15.18:0/2507916107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddfc0cbd40 0x7fddfc155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 >> 172.21.15.18:0/2507916107 conn(0x7fddfc0afa90 msgr2=0x7fddfc157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 shutdown_connections 2023-06-09T04:39:17.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.290+0000 7fde00f40640 1 -- 172.21.15.18:0/2507916107 wait complete. 2023-06-09T04:39:17.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:17.435 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 Processor -- start 2023-06-09T04:39:17.436 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 -- start start 2023-06-09T04:39:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa88815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa8880c3940 0x7fa8880c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880cc450 con 0x7fa8881595d0 2023-06-09T04:39:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88815ce40 con 0x7fa8880c3940 2023-06-09T04:39:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88fe65640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880c42f0 con 0x7fa888155d20 2023-06-09T04:39:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88d400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa8881595d0 0x7fa88806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43416/0 (socket says 172.21.15.18:43416) 2023-06-09T04:39:17.438 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88d400640 1 -- 172.21.15.18:0/3944654866 learned_addr learned my addr 172.21.15.18:0/3944654866 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:17.439 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88e402640 1 --2- 172.21.15.18:0/3944654866 >> v2:172.21.15.81:3300/0 conn(0x7fa8880c3940 0x7fa8880c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.439 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa88815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.439 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935139925 0 0) 0x7fa8880cc450 con 0x7fa8881595d0 2023-06-09T04:39:17.439 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa874003530 con 0x7fa8881595d0 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418996789 0 0) 0x7fa874003530 con 0x7fa8881595d0 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 msgr2=0x7fa88815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa88815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 >> v2:172.21.15.81:3300/0 conn(0x7fa8880c3940 msgr2=0x7fa8880c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 --2- 172.21.15.18:0/3944654866 >> v2:172.21.15.81:3300/0 conn(0x7fa8880c3940 0x7fa8880c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88815c880 con 0x7fa8881595d0 2023-06-09T04:39:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fa884001680 con 0x7fa8881595d0 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 >> v1:172.21.15.18:6789/0 conn(0x7fa8881595d0 legacy=0x7fa88806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874003980 0x7fa874003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa8740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8740042d0 0x7fa874004d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815ce40 con 0x7fa874003980 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880c42f0 con 0x7fa8740042d0 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874005550 con 0x7fa888155d20 2023-06-09T04:39:17.441 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874003980 0x7fa874003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88d400640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa8740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88e402640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8740042d0 0x7fa874004d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 -- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 msgr2=0x7fa8740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa8740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 -- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8740042d0 msgr2=0x7fa874004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8740042d0 0x7fa874004d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88dc01640 1 -- 172.21.15.18:0/3944654866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874003530 con 0x7fa874003980 2023-06-09T04:39:17.442 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.434+0000 7fa88d400640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888155d20 0x7fa8740047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88dc01640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874003980 0x7fa874003d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa878009ac0 tx=0x7fa87801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11e91ad5764a786 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780059a0 con 0x7fa874003980 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878005b00 con 0x7fa874003980 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88cbff640 1 -- 172.21.15.18:0/3944654866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878006030 con 0x7fa874003980 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 -- 172.21.15.18:0/3944654866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874003980 msgr2=0x7fa874003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 --2- 172.21.15.18:0/3944654866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874003980 0x7fa874003d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa878009ac0 tx=0x7fa87801c940 comp rx=0 tx=0).stop 2023-06-09T04:39:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88e402640 1 -- 172.21.15.18:0/3944654866 reap_dead start 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 -- 172.21.15.18:0/3944654866 shutdown_connections 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 -- 172.21.15.18:0/3944654866 >> 172.21.15.18:0/3944654866 conn(0x7fa8880afa90 msgr2=0x7fa8880afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 -- 172.21.15.18:0/3944654866 shutdown_connections 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 -- 172.21.15.18:0/3944654866 wait complete. 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 Processor -- start 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.438+0000 7fa88fe65640 1 -- start start 2023-06-09T04:39:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 0x7fa8880ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888143090 0x7fa8880cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa888145690 0x7fa888145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa888143590 con 0x7fa888142cc0 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880b1610 con 0x7fa888145690 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881463c0 con 0x7fa888143090 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 0x7fa8880ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 0x7fa8880ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52452/0 (socket says 172.21.15.18:52452) 2023-06-09T04:39:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 -- 172.21.15.18:0/4090680949 learned_addr learned my addr 172.21.15.18:0/4090680949 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88d400640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888143090 0x7fa8880cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88e402640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa888145690 0x7fa888145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 -- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888143090 msgr2=0x7fa8880cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888143090 0x7fa8880cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 -- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa888145690 msgr2=0x7fa888145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa888145690 0x7fa888145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 -- 172.21.15.18:0/4090680949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8881437a0 con 0x7fa888142cc0 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88d400640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888143090 0x7fa8880cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88dc01640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 0x7fa8880ccdd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af040 tx=0x7fa8780196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780bd070 con 0x7fa888142cc0 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800f000 con 0x7fa888142cc0 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa888143a80 con 0x7fa888142cc0 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780059a0 con 0x7fa888142cc0 2023-06-09T04:39:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa888146070 con 0x7fa888142cc0 2023-06-09T04:39:17.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa878006730 con 0x7fa888142cc0 2023-06-09T04:39:17.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888070ae0 con 0x7fa888142cc0 2023-06-09T04:39:17.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa87e7fc640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa86c0662b0 0x7fa86c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa87811dce0 con 0x7fa888142cc0 2023-06-09T04:39:17.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.442+0000 7fa88d400640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa86c0662b0 0x7fa86c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.446+0000 7fa88d400640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa86c0662b0 0x7fa86c068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa8880b12a0 tx=0x7fa884001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.451 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.446+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8780eaf00 con 0x7fa888142cc0 2023-06-09T04:39:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.594+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa888070ae0 con 0x7fa888142cc0 2023-06-09T04:39:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.594+0000 7fa87e7fc640 1 -- 172.21.15.18:0/4090680949 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa8780ee520 con 0x7fa888142cc0 2023-06-09T04:39:17.598 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa86c0662b0 msgr2=0x7fa86c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa86c0662b0 0x7fa86c068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa8880b12a0 tx=0x7fa884001df0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 msgr2=0x7fa8880ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 0x7fa8880ccdd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af040 tx=0x7fa8780196e0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 shutdown_connections 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa888145690 0x7fa888145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa86c0662b0 0x7fa86c068760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa888143090 0x7fa8880cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 --2- 172.21.15.18:0/4090680949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa888142cc0 0x7fa8880ccdd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 >> 172.21.15.18:0/4090680949 conn(0x7fa8880afa90 msgr2=0x7fa8880cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 shutdown_connections 2023-06-09T04:39:17.602 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.598+0000 7fa88fe65640 1 -- 172.21.15.18:0/4090680949 wait complete. 2023-06-09T04:39:17.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:17.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 Processor -- start 2023-06-09T04:39:17.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 -- start start 2023-06-09T04:39:17.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 0x7f08a815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08a815d680 0x7f08a806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a815cf10 con 0x7f08a815dad0 2023-06-09T04:39:17.725 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a815a920 con 0x7f08a815d680 2023-06-09T04:39:17.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08ae156640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a80c81b0 con 0x7f08a8159320 2023-06-09T04:39:17.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 0x7f08a815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.726 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f089ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08a815d680 0x7f08a806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 0x7f08a815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:34292/0 (socket says 172.21.15.18:34292) 2023-06-09T04:39:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 -- 172.21.15.18:0/3220223100 learned_addr learned my addr 172.21.15.18:0/3220223100 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 -- 172.21.15.18:0/3220223100 >> v2:172.21.15.81:3300/0 conn(0x7f08a815d680 msgr2=0x7f08a806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 --2- 172.21.15.18:0/3220223100 >> v2:172.21.15.81:3300/0 conn(0x7f08a815d680 0x7f08a806fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 -- 172.21.15.18:0/3220223100 >> v1:172.21.15.81:6789/0 conn(0x7f08a815dad0 legacy=0x7f08a80692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.722+0000 7f08a77fe640 1 -- 172.21.15.18:0/3220223100 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80c8490 con 0x7f08a8159320 2023-06-09T04:39:17.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08a77fe640 1 --2- 172.21.15.18:0/3220223100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 0x7f08a815a3e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0898009870 tx=0x7f089801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533a9fb88eaef0cd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08a6ffd640 1 -- 172.21.15.18:0/3220223100 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08980ab680 con 0x7f08a8159320 2023-06-09T04:39:17.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08a6ffd640 1 -- 172.21.15.18:0/3220223100 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08980ab7e0 con 0x7f08a8159320 2023-06-09T04:39:17.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08a6ffd640 1 -- 172.21.15.18:0/3220223100 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08980abb70 con 0x7f08a8159320 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 -- 172.21.15.18:0/3220223100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 msgr2=0x7f08a815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 --2- 172.21.15.18:0/3220223100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 0x7f08a815a3e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0898009870 tx=0x7f089801c480 comp rx=0 tx=0).stop 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 -- 172.21.15.18:0/3220223100 shutdown_connections 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 --2- 172.21.15.18:0/3220223100 >> v2:172.21.15.81:3300/0 conn(0x7f08a815d680 0x7f08a806fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 --2- 172.21.15.18:0/3220223100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a8159320 0x7f08a815a3e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 -- 172.21.15.18:0/3220223100 >> 172.21.15.18:0/3220223100 conn(0x7f08a80b0240 msgr2=0x7f08a80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 -- 172.21.15.18:0/3220223100 shutdown_connections 2023-06-09T04:39:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 -- 172.21.15.18:0/3220223100 wait complete. 2023-06-09T04:39:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 Processor -- start 2023-06-09T04:39:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.726+0000 7f08ae156640 1 -- start start 2023-06-09T04:39:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a8159320 0x7f08a814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a815d680 0x7f08a8153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 0x7f08a80c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a81537b0 con 0x7f08a815dad0 2023-06-09T04:39:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a814d990 con 0x7f08a8159320 2023-06-09T04:39:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a814dc70 con 0x7f08a815d680 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 0x7f08a80c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 0x7f08a80c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52462/0 (socket says 172.21.15.18:52462) 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 -- 172.21.15.18:0/514429355 learned_addr learned my addr 172.21.15.18:0/514429355 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a77fe640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a8159320 0x7f08a814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f089ffff640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a815d680 0x7f08a8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 -- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a815d680 msgr2=0x7f08a8153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a815d680 0x7f08a8153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 -- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a8159320 msgr2=0x7f08a814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a8159320 0x7f08a814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 -- 172.21.15.18:0/514429355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980094d0 con 0x7f08a815dad0 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a7fff640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 0x7f08a80c3a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c730 tx=0x7f08a000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0006d60 con 0x7f08a815dad0 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0003980 con 0x7f08a815dad0 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a814df50 con 0x7f08a815dad0 2023-06-09T04:39:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0003d30 con 0x7f08a815dad0 2023-06-09T04:39:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a814e510 con 0x7f08a815dad0 2023-06-09T04:39:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a815a470 con 0x7f08a815dad0 2023-06-09T04:39:17.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08a00050d0 con 0x7f08a815dad0 2023-06-09T04:39:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a4ff9640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0888066280 0x7f0888068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08a0083af0 con 0x7f08a815dad0 2023-06-09T04:39:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.730+0000 7f08a77fe640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0888066280 0x7f0888068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.734+0000 7f08a77fe640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0888066280 0x7f0888068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08980af000 tx=0x7f08980b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.738+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08a0054720 con 0x7f08a815dad0 2023-06-09T04:39:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.902+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f08a80ce690 con 0x7f08a815dad0 2023-06-09T04:39:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.902+0000 7f08a4ff9640 1 -- 172.21.15.18:0/514429355 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f08a00542b0 con 0x7f08a815dad0 2023-06-09T04:39:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0888066280 msgr2=0x7f0888068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0888066280 0x7f0888068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08980af000 tx=0x7f08980b6040 comp rx=0 tx=0).stop 2023-06-09T04:39:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 msgr2=0x7f08a80c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 0x7f08a80c3a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f08a000c730 tx=0x7f08a000cb30 comp rx=0 tx=0).stop 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 shutdown_connections 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08a815dad0 0x7f08a80c3a10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0888066280 0x7f0888068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08a815d680 0x7f08a8153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 --2- 172.21.15.18:0/514429355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a8159320 0x7f08a814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 >> 172.21.15.18:0/514429355 conn(0x7f08a80b0240 msgr2=0x7f08a8159870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 shutdown_connections 2023-06-09T04:39:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:17.906+0000 7f08ae156640 1 -- 172.21.15.18:0/514429355 wait complete. 2023-06-09T04:39:17.924 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:39:17.925 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:17.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:18.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 Processor -- start 2023-06-09T04:39:18.095 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 -- start start 2023-06-09T04:39:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e9c15a3e0 0x7f4e9c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c0700a0 0x7f4e9c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c15cf10 con 0x7f4e9c159320 2023-06-09T04:39:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c070520 con 0x7f4e9c15a3e0 2023-06-09T04:39:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4ea208e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c15dd90 con 0x7f4e9c0700a0 2023-06-09T04:39:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e9c15a3e0 0x7f4e9c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4e9c159320 0x7f4e9c15d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43428/0 (socket says 172.21.15.18:43428) 2023-06-09T04:39:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9b7fe640 1 -- 172.21.15.18:0/3057338755 learned_addr learned my addr 172.21.15.18:0/3057338755 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9affd640 1 -- 172.21.15.18:0/3057338755 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c0700a0 msgr2=0x7f4e9c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9bfff640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c0700a0 0x7f4e9c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9affd640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c0700a0 0x7f4e9c06bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9affd640 1 -- 172.21.15.18:0/3057338755 >> v1:172.21.15.18:6789/0 conn(0x7f4e9c159320 legacy=0x7f4e9c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9affd640 1 -- 172.21.15.18:0/3057338755 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0c81b0 con 0x7f4e9c15a3e0 2023-06-09T04:39:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9a7fc640 1 -- 172.21.15.18:0/3057338755 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207839946 0 0) 0x7f4e9c15cf10 con 0x7f4e9c159320 2023-06-09T04:39:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9bfff640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c0700a0 0x7f4e9c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:18.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9affd640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c15a3e0 0x7f4e9c06fb60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0097c0 tx=0x7f4e8c01c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58f2dd7bfdc9675 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9a7fc640 1 -- 172.21.15.18:0/3057338755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0ab600 con 0x7f4e9c15a3e0 2023-06-09T04:39:18.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9a7fc640 1 -- 172.21.15.18:0/3057338755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c0a7050 con 0x7f4e9c15a3e0 2023-06-09T04:39:18.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.094+0000 7f4e9a7fc640 1 -- 172.21.15.18:0/3057338755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0ab980 con 0x7f4e9c15a3e0 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/3057338755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c15a3e0 msgr2=0x7f4e9c06fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c15a3e0 0x7f4e9c06fb60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0097c0 tx=0x7f4e8c01c100 comp rx=0 tx=0).stop 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/3057338755 shutdown_connections 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c0700a0 0x7f4e9c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 --2- 172.21.15.18:0/3057338755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c15a3e0 0x7f4e9c06fb60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/3057338755 >> 172.21.15.18:0/3057338755 conn(0x7f4e9c0b0240 msgr2=0x7f4e9c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/3057338755 shutdown_connections 2023-06-09T04:39:18.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/3057338755 wait complete. 2023-06-09T04:39:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 Processor -- start 2023-06-09T04:39:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- start start 2023-06-09T04:39:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 0x7f4e9c0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c159320 0x7f4e9c0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c15a3e0 0x7f4e9c0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0cd3c0 con 0x7f4e9c0700a0 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0cbde0 con 0x7f4e9c159320 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0cc0c0 con 0x7f4e9c15a3e0 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 0x7f4e9c0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 0x7f4e9c0cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52488/0 (socket says 172.21.15.18:52488) 2023-06-09T04:39:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 -- 172.21.15.18:0/736591847 learned_addr learned my addr 172.21.15.18:0/736591847 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9affd640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c159320 0x7f4e9c0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9bfff640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c15a3e0 0x7f4e9c0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 -- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c15a3e0 msgr2=0x7f4e9c0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c15a3e0 0x7f4e9c0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 -- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c159320 msgr2=0x7f4e9c0cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c159320 0x7f4e9c0cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 -- 172.21.15.18:0/736591847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c009420 con 0x7f4e9c0700a0 2023-06-09T04:39:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9affd640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c159320 0x7f4e9c0cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e9b7fe640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 0x7f4e9c0cce80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e840011f0 tx=0x7f4e8400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840074e0 con 0x7f4e9c0700a0 2023-06-09T04:39:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84007640 con 0x7f4e9c0700a0 2023-06-09T04:39:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c0cc3a0 con 0x7f4e9c0700a0 2023-06-09T04:39:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84004a10 con 0x7f4e9c0700a0 2023-06-09T04:39:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.098+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c0cc960 con 0x7f4e9c0700a0 2023-06-09T04:39:18.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.102+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c0cbb90 con 0x7f4e9c0700a0 2023-06-09T04:39:18.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.102+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e84004b70 con 0x7f4e9c0700a0 2023-06-09T04:39:18.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.102+0000 7f4e93fff640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e7c066280 0x7f4e7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.102+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e840835d0 con 0x7f4e9c0700a0 2023-06-09T04:39:18.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.102+0000 7f4e9affd640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e7c066280 0x7f4e7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.102+0000 7f4e9affd640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e7c066280 0x7f4e7c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0ad000 tx=0x7f4e8c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.106+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e84050760 con 0x7f4e9c0700a0 2023-06-09T04:39:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.254+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e9c06bf70 con 0x7f4e9c0700a0 2023-06-09T04:39:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4e93fff640 1 -- 172.21.15.18:0/736591847 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f4e84053d80 con 0x7f4e9c0700a0 2023-06-09T04:39:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:18.260 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:18.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e7c066280 msgr2=0x7f4e7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e7c066280 0x7f4e7c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0ad000 tx=0x7f4e8c0a6000 comp rx=0 tx=0).stop 2023-06-09T04:39:18.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 msgr2=0x7f4e9c0cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 0x7f4e9c0cce80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e840011f0 tx=0x7f4e8400c9b0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 shutdown_connections 2023-06-09T04:39:18.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4e7c066280 0x7f4e7c068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4e9c15a3e0 0x7f4e9c0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c159320 0x7f4e9c0cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 --2- 172.21.15.18:0/736591847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e9c0700a0 0x7f4e9c0cce80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 >> 172.21.15.18:0/736591847 conn(0x7f4e9c0b0240 msgr2=0x7f4e9c064fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 shutdown_connections 2023-06-09T04:39:18.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.258+0000 7f4ea208e640 1 -- 172.21.15.18:0/736591847 wait complete. 2023-06-09T04:39:18.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:18.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:18.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 Processor -- start 2023-06-09T04:39:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 -- start start 2023-06-09T04:39:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5540b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5540cf890 0x7ff5540cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff554159980 con 0x7ff5540cc9a0 2023-06-09T04:39:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5540cbfc0 con 0x7ff5540cf890 2023-06-09T04:39:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff558dc8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540ce710 con 0x7ff5541595b0 2023-06-09T04:39:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff5540cc9a0 0x7ff5540b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43438/0 (socket says 172.21.15.18:43438) 2023-06-09T04:39:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 -- 172.21.15.18:0/2705302039 learned_addr learned my addr 172.21.15.18:0/2705302039 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55259c640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5540b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff551d9b640 1 --2- 172.21.15.18:0/2705302039 >> v2:172.21.15.81:3300/0 conn(0x7ff5540cf890 0x7ff5540cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939438066 0 0) 0x7ff554159980 con 0x7ff5540cc9a0 2023-06-09T04:39:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff540003530 con 0x7ff5540cc9a0 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874349373 0 0) 0x7ff540003530 con 0x7ff5540cc9a0 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 msgr2=0x7ff5540b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5540b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 >> v2:172.21.15.81:3300/0 conn(0x7ff5540cf890 msgr2=0x7ff5540cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 --2- 172.21.15.18:0/2705302039 >> v2:172.21.15.81:3300/0 conn(0x7ff5540cf890 0x7ff5540cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540cabb0 con 0x7ff5540cc9a0 2023-06-09T04:39:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7ff54c001a00 con 0x7ff5540cc9a0 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 >> v1:172.21.15.18:6789/0 conn(0x7ff5540cc9a0 legacy=0x7ff5540b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff540003980 0x7ff540003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff540005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540cbfc0 con 0x7ff540004d10 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5540ce710 con 0x7ff540003980 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54000b990 con 0x7ff5541595b0 2023-06-09T04:39:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff540005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff55259c640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff540003980 0x7ff540003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff551d9b640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 -- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 msgr2=0x7ff5400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 -- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff540003980 msgr2=0x7ff540003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff540003980 0x7ff540003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff552d9d640 1 -- 172.21.15.18:0/2705302039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540003530 con 0x7ff540004d10 2023-06-09T04:39:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.402+0000 7ff551d9b640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff5541595b0 0x7ff5400047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff552d9d640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff540005180 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00a8d0 tx=0x7ff54c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe54134e8a34a47 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0ad630 con 0x7ff540004d10 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0a8070 con 0x7ff540004d10 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff55159a640 1 -- 172.21.15.18:0/2705302039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0ad9d0 con 0x7ff540004d10 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 -- 172.21.15.18:0/2705302039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 msgr2=0x7ff540005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 --2- 172.21.15.18:0/2705302039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff540005180 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00a8d0 tx=0x7ff54c01d380 comp rx=0 tx=0).stop 2023-06-09T04:39:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff552d9d640 1 -- 172.21.15.18:0/2705302039 reap_dead start 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 -- 172.21.15.18:0/2705302039 shutdown_connections 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 -- 172.21.15.18:0/2705302039 >> 172.21.15.18:0/2705302039 conn(0x7ff55406ce60 msgr2=0x7ff55406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 -- 172.21.15.18:0/2705302039 shutdown_connections 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 -- 172.21.15.18:0/2705302039 wait complete. 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 Processor -- start 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 -- start start 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff5540b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff55414cc80 0x7ff55414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.406+0000 7ff558dc8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541ee540 0x7ff5540b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff558dc8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55414b940 con 0x7ff540004d10 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff558dc8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55414bbe0 con 0x7ff5541ee540 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff558dc8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55414bec0 con 0x7ff55414cc80 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff5540b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff5540b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52496/0 (socket says 172.21.15.18:52496) 2023-06-09T04:39:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 -- 172.21.15.18:0/1077643388 learned_addr learned my addr 172.21.15.18:0/1077643388 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff551d9b640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff55414cc80 0x7ff55414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff552d9d640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541ee540 0x7ff5540b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 -- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff55414cc80 msgr2=0x7ff55414b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff55414cc80 0x7ff55414b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 -- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541ee540 msgr2=0x7ff5540b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541ee540 0x7ff5540b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 -- 172.21.15.18:0/1077643388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5540ce9f0 con 0x7ff540004d10 2023-06-09T04:39:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff55259c640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff5540b56e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff544011960 tx=0x7ff544011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400faf0 con 0x7ff540004d10 2023-06-09T04:39:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54400fc50 con 0x7ff540004d10 2023-06-09T04:39:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55414c1a0 con 0x7ff540004d10 2023-06-09T04:39:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544014440 con 0x7ff540004d10 2023-06-09T04:39:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55414c760 con 0x7ff540004d10 2023-06-09T04:39:18.417 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5540c56a0 con 0x7ff540004d10 2023-06-09T04:39:18.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff54401d400 con 0x7ff540004d10 2023-06-09T04:39:18.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff54affd640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff534066280 0x7ff534068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff544084920 con 0x7ff540004d10 2023-06-09T04:39:18.418 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff551d9b640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff534066280 0x7ff534068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.410+0000 7ff551d9b640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff534066280 0x7ff534068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff5541f2180 tx=0x7ff53c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.419 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.414+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff544051a10 con 0x7ff540004d10 2023-06-09T04:39:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff55406ecb0 con 0x7ff540004d10 2023-06-09T04:39:18.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff54affd640 1 -- 172.21.15.18:0/1077643388 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff544055030 con 0x7ff540004d10 2023-06-09T04:39:18.572 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff534066280 msgr2=0x7ff534068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff534066280 0x7ff534068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff5541f2180 tx=0x7ff53c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 msgr2=0x7ff5540b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff5540b56e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff544011960 tx=0x7ff544011e20 comp rx=0 tx=0).stop 2023-06-09T04:39:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 shutdown_connections 2023-06-09T04:39:18.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5541ee540 0x7ff5540b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff534066280 0x7ff534068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff55414cc80 0x7ff55414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 --2- 172.21.15.18:0/1077643388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540004d10 0x7ff5540b56e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 >> 172.21.15.18:0/1077643388 conn(0x7ff55406ce60 msgr2=0x7ff5540c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 shutdown_connections 2023-06-09T04:39:18.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.570+0000 7ff558dc8640 1 -- 172.21.15.18:0/1077643388 wait complete. 2023-06-09T04:39:18.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:18.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 Processor -- start 2023-06-09T04:39:18.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 -- start start 2023-06-09T04:39:18.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa39c155d20 0x7fa39c15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa39c0c3940 0x7fa39c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c0cc450 con 0x7fa39c1595d0 2023-06-09T04:39:18.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c15ce40 con 0x7fa39c0c3940 2023-06-09T04:39:18.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa3a1cbb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0c4300 con 0x7fa39c155d20 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa39c0c3940 0x7fa39c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa39c0c3940 0x7fa39c0c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52504/0 (socket says 172.21.15.18:52504) 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 -- 172.21.15.18:0/2045932741 learned_addr learned my addr 172.21.15.18:0/2045932741 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39b7fe640 1 --2- 172.21.15.18:0/2045932741 >> v2:172.21.15.81:3300/0 conn(0x7fa39c155d20 0x7fa39c15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 -- 172.21.15.18:0/2045932741 >> v2:172.21.15.81:3300/0 conn(0x7fa39c155d20 msgr2=0x7fa39c15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 --2- 172.21.15.18:0/2045932741 >> v2:172.21.15.81:3300/0 conn(0x7fa39c155d20 0x7fa39c15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 -- 172.21.15.18:0/2045932741 >> v1:172.21.15.81:6789/0 conn(0x7fa39c1595d0 legacy=0x7fa39c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:18.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 -- 172.21.15.18:0/2045932741 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c15c880 con 0x7fa39c0c3940 2023-06-09T04:39:18.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.706+0000 7fa39bfff640 1 --2- 172.21.15.18:0/2045932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0c3dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0c4440 tx=0x7fa39401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d70ac94cae3da93 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39a7fc640 1 -- 172.21.15.18:0/2045932741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a5820 con 0x7fa39c0c3940 2023-06-09T04:39:18.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39a7fc640 1 -- 172.21.15.18:0/2045932741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940a5980 con 0x7fa39c0c3940 2023-06-09T04:39:18.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39a7fc640 1 -- 172.21.15.18:0/2045932741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940a5d10 con 0x7fa39c0c3940 2023-06-09T04:39:18.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/2045932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 msgr2=0x7fa39c0c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/2045932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0c3dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0c4440 tx=0x7fa39401c960 comp rx=0 tx=0).stop 2023-06-09T04:39:18.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/2045932741 shutdown_connections 2023-06-09T04:39:18.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/2045932741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0c3dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/2045932741 >> v2:172.21.15.81:3300/0 conn(0x7fa39c155d20 0x7fa39c15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/2045932741 >> 172.21.15.18:0/2045932741 conn(0x7fa39c0afa90 msgr2=0x7fa39c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/2045932741 shutdown_connections 2023-06-09T04:39:18.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/2045932741 wait complete. 2023-06-09T04:39:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 Processor -- start 2023-06-09T04:39:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- start start 2023-06-09T04:39:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa39c155d20 0x7fa39c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39c1595d0 0x7fa39c069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0708f0 con 0x7fa39c0c3940 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c06fc70 con 0x7fa39c1595d0 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c06ff50 con 0x7fa39c155d20 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52520/0 (socket says 172.21.15.18:52520) 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 -- 172.21.15.18:0/3572199919 learned_addr learned my addr 172.21.15.18:0/3572199919 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:18.716 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39affd640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa39c155d20 0x7fa39c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 -- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa39c155d20 msgr2=0x7fa39c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa39c155d20 0x7fa39c157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 -- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39c1595d0 msgr2=0x7fa39c069340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39bfff640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39c1595d0 0x7fa39c069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39c1595d0 0x7fa39c069340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 -- 172.21.15.18:0/3572199919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009b30 con 0x7fa39c0c3940 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa39b7fe640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0ae050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00d800 tx=0x7fa38c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.717 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c018070 con 0x7fa39c0c3940 2023-06-09T04:39:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c0059a0 con 0x7fa39c0c3940 2023-06-09T04:39:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c070230 con 0x7fa39c0c3940 2023-06-09T04:39:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c005b50 con 0x7fa39c0c3940 2023-06-09T04:39:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.710+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c0ae590 con 0x7fa39c0c3940 2023-06-09T04:39:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.714+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c073380 con 0x7fa39c0c3940 2023-06-09T04:39:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.714+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa38c005cb0 con 0x7fa39c0c3940 2023-06-09T04:39:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.714+0000 7fa383fff640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa388066280 0x7fa388068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.714+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa38c083e40 con 0x7fa39c0c3940 2023-06-09T04:39:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.714+0000 7fa39affd640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa388066280 0x7fa388068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.714+0000 7fa39affd640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa388066280 0x7fa388068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0cb870 tx=0x7fa390009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.718+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa38c054af0 con 0x7fa39c0c3940 2023-06-09T04:39:18.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.866+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa39c0cbd50 con 0x7fa39c0c3940 2023-06-09T04:39:18.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.866+0000 7fa383fff640 1 -- 172.21.15.18:0/3572199919 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa38c054680 con 0x7fa39c0c3940 2023-06-09T04:39:18.869 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa388066280 msgr2=0x7fa388068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa388066280 0x7fa388068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0cb870 tx=0x7fa390009040 comp rx=0 tx=0).stop 2023-06-09T04:39:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 msgr2=0x7fa39c0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0ae050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00d800 tx=0x7fa38c00dcc0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 shutdown_connections 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa39c1595d0 0x7fa39c069340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fa388066280 0x7fa388068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa39c155d20 0x7fa39c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 --2- 172.21.15.18:0/3572199919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa39c0c3940 0x7fa39c0ae050 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:18.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 >> 172.21.15.18:0/3572199919 conn(0x7fa39c0afa90 msgr2=0x7fa39c06bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 shutdown_connections 2023-06-09T04:39:18.874 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.870+0000 7fa3a1cbb640 1 -- 172.21.15.18:0/3572199919 wait complete. 2023-06-09T04:39:18.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.994+0000 7fb583d10640 1 Processor -- start 2023-06-09T04:39:18.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.994+0000 7fb583d10640 1 -- start start 2023-06-09T04:39:19.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb583d10640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb57c0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb583d10640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb57c06b800 0x7fb57c0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb583d10640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c069df0 con 0x7fb57c0b1530 2023-06-09T04:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb583d10640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c06a0d0 con 0x7fb57c06b800 2023-06-09T04:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb583d10640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0cc610 con 0x7fb57c0b75e0 2023-06-09T04:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb57c0b1530 0x7fb57c06b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43444/0 (socket says 172.21.15.18:43444) 2023-06-09T04:39:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 -- 172.21.15.18:0/2571305739 learned_addr learned my addr 172.21.15.18:0/2571305739 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:19.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb581aac640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb57c0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5822ad640 1 --2- 172.21.15.18:0/2571305739 >> v2:172.21.15.81:3300/0 conn(0x7fb57c06b800 0x7fb57c0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806029087 0 0) 0x7fb57c069df0 con 0x7fb57c0b1530 2023-06-09T04:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb568003530 con 0x7fb57c0b1530 2023-06-09T04:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3772489869 0 0) 0x7fb568003530 con 0x7fb57c0b1530 2023-06-09T04:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 msgr2=0x7fb57c0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb57c0ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 >> v2:172.21.15.81:3300/0 conn(0x7fb57c06b800 msgr2=0x7fb57c0cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 --2- 172.21.15.18:0/2571305739 >> v2:172.21.15.81:3300/0 conn(0x7fb57c06b800 0x7fb57c0cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0cc8f0 con 0x7fb57c0b1530 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fb56c001680 con 0x7fb57c0b1530 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 >> v1:172.21.15.18:6789/0 conn(0x7fb57c0b1530 legacy=0x7fb57c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb568003980 0x7fb568003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb568004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb568004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c06a0d0 con 0x7fb5680043b0 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0cc610 con 0x7fb568003980 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56800b990 con 0x7fb57c0b75e0 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb568004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb581aac640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb568003980 0x7fb568003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5822ad640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb568004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 -- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 msgr2=0x7fb568004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb568004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 -- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb568003980 msgr2=0x7fb568003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb568003980 0x7fb568003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5812ab640 1 -- 172.21.15.18:0/2571305739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568003530 con 0x7fb5680043b0 2023-06-09T04:39:19.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:18.998+0000 7fb5822ad640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0b75e0 0x7fb568004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:19.008 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb568004870 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c290 tx=0x7fb56c01f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a839ccc03491a69 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c005ae0 con 0x7fb5680043b0 2023-06-09T04:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c0ab070 con 0x7fb5680043b0 2023-06-09T04:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb580aaa640 1 -- 172.21.15.18:0/2571305739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c005e80 con 0x7fb5680043b0 2023-06-09T04:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2571305739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 msgr2=0x7fb568004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 --2- 172.21.15.18:0/2571305739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb568004870 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c290 tx=0x7fb56c01f430 comp rx=0 tx=0).stop 2023-06-09T04:39:19.009 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5822ad640 1 -- 172.21.15.18:0/2571305739 reap_dead start 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2571305739 shutdown_connections 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2571305739 >> 172.21.15.18:0/2571305739 conn(0x7fb57c0b46c0 msgr2=0x7fb57c0d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2571305739 shutdown_connections 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2571305739 wait complete. 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 Processor -- start 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- start start 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb57c15d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.010 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb57c0c7c10 0x7fb57c0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0ca6c0 0x7fb57c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c148e20 con 0x7fb5680043b0 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c149100 con 0x7fb57c0c7c10 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1493e0 con 0x7fb57c0ca6c0 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb57c15d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb57c15d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52536/0 (socket says 172.21.15.18:52536) 2023-06-09T04:39:19.011 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 -- 172.21.15.18:0/2241010326 learned_addr learned my addr 172.21.15.18:0/2241010326 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb57c0c7c10 0x7fb57c0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5822ad640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0ca6c0 0x7fb57c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 -- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0ca6c0 msgr2=0x7fb57c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0ca6c0 0x7fb57c0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 -- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb57c0c7c10 msgr2=0x7fb57c0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb57c0c7c10 0x7fb57c0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 -- 172.21.15.18:0/2241010326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c1496c0 con 0x7fb5680043b0 2023-06-09T04:39:19.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb57c0c7c10 0x7fb57c0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb581aac640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb57c15d380 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb578011560 tx=0x7fb578011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578015930 con 0x7fb5680043b0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578015a90 con 0x7fb5680043b0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c1499a0 con 0x7fb5680043b0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578015e60 con 0x7fb5680043b0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.002+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c0c8080 con 0x7fb5680043b0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.006+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c06a750 con 0x7fb5680043b0 2023-06-09T04:39:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.006+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb57800f460 con 0x7fb5680043b0 2023-06-09T04:39:19.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.006+0000 7fb5727fc640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb560066280 0x7fb560068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.006+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5780846c0 con 0x7fb5680043b0 2023-06-09T04:39:19.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.006+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb560066280 0x7fb560068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.006+0000 7fb5812ab640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb560066280 0x7fb560068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0ae000 tx=0x7fb56c001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.010+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5780518e0 con 0x7fb5680043b0 2023-06-09T04:39:19.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb57c15fc40 con 0x7fb5680043b0 2023-06-09T04:39:19.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb5727fc640 1 -- 172.21.15.18:0/2241010326 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb578054f00 con 0x7fb5680043b0 2023-06-09T04:39:19.161 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb560066280 msgr2=0x7fb560068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb560066280 0x7fb560068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0ae000 tx=0x7fb56c001a10 comp rx=0 tx=0).stop 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 msgr2=0x7fb57c15d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb57c15d380 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb578011560 tx=0x7fb578011a20 comp rx=0 tx=0).stop 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 shutdown_connections 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb560066280 0x7fb560068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.163 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb57c0ca6c0 0x7fb57c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb57c0c7c10 0x7fb57c0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 --2- 172.21.15.18:0/2241010326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5680043b0 0x7fb57c15d380 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 >> 172.21.15.18:0/2241010326 conn(0x7fb57c0b46c0 msgr2=0x7fb57c06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 shutdown_connections 2023-06-09T04:39:19.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.158+0000 7fb583d10640 1 -- 172.21.15.18:0/2241010326 wait complete. 2023-06-09T04:39:19.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:19.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4beedfb640 1 Processor -- start 2023-06-09T04:39:19.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4beedfb640 1 -- start start 2023-06-09T04:39:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4beedfb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4be815f280 0x7f4be815f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4beedfb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be815fd40 con 0x7f4be815b600 2023-06-09T04:39:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4beedfb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be8160020 con 0x7f4be80b39d0 2023-06-09T04:39:19.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4beedfb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be80cfce0 con 0x7f4be815f280 2023-06-09T04:39:19.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4becb97640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4be815b600 0x7f4be80b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43452/0 (socket says 172.21.15.18:43452) 2023-06-09T04:39:19.294 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4becb97640 1 -- 172.21.15.18:0/506774842 learned_addr learned my addr 172.21.15.18:0/506774842 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:19.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 --2- 172.21.15.18:0/506774842 >> v2:172.21.15.81:3300/0 conn(0x7f4be815f280 0x7f4be815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.295 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171001827 0 0) 0x7f4be815fd40 con 0x7f4be815b600 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd4003530 con 0x7f4be815b600 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727884932 0 0) 0x7f4bd4003530 con 0x7f4be815b600 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 >> v2:172.21.15.81:3300/0 conn(0x7f4be815f280 msgr2=0x7f4be815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 --2- 172.21.15.18:0/506774842 >> v2:172.21.15.81:3300/0 conn(0x7f4be815f280 0x7f4be815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 >> v1:172.21.15.81:6789/0 conn(0x7f4be80b39d0 legacy=0x7f4be80d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be80cfef0 con 0x7f4be815b600 2023-06-09T04:39:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4bd8001a00 con 0x7f4be815b600 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 >> v1:172.21.15.18:6789/0 conn(0x7f4be815b600 legacy=0x7f4be80b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bd40039d0 0x7f4bd4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd40047d0 0x7f4bd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd4005180 0x7f4bd400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80cfce0 con 0x7f4bd40047d0 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd400c060 con 0x7f4bd4005180 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd400c220 con 0x7f4bd40039d0 2023-06-09T04:39:19.297 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd40047d0 0x7f4bd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4bed398640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd4005180 0x7f4bd400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4becb97640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bd40039d0 0x7f4bd4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 -- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bd40039d0 msgr2=0x7f4bd4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bd40039d0 0x7f4bd4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 -- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd4005180 msgr2=0x7f4bd400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd4005180 0x7f4bd400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4be7fff640 1 -- 172.21.15.18:0/506774842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4003530 con 0x7f4bd40047d0 2023-06-09T04:39:19.298 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4bed398640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd4005180 0x7f4bd400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:19.299 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.290+0000 7f4bed398640 1 -- 172.21.15.18:0/506774842 reap_dead start 2023-06-09T04:39:19.299 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4be7fff640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd40047d0 0x7f4bd4004c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009ab0 tx=0x7f4bd001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d741db98efc4b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00a55c0 con 0x7f4bd40047d0 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00a5720 con 0x7f4bd40047d0 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4be77fe640 1 -- 172.21.15.18:0/506774842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00a5ad0 con 0x7f4bd40047d0 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 -- 172.21.15.18:0/506774842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd40047d0 msgr2=0x7f4bd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd40047d0 0x7f4bd4004c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009ab0 tx=0x7f4bd001c9d0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 -- 172.21.15.18:0/506774842 shutdown_connections 2023-06-09T04:39:19.300 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 --2- 172.21.15.18:0/506774842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd40047d0 0x7f4bd4004c40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.301 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 -- 172.21.15.18:0/506774842 >> 172.21.15.18:0/506774842 conn(0x7f4be80d2120 msgr2=0x7f4be80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.301 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 -- 172.21.15.18:0/506774842 shutdown_connections 2023-06-09T04:39:19.301 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.294+0000 7f4beedfb640 1 -- 172.21.15.18:0/506774842 wait complete. 2023-06-09T04:39:19.302 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 Processor -- start 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 -- start start 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd40047d0 0x7f4be81f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 0x7f4be80b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4be814a390 0x7f4be814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be815c0e0 con 0x7f4be814afb0 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be814ad50 con 0x7f4bd40047d0 2023-06-09T04:39:19.303 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be81f50c0 con 0x7f4be814a390 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 0x7f4be80b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 0x7f4be80b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52560/0 (socket says 172.21.15.18:52560) 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 -- 172.21.15.18:0/4084518685 learned_addr learned my addr 172.21.15.18:0/4084518685 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4bed398640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4be814a390 0x7f4be814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4becb97640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd40047d0 0x7f4be81f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 -- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4be814a390 msgr2=0x7f4be814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.304 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4be814a390 0x7f4be814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 -- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd40047d0 msgr2=0x7f4be81f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd40047d0 0x7f4be81f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 -- 172.21.15.18:0/4084518685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be81f53a0 con 0x7f4be814afb0 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4becb97640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd40047d0 0x7f4be81f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be7fff640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 0x7f4be80b64c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00983e0 tx=0x7f4bd00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00a55c0 con 0x7f4be814afb0 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0004230 con 0x7f4be814afb0 2023-06-09T04:39:19.305 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003620 con 0x7f4be814afb0 2023-06-09T04:39:19.306 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be81f5680 con 0x7f4be814afb0 2023-06-09T04:39:19.306 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.298+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be81f4d00 con 0x7f4be814afb0 2023-06-09T04:39:19.306 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.302+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be815c250 con 0x7f4be814afb0 2023-06-09T04:39:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.302+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bd00b4040 con 0x7f4be814afb0 2023-06-09T04:39:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.302+0000 7f4be57fa640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4bc8066280 0x7f4bc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.302+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4bd011de40 con 0x7f4be814afb0 2023-06-09T04:39:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.302+0000 7f4becb97640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4bc8066280 0x7f4bc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.307 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.302+0000 7f4becb97640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4bc8066280 0x7f4bc8068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8001b30 tx=0x7f4bd8004b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.308 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.306+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bd00eb100 con 0x7f4be814afb0 2023-06-09T04:39:19.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.458+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4be80d1a00 con 0x7f4be814afb0 2023-06-09T04:39:19.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.458+0000 7f4be57fa640 1 -- 172.21.15.18:0/4084518685 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4bd00ee720 con 0x7f4be814afb0 2023-06-09T04:39:19.462 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:19.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4bc8066280 msgr2=0x7f4bc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4bc8066280 0x7f4bc8068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8001b30 tx=0x7f4bd8004b70 comp rx=0 tx=0).stop 2023-06-09T04:39:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 msgr2=0x7f4be80b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 0x7f4be80b64c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00983e0 tx=0x7f4bd00197d0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 shutdown_connections 2023-06-09T04:39:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4bc8066280 0x7f4bc8068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4be814a390 0x7f4be814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4be814afb0 0x7f4be80b64c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 --2- 172.21.15.18:0/4084518685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd40047d0 0x7f4be81f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 >> 172.21.15.18:0/4084518685 conn(0x7f4be80d2120 msgr2=0x7f4be8064f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 shutdown_connections 2023-06-09T04:39:19.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.462+0000 7f4beedfb640 1 -- 172.21.15.18:0/4084518685 wait complete. 2023-06-09T04:39:19.480 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:19.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 Processor -- start 2023-06-09T04:39:19.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 -- start start 2023-06-09T04:39:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0ad220 0x7f550c0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f550c1579a0 0x7f550c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f550c15b5a0 0x7f550c06fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0699a0 con 0x7f550c1579a0 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c15bef0 con 0x7f550c15b5a0 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f5514318640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c15c1d0 con 0x7f550c0ad220 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f550c1579a0 0x7f550c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f550c1579a0 0x7f550c0caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52568/0 (socket says 172.21.15.18:52568) 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 -- 172.21.15.18:0/842838288 learned_addr learned my addr 172.21.15.18:0/842838288 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55128b5640 1 --2- 172.21.15.18:0/842838288 >> v2:172.21.15.81:3300/0 conn(0x7f550c15b5a0 0x7f550c06fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55120b4640 1 --2- 172.21.15.18:0/842838288 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0ad220 0x7f550c0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 -- 172.21.15.18:0/842838288 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0ad220 msgr2=0x7f550c0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 --2- 172.21.15.18:0/842838288 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0ad220 0x7f550c0cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 -- 172.21.15.18:0/842838288 >> v2:172.21.15.81:3300/0 conn(0x7f550c15b5a0 msgr2=0x7f550c06fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 --2- 172.21.15.18:0/842838288 >> v2:172.21.15.81:3300/0 conn(0x7f550c15b5a0 0x7f550c06fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.602+0000 7f55118b3640 1 -- 172.21.15.18:0/842838288 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c15c4b0 con 0x7f550c1579a0 2023-06-09T04:39:19.608 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f55118b3640 1 --2- 172.21.15.18:0/842838288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c1579a0 0x7f550c0caaf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f550c0c2a40 tx=0x7f54fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7819badde24da50 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f55110b2640 1 -- 172.21.15.18:0/842838288 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0ab670 con 0x7f550c1579a0 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f55110b2640 1 -- 172.21.15.18:0/842838288 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc0ab7d0 con 0x7f550c1579a0 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f55110b2640 1 -- 172.21.15.18:0/842838288 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0abb60 con 0x7f550c1579a0 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- 172.21.15.18:0/842838288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c1579a0 msgr2=0x7f550c0caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- 172.21.15.18:0/842838288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c1579a0 0x7f550c0caaf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f550c0c2a40 tx=0x7f54fc01c4d0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- 172.21.15.18:0/842838288 shutdown_connections 2023-06-09T04:39:19.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- 172.21.15.18:0/842838288 >> v2:172.21.15.81:3300/0 conn(0x7f550c15b5a0 0x7f550c06fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- 172.21.15.18:0/842838288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c1579a0 0x7f550c0caaf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- 172.21.15.18:0/842838288 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0ad220 0x7f550c0cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- 172.21.15.18:0/842838288 >> 172.21.15.18:0/842838288 conn(0x7f550c0afa90 msgr2=0x7f550c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- 172.21.15.18:0/842838288 shutdown_connections 2023-06-09T04:39:19.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- 172.21.15.18:0/842838288 wait complete. 2023-06-09T04:39:19.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 Processor -- start 2023-06-09T04:39:19.611 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- start start 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f550c1579a0 0x7f550c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 0x7f550c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0c8f40 0x7f550c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c9920 con 0x7f550c15b5a0 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c14c820 con 0x7f550c1579a0 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.606+0000 7f5514318640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c14cb00 con 0x7f550c0c8f40 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 0x7f550c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 0x7f550c0b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52574/0 (socket says 172.21.15.18:52574) 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55128b5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0c8f40 0x7f550c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 -- 172.21.15.18:0/3401776662 learned_addr learned my addr 172.21.15.18:0/3401776662 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55120b4640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f550c1579a0 0x7f550c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 -- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0c8f40 msgr2=0x7f550c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0c8f40 0x7f550c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 -- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f550c1579a0 msgr2=0x7f550c15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.613 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f550c1579a0 0x7f550c15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.614 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 -- 172.21.15.18:0/3401776662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0094d0 con 0x7f550c15b5a0 2023-06-09T04:39:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55118b3640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 0x7f550c0b30f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54fc01ab80 tx=0x7f54fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0ab670 con 0x7f550c15b5a0 2023-06-09T04:39:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc0b4820 con 0x7f550c15b5a0 2023-06-09T04:39:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0b4bd0 con 0x7f550c15b5a0 2023-06-09T04:39:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c14cde0 con 0x7f550c15b5a0 2023-06-09T04:39:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c14d3a0 con 0x7f550c15b5a0 2023-06-09T04:39:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c14d590 con 0x7f550c15b5a0 2023-06-09T04:39:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54fc0b4d30 con 0x7f550c15b5a0 2023-06-09T04:39:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5502ffd640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f54f00662b0 0x7f54f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54fc11e2d0 con 0x7f550c15b5a0 2023-06-09T04:39:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55120b4640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f54f00662b0 0x7f54f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.610+0000 7f55120b4640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f54f00662b0 0x7f54f0068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5508003b90 tx=0x7f5508009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.618+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54fc0eb510 con 0x7f550c15b5a0 2023-06-09T04:39:19.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.766+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f550c073380 con 0x7f550c15b5a0 2023-06-09T04:39:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5502ffd640 1 -- 172.21.15.18:0/3401776662 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f54fc0eeb30 con 0x7f550c15b5a0 2023-06-09T04:39:19.772 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:19.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f54f00662b0 msgr2=0x7f54f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f54f00662b0 0x7f54f0068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5508003b90 tx=0x7f5508009880 comp rx=0 tx=0).stop 2023-06-09T04:39:19.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 msgr2=0x7f550c0b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 0x7f550c0b30f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54fc01ab80 tx=0x7f54fc01ad10 comp rx=0 tx=0).stop 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 shutdown_connections 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f54f00662b0 0x7f54f0068760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f550c0c8f40 0x7f550c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f550c15b5a0 0x7f550c0b30f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 --2- 172.21.15.18:0/3401776662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f550c1579a0 0x7f550c15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 >> 172.21.15.18:0/3401776662 conn(0x7f550c0afa90 msgr2=0x7f550c14ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 shutdown_connections 2023-06-09T04:39:19.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.770+0000 7f5514318640 1 -- 172.21.15.18:0/3401776662 wait complete. 2023-06-09T04:39:19.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.898+0000 7f75d4589640 1 Processor -- start 2023-06-09T04:39:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.898+0000 7f75d4589640 1 -- start start 2023-06-09T04:39:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d4589640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc159350 0x7f75cc15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d4589640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75cc0c9da0 0x7f75cc06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d4589640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0cd430 con 0x7f75cc06ff90 2023-06-09T04:39:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d4589640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc15df00 con 0x7f75cc0c9da0 2023-06-09T04:39:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d4589640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc070410 con 0x7f75cc159350 2023-06-09T04:39:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f75cc06ff90 0x7f75cc0692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43454/0 (socket says 172.21.15.18:43454) 2023-06-09T04:39:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 -- 172.21.15.18:0/1304597188 learned_addr learned my addr 172.21.15.18:0/1304597188 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2325640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc159350 0x7f75cc15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1b24640 1 --2- 172.21.15.18:0/1304597188 >> v2:172.21.15.81:3300/0 conn(0x7f75cc0c9da0 0x7f75cc06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39934497 0 0) 0x7f75cc0cd430 con 0x7f75cc06ff90 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b8003530 con 0x7f75cc06ff90 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 197326352 0 0) 0x7f75b8003530 con 0x7f75cc06ff90 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc159350 msgr2=0x7f75cc15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc159350 0x7f75cc15cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 >> v2:172.21.15.81:3300/0 conn(0x7f75cc0c9da0 msgr2=0x7f75cc06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 --2- 172.21.15.18:0/1304597188 >> v2:172.21.15.81:3300/0 conn(0x7f75cc0c9da0 0x7f75cc06fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0ca1f0 con 0x7f75cc06ff90 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f75c4001a00 con 0x7f75cc06ff90 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 >> v1:172.21.15.18:6789/0 conn(0x7f75cc06ff90 legacy=0x7f75cc0692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75b8003980 0x7f75b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b8004360 0x7f75b8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b8004f40 0x7f75b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc15df00 con 0x7f75b8004f40 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc070410 con 0x7f75b8004360 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b800bed0 con 0x7f75b8003980 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b8004f40 0x7f75b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1b24640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b8004360 0x7f75b8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2325640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75b8003980 0x7f75b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 -- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75b8003980 msgr2=0x7f75b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75b8003980 0x7f75b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 -- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b8004360 msgr2=0x7f75b8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b8004360 0x7f75b8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d2b26640 1 -- 172.21.15.18:0/1304597188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8003530 con 0x7f75b8004f40 2023-06-09T04:39:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.902+0000 7f75d1b24640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b8004360 0x7f75b8004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d2b26640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b8004f40 0x7f75b800b990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f75c400a860 tx=0x7f75c401faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a6ecf921874842 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40aa6d0 con 0x7f75b8004f40 2023-06-09T04:39:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c40aa830 con 0x7f75b8004f40 2023-06-09T04:39:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d1323640 1 -- 172.21.15.18:0/1304597188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40aac60 con 0x7f75b8004f40 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- 172.21.15.18:0/1304597188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b8004f40 msgr2=0x7f75b800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 --2- 172.21.15.18:0/1304597188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75b8004f40 0x7f75b800b990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f75c400a860 tx=0x7f75c401faa0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d2b26640 1 -- 172.21.15.18:0/1304597188 reap_dead start 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- 172.21.15.18:0/1304597188 shutdown_connections 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- 172.21.15.18:0/1304597188 >> 172.21.15.18:0/1304597188 conn(0x7f75cc0cd9c0 msgr2=0x7f75cc0cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- 172.21.15.18:0/1304597188 shutdown_connections 2023-06-09T04:39:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- 172.21.15.18:0/1304597188 wait complete. 2023-06-09T04:39:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 Processor -- start 2023-06-09T04:39:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- start start 2023-06-09T04:39:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 0x7f75cc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc1f2830 0x7f75cc1eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc1ef170 0x7f75cc0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0c5f60 con 0x7f75cc1f2460 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0c52e0 con 0x7f75cc1ef170 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d4589640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0c55c0 con 0x7f75cc1f2830 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.906+0000 7f75d2325640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 0x7f75cc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 0x7f75cc0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52586/0 (socket says 172.21.15.18:52586) 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 -- 172.21.15.18:0/658543844 learned_addr learned my addr 172.21.15.18:0/658543844 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d1b24640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc1f2830 0x7f75cc1eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2b26640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc1ef170 0x7f75cc0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 -- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc1f2830 msgr2=0x7f75cc1eec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc1f2830 0x7f75cc1eec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 -- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc1ef170 msgr2=0x7f75cc0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc1ef170 0x7f75cc0c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 -- 172.21.15.18:0/658543844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0c58a0 con 0x7f75cc1f2460 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d1b24640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc1f2830 0x7f75cc1eec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d2325640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 0x7f75cc0c4a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f75c80114c0 tx=0x7f75c80115b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8015660 con 0x7f75cc1f2460 2023-06-09T04:39:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80157c0 con 0x7f75cc1f2460 2023-06-09T04:39:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8015b70 con 0x7f75cc1f2460 2023-06-09T04:39:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc0c5b80 con 0x7f75cc1f2460 2023-06-09T04:39:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc1579f0 con 0x7f75cc1f2460 2023-06-09T04:39:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc0c61d0 con 0x7f75cc1f2460 2023-06-09T04:39:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75c8015cd0 con 0x7f75cc1f2460 2023-06-09T04:39:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75c2ffd640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f75b0066280 0x7f75b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75c80840c0 con 0x7f75cc1f2460 2023-06-09T04:39:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d1b24640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f75b0066280 0x7f75b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.910+0000 7f75d1b24640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f75b0066280 0x7f75b0068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0ccd70 tx=0x7f75bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:19.918 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:19.914+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75c8051280 con 0x7f75cc1f2460 2023-06-09T04:39:20.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.074+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75cc06a750 con 0x7f75cc1f2460 2023-06-09T04:39:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.074+0000 7f75c2ffd640 1 -- 172.21.15.18:0/658543844 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f75c80548a0 con 0x7f75cc1f2460 2023-06-09T04:39:20.078 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f75b0066280 msgr2=0x7f75b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f75b0066280 0x7f75b0068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0ccd70 tx=0x7f75bc008040 comp rx=0 tx=0).stop 2023-06-09T04:39:20.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 msgr2=0x7f75cc0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 0x7f75cc0c4a90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f75c80114c0 tx=0x7f75c80115b0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 shutdown_connections 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc1ef170 0x7f75cc0c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f75b0066280 0x7f75b0068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f75cc1f2830 0x7f75cc1eec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 --2- 172.21.15.18:0/658543844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc1f2460 0x7f75cc0c4a90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 >> 172.21.15.18:0/658543844 conn(0x7f75cc0cd9c0 msgr2=0x7f75cc0afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 shutdown_connections 2023-06-09T04:39:20.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.078+0000 7f75d4589640 1 -- 172.21.15.18:0/658543844 wait complete. 2023-06-09T04:39:20.095 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2023-06-09T04:39:20.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:20.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-06-09T04:39:20.108 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:20.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2023-06-09T04:39:20.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:20.109 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T04:39:20.155 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:39:20.156 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:20.162 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:39:20.162 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:20.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:20.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 Processor -- start 2023-06-09T04:39:20.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 -- start start 2023-06-09T04:39:20.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e0415b770 0x7f5e040cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040ca6f0 con 0x7f5e040ca2a0 2023-06-09T04:39:20.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0415fb70 con 0x7f5e0415b770 2023-06-09T04:39:20.323 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.318+0000 7f5e08919640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040cdf60 con 0x7f5e040cc970 2023-06-09T04:39:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e02d9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e0415b770 0x7f5e040cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e02d9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0406ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:34446/0 (socket says 172.21.15.18:34446) 2023-06-09T04:39:20.324 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e0415b770 0x7f5e040cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:41792/0 (socket says 172.21.15.18:41792) 2023-06-09T04:39:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e02d9d640 1 -- 172.21.15.18:0/882363576 learned_addr learned my addr 172.21.15.18:0/882363576 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 -- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 msgr2=0x7f5e0406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 --2- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0406ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 -- 172.21.15.18:0/882363576 >> v1:172.21.15.81:6789/0 conn(0x7f5e040ca2a0 legacy=0x7f5e040cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.325 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 -- 172.21.15.18:0/882363576 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e041600a0 con 0x7f5e0415b770 2023-06-09T04:39:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0259c640 1 --2- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0415b770 0x7f5e040cf4e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5df40097c0 tx=0x7f5df401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a1cad2438e51d15 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0159a640 1 -- 172.21.15.18:0/882363576 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40ab600 con 0x7f5e0415b770 2023-06-09T04:39:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0159a640 1 -- 172.21.15.18:0/882363576 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40a7050 con 0x7f5e0415b770 2023-06-09T04:39:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e0159a640 1 -- 172.21.15.18:0/882363576 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40ab980 con 0x7f5e0415b770 2023-06-09T04:39:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 -- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0415b770 msgr2=0x7f5e040cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.327 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 --2- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0415b770 0x7f5e040cf4e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5df40097c0 tx=0x7f5df401c3f0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 -- 172.21.15.18:0/882363576 shutdown_connections 2023-06-09T04:39:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 --2- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 --2- 172.21.15.18:0/882363576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0415b770 0x7f5e040cf4e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 -- 172.21.15.18:0/882363576 >> 172.21.15.18:0/882363576 conn(0x7f5e0406f850 msgr2=0x7f5e0406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 -- 172.21.15.18:0/882363576 shutdown_connections 2023-06-09T04:39:20.328 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.322+0000 7f5e08919640 1 -- 172.21.15.18:0/882363576 wait complete. 2023-06-09T04:39:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 Processor -- start 2023-06-09T04:39:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- start start 2023-06-09T04:39:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e040ca2a0 0x7f5e040af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 0x7f5e040b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414cac0 con 0x7f5e0415b770 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414e000 con 0x7f5e040ca2a0 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0414d7a0 con 0x7f5e040cc970 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 0x7f5e040b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 0x7f5e040b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52594/0 (socket says 172.21.15.18:52594) 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 -- 172.21.15.18:0/1246804239 learned_addr learned my addr 172.21.15.18:0/1246804239 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:20.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e0259c640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e040ca2a0 0x7f5e040af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e01d9b640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 -- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 msgr2=0x7f5e0414c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0414c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 -- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e040ca2a0 msgr2=0x7f5e040af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e040ca2a0 0x7f5e040af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 -- 172.21.15.18:0/1246804239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009420 con 0x7f5e0415b770 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e01d9b640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:20.332 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e02d9d640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 0x7f5e040b2a80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ec10 tx=0x7f5dfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00cb20 con 0x7f5e0415b770 2023-06-09T04:39:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00f040 con 0x7f5e0415b770 2023-06-09T04:39:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e040b4500 con 0x7f5e0415b770 2023-06-09T04:39:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0039a0 con 0x7f5e0415b770 2023-06-09T04:39:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0414dd20 con 0x7f5e0415b770 2023-06-09T04:39:20.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e04073380 con 0x7f5e0415b770 2023-06-09T04:39:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.326+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5dfc003d10 con 0x7f5e0415b770 2023-06-09T04:39:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.330+0000 7f5df2ffd640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.330+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5dfc084720 con 0x7f5e0415b770 2023-06-09T04:39:20.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.330+0000 7f5e0259c640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.330+0000 7f5e0259c640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5df40ad000 tx=0x7f5df4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.334+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5dfc0518a0 con 0x7f5e0415b770 2023-06-09T04:39:20.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.482+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e0406eb20 con 0x7f5e0415b770 2023-06-09T04:39:20.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5df2ffd640 1 -- 172.21.15.18:0/1246804239 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f5dfc054ec0 con 0x7f5e0415b770 2023-06-09T04:39:20.488 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:20.488 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:20.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 msgr2=0x7f5de4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5df40ad000 tx=0x7f5df4008040 comp rx=0 tx=0).stop 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 msgr2=0x7f5e040b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 0x7f5e040b2a80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ec10 tx=0x7f5dfc00c490 comp rx=0 tx=0).stop 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 shutdown_connections 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e0415b770 0x7f5e040b2a80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5de4066280 0x7f5de4068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5e040cc970 0x7f5e0414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 --2- 172.21.15.18:0/1246804239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e040ca2a0 0x7f5e040af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 >> 172.21.15.18:0/1246804239 conn(0x7f5e0406f850 msgr2=0x7f5e04150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 shutdown_connections 2023-06-09T04:39:20.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.486+0000 7f5e08919640 1 -- 172.21.15.18:0/1246804239 wait complete. 2023-06-09T04:39:20.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:20.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:20.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab7440a640 1 Processor -- start 2023-06-09T04:39:20.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab7440a640 1 -- start start 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab7440a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab6c0b2bc0 0x7fab6c1643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab7440a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c159980 con 0x7fab6c0cf890 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab7440a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0cabb0 con 0x7fab6c1595b0 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab7440a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0cbfc0 con 0x7fab6c0b2bc0 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fab6c0cf890 0x7fab6c0ccb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43464/0 (socket says 172.21.15.18:43464) 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 -- 172.21.15.18:0/3437532749 learned_addr learned my addr 172.21.15.18:0/3437532749 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:20.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab729a7640 1 --2- 172.21.15.18:0/3437532749 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0b2bc0 0x7fab6c1643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068846751 0 0) 0x7fab6c159980 con 0x7fab6c0cf890 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab54003530 con 0x7fab6c0cf890 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210759410 0 0) 0x7fab54003530 con 0x7fab6c0cf890 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0b2bc0 msgr2=0x7fab6c1643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 --2- 172.21.15.18:0/3437532749 >> v2:172.21.15.81:3300/0 conn(0x7fab6c0b2bc0 0x7fab6c1643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 >> v1:172.21.15.81:6789/0 conn(0x7fab6c1595b0 legacy=0x7fab6c0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0ce9f0 con 0x7fab6c0cf890 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fab60001680 con 0x7fab6c0cf890 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 >> v1:172.21.15.18:6789/0 conn(0x7fab6c0cf890 legacy=0x7fab6c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54003980 0x7fab54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab54005180 0x7fab5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0cbfc0 con 0x7fab540047d0 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400c000 con 0x7fab54003980 2023-06-09T04:39:20.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400c1c0 con 0x7fab54005180 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab721a6640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54003980 0x7fab54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab729a7640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab54005180 0x7fab5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 -- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab54005180 msgr2=0x7fab5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab54005180 0x7fab5400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 -- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54003980 msgr2=0x7fab54003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54003980 0x7fab54003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab719a5640 1 -- 172.21.15.18:0/3437532749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54003530 con 0x7fab540047d0 2023-06-09T04:39:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab729a7640 1 -- 172.21.15.18:0/3437532749 reap_dead start 2023-06-09T04:39:20.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.630+0000 7fab721a6640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54003980 0x7fab54003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:20.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab719a5640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab54004c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fab6000c240 tx=0x7fab6001f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b21519884887e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab600a8dd0 con 0x7fab540047d0 2023-06-09T04:39:20.640 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab600058e0 con 0x7fab540047d0 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab711a4640 1 -- 172.21.15.18:0/3437532749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60005d10 con 0x7fab540047d0 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- 172.21.15.18:0/3437532749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 msgr2=0x7fab54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab54004c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fab6000c240 tx=0x7fab6001f2b0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- 172.21.15.18:0/3437532749 shutdown_connections 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 --2- 172.21.15.18:0/3437532749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab54004c40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- 172.21.15.18:0/3437532749 >> 172.21.15.18:0/3437532749 conn(0x7fab6c06ce60 msgr2=0x7fab6c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- 172.21.15.18:0/3437532749 shutdown_connections 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- 172.21.15.18:0/3437532749 wait complete. 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 Processor -- start 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- start start 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab6c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c1eea80 0x7fab6c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c1eeef0 0x7fab6c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c153ea0 con 0x7fab540047d0 2023-06-09T04:39:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1efa50 con 0x7fab6c1eea80 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab7440a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1f0110 con 0x7fab6c1eeef0 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab6c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab6c153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52624/0 (socket says 172.21.15.18:52624) 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 -- 172.21.15.18:0/208965881 learned_addr learned my addr 172.21.15.18:0/208965881 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab719a5640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c1eea80 0x7fab6c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab729a7640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c1eeef0 0x7fab6c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 -- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c1eeef0 msgr2=0x7fab6c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c1eeef0 0x7fab6c0cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 -- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c1eea80 msgr2=0x7fab6c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c1eea80 0x7fab6c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 -- 172.21.15.18:0/208965881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c1ef490 con 0x7fab540047d0 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab721a6640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab6c153960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00d4d0 tx=0x7fab5c00d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00b070 con 0x7fab540047d0 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.634+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c005330 con 0x7fab540047d0 2023-06-09T04:39:20.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c1ef770 con 0x7fab540047d0 2023-06-09T04:39:20.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c007270 con 0x7fab540047d0 2023-06-09T04:39:20.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c155c90 con 0x7fab540047d0 2023-06-09T04:39:20.645 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c06ecb0 con 0x7fab540047d0 2023-06-09T04:39:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab5c0073d0 con 0x7fab540047d0 2023-06-09T04:39:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab6affd640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fab580662b0 0x7fab58068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab5c0839b0 con 0x7fab540047d0 2023-06-09T04:39:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab719a5640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fab580662b0 0x7fab58068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.638+0000 7fab719a5640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fab580662b0 0x7fab58068760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fab600ae000 tx=0x7fab600aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.642+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab5c050c90 con 0x7fab540047d0 2023-06-09T04:39:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.790+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab6c0cdd90 con 0x7fab540047d0 2023-06-09T04:39:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab6affd640 1 -- 172.21.15.18:0/208965881 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab5c0542b0 con 0x7fab540047d0 2023-06-09T04:39:20.796 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fab580662b0 msgr2=0x7fab58068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fab580662b0 0x7fab58068760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fab600ae000 tx=0x7fab600aa070 comp rx=0 tx=0).stop 2023-06-09T04:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 msgr2=0x7fab6c153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab6c153960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00d4d0 tx=0x7fab5c00d5c0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 shutdown_connections 2023-06-09T04:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fab580662b0 0x7fab58068760 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab6c1eeef0 0x7fab6c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab6c1eea80 0x7fab6c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 --2- 172.21.15.18:0/208965881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab540047d0 0x7fab6c153960 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 >> 172.21.15.18:0/208965881 conn(0x7fab6c06ce60 msgr2=0x7fab6c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 shutdown_connections 2023-06-09T04:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.794+0000 7fab7440a640 1 -- 172.21.15.18:0/208965881 wait complete. 2023-06-09T04:39:20.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 Processor -- start 2023-06-09T04:39:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 -- start start 2023-06-09T04:39:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88dc0cbd40 0x7f88dc069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc15de50 con 0x7f88dc1591c0 2023-06-09T04:39:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc15d2d0 con 0x7f88dc0cbd40 2023-06-09T04:39:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88e3176640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc15d5b0 con 0x7f88dc159590 2023-06-09T04:39:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88dbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88dc0cbd40 0x7f88dc069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88dbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88dc0cbd40 0x7f88dc069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52634/0 (socket says 172.21.15.18:52634) 2023-06-09T04:39:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.934+0000 7f88dbfff640 1 -- 172.21.15.18:0/1299464258 learned_addr learned my addr 172.21.15.18:0/1299464258 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e1713640 1 --2- 172.21.15.18:0/1299464258 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88dbfff640 1 -- 172.21.15.18:0/1299464258 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 msgr2=0x7f88dc069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88dbfff640 1 --2- 172.21.15.18:0/1299464258 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88dbfff640 1 -- 172.21.15.18:0/1299464258 >> v1:172.21.15.81:6789/0 conn(0x7f88dc1591c0 legacy=0x7f88dc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88dbfff640 1 -- 172.21.15.18:0/1299464258 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc15d890 con 0x7f88dc0cbd40 2023-06-09T04:39:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88dbfff640 1 --2- 172.21.15.18:0/1299464258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc0cbd40 0x7f88dc069600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98184806640da1e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88db7fe640 1 -- 172.21.15.18:0/1299464258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80ab670 con 0x7f88dc0cbd40 2023-06-09T04:39:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88db7fe640 1 -- 172.21.15.18:0/1299464258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c80ab7d0 con 0x7f88dc0cbd40 2023-06-09T04:39:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88db7fe640 1 -- 172.21.15.18:0/1299464258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80abb60 con 0x7f88dc0cbd40 2023-06-09T04:39:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 -- 172.21.15.18:0/1299464258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc0cbd40 msgr2=0x7f88dc069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 --2- 172.21.15.18:0/1299464258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc0cbd40 0x7f88dc069600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c801c510 comp rx=0 tx=0).stop 2023-06-09T04:39:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 -- 172.21.15.18:0/1299464258 shutdown_connections 2023-06-09T04:39:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 --2- 172.21.15.18:0/1299464258 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 --2- 172.21.15.18:0/1299464258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc0cbd40 0x7f88dc069600 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 -- 172.21.15.18:0/1299464258 >> 172.21.15.18:0/1299464258 conn(0x7f88dc0afa90 msgr2=0x7f88dc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 -- 172.21.15.18:0/1299464258 shutdown_connections 2023-06-09T04:39:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.938+0000 7f88e3176640 1 -- 172.21.15.18:0/1299464258 wait complete. 2023-06-09T04:39:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 Processor -- start 2023-06-09T04:39:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- start start 2023-06-09T04:39:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc0cbd40 0x7f88dc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 0x7f88dc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc152a90 con 0x7f88dc1591c0 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc15a860 con 0x7f88dc0cbd40 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc15a2a0 con 0x7f88dc159590 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 0x7f88dc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 0x7f88dc1599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52644/0 (socket says 172.21.15.18:52644) 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 -- 172.21.15.18:0/3797922067 learned_addr learned my addr 172.21.15.18:0/3797922067 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e1713640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e0f12640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc0cbd40 0x7f88dc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 -- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 msgr2=0x7f88dc0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc0cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 -- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc0cbd40 msgr2=0x7f88dc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc0cbd40 0x7f88dc152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 -- 172.21.15.18:0/3797922067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80094d0 con 0x7f88dc1591c0 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e0f12640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc0cbd40 0x7f88dc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88dbfff640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 0x7f88dc1599e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f88c80ad040 tx=0x7f88c801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80b4800 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c80b4960 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc15a580 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80b4d10 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0b1850 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0b1a40 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.942+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88c80c7440 con 0x7f88dc1591c0 2023-06-09T04:39:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.946+0000 7f88d97fa640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f88c0066280 0x7f88c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.946+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88c811eb90 con 0x7f88dc1591c0 2023-06-09T04:39:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.946+0000 7f88e0f12640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f88c0066280 0x7f88c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.946+0000 7f88e0f12640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f88c0066280 0x7f88c0068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b3a40 tx=0x7f88d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:20.951 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:20.950+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88c80ebdb0 con 0x7f88dc1591c0 2023-06-09T04:39:21.101 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.098+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88dc073380 con 0x7f88dc1591c0 2023-06-09T04:39:21.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.098+0000 7f88d97fa640 1 -- 172.21.15.18:0/3797922067 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88c80ef3d0 con 0x7f88dc1591c0 2023-06-09T04:39:21.102 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:21.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f88c0066280 msgr2=0x7f88c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f88c0066280 0x7f88c0068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0b3a40 tx=0x7f88d0009040 comp rx=0 tx=0).stop 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 msgr2=0x7f88dc1599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 0x7f88dc1599e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f88c80ad040 tx=0x7f88c801ad50 comp rx=0 tx=0).stop 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 shutdown_connections 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f88c0066280 0x7f88c0068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88dc159590 0x7f88dc0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88dc1591c0 0x7f88dc1599e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 --2- 172.21.15.18:0/3797922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc0cbd40 0x7f88dc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 >> 172.21.15.18:0/3797922067 conn(0x7f88dc0afa90 msgr2=0x7f88dc155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 shutdown_connections 2023-06-09T04:39:21.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.102+0000 7f88e3176640 1 -- 172.21.15.18:0/3797922067 wait complete. 2023-06-09T04:39:21.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:21.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 Processor -- start 2023-06-09T04:39:21.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 -- start start 2023-06-09T04:39:21.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd23c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23c0ccb70 0x7fd23c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c159980 con 0x7fd23c1595b0 2023-06-09T04:39:21.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0cbfc0 con 0x7fd23c0ccb70 2023-06-09T04:39:21.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.238+0000 7fd243175640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0ce710 con 0x7fd23c0cf890 2023-06-09T04:39:21.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd23c1595b0 0x7fd23c0cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43480/0 (socket says 172.21.15.18:43480) 2023-06-09T04:39:21.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 -- 172.21.15.18:0/2429899877 learned_addr learned my addr 172.21.15.18:0/2429899877 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:21.245 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd23c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd241712640 1 --2- 172.21.15.18:0/2429899877 >> v2:172.21.15.81:3300/0 conn(0x7fd23c0ccb70 0x7fd23c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302660214 0 0) 0x7fd23c159980 con 0x7fd23c1595b0 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd228003530 con 0x7fd23c1595b0 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578844693 0 0) 0x7fd228003530 con 0x7fd23c1595b0 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 msgr2=0x7fd23c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd23c0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 >> v2:172.21.15.81:3300/0 conn(0x7fd23c0ccb70 msgr2=0x7fd23c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 --2- 172.21.15.18:0/2429899877 >> v2:172.21.15.81:3300/0 conn(0x7fd23c0ccb70 0x7fd23c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0cabb0 con 0x7fd23c1595b0 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fd234001680 con 0x7fd23c1595b0 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd23c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 >> v1:172.21.15.18:6789/0 conn(0x7fd23c1595b0 legacy=0x7fd23c0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd228003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2280043b0 0x7fd228004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.247 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd228004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0cbfc0 con 0x7fd228003980 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0ce710 con 0x7fd2280043b0 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22800b990 con 0x7fd23c0cf890 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd228003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2280043b0 0x7fd228004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd241712640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd228004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 -- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 msgr2=0x7fd228004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.248 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c0cf890 0x7fd228004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.249 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 -- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2280043b0 msgr2=0x7fd228004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.249 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2280043b0 0x7fd228004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.249 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 -- 172.21.15.18:0/2429899877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224009a70 con 0x7fd228003980 2023-06-09T04:39:21.251 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd240f11640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd228003d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c240 tx=0x7fd23401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89ee7000e268027 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.251 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340058e0 con 0x7fd228003980 2023-06-09T04:39:21.251 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234005a40 con 0x7fd228003980 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.242+0000 7fd23b7fe640 1 -- 172.21.15.18:0/2429899877 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234005e10 con 0x7fd228003980 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2429899877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 msgr2=0x7fd228003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 --2- 172.21.15.18:0/2429899877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd228003d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c240 tx=0x7fd23401cc60 comp rx=0 tx=0).stop 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd241712640 1 -- 172.21.15.18:0/2429899877 reap_dead start 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2429899877 shutdown_connections 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2429899877 >> 172.21.15.18:0/2429899877 conn(0x7fd23c06ce60 msgr2=0x7fd23c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2429899877 shutdown_connections 2023-06-09T04:39:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2429899877 wait complete. 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 Processor -- start 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- start start 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd23c151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c152260 0x7fd23c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c15f410 0x7fd23c15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15fdd0 con 0x7fd228003980 2023-06-09T04:39:21.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c8c40 con 0x7fd23c152260 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c8f20 con 0x7fd23c15f410 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd23c151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd23c151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52668/0 (socket says 172.21.15.18:52668) 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 -- 172.21.15.18:0/2995724113 learned_addr learned my addr 172.21.15.18:0/2995724113 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd241712640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c15f410 0x7fd23c15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c152260 0x7fd23c0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 -- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c15f410 msgr2=0x7fd23c15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.254 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c15f410 0x7fd23c15f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 -- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c152260 msgr2=0x7fd23c0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c152260 0x7fd23c0c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 -- 172.21.15.18:0/2995724113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0ce9f0 con 0x7fd228003980 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c152260 0x7fd23c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd240f11640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd23c151ba0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c240 tx=0x7fd228005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340047f0 con 0x7fd228003980 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234004950 con 0x7fd228003980 2023-06-09T04:39:21.255 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234004cc0 con 0x7fd228003980 2023-06-09T04:39:21.256 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0c9200 con 0x7fd228003980 2023-06-09T04:39:21.256 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.246+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0c97c0 con 0x7fd228003980 2023-06-09T04:39:21.256 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.250+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c160180 con 0x7fd228003980 2023-06-09T04:39:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.250+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd234007070 con 0x7fd228003980 2023-06-09T04:39:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.250+0000 7fd2397fa640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd21c0662b0 0x7fd21c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.250+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd23411d1c0 con 0x7fd228003980 2023-06-09T04:39:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.250+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd21c0662b0 0x7fd21c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.250+0000 7fd23bfff640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd21c0662b0 0x7fd21c068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2240075a0 tx=0x7fd22400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.254+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2340ea400 con 0x7fd228003980 2023-06-09T04:39:21.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd23c06ecb0 con 0x7fd228003980 2023-06-09T04:39:21.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd2397fa640 1 -- 172.21.15.18:0/2995724113 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2340eda20 con 0x7fd228003980 2023-06-09T04:39:21.409 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:21.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd21c0662b0 msgr2=0x7fd21c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd21c0662b0 0x7fd21c068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2240075a0 tx=0x7fd22400b040 comp rx=0 tx=0).stop 2023-06-09T04:39:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 msgr2=0x7fd23c151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd23c151ba0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c240 tx=0x7fd228005800 comp rx=0 tx=0).stop 2023-06-09T04:39:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 shutdown_connections 2023-06-09T04:39:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd21c0662b0 0x7fd21c068760 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd23c15f410 0x7fd23c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23c152260 0x7fd23c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 --2- 172.21.15.18:0/2995724113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd228003980 0x7fd23c151ba0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.406+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 >> 172.21.15.18:0/2995724113 conn(0x7fd23c06ce60 msgr2=0x7fd23c0c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.410+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 shutdown_connections 2023-06-09T04:39:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.410+0000 7fd243175640 1 -- 172.21.15.18:0/2995724113 wait complete. 2023-06-09T04:39:21.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:21.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 Processor -- start 2023-06-09T04:39:21.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 -- start start 2023-06-09T04:39:21.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff7a01527e0 0x7ff7a00692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a00c3010 0x7ff7a0070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a015fb20 con 0x7ff7a015f140 2023-06-09T04:39:21.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a015fe00 con 0x7ff7a01527e0 2023-06-09T04:39:21.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a65c9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a006fd50 con 0x7ff7a00c3010 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff797fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff7a015f140 0x7ff7a00c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43490/0 (socket says 172.21.15.18:43490) 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff797fff640 1 -- 172.21.15.18:0/3454160601 learned_addr learned my addr 172.21.15.18:0/3454160601 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff79ffff640 1 --2- 172.21.15.18:0/3454160601 >> v2:172.21.15.18:3300/0 conn(0x7ff7a01527e0 0x7ff7a00692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff7a4b66640 1 --2- 172.21.15.18:0/3454160601 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a00c3010 0x7ff7a0070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff79ffff640 1 -- 172.21.15.18:0/3454160601 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a00c3010 msgr2=0x7ff7a0070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff79ffff640 1 --2- 172.21.15.18:0/3454160601 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a00c3010 0x7ff7a0070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff79ffff640 1 -- 172.21.15.18:0/3454160601 >> v1:172.21.15.18:6789/0 conn(0x7ff7a015f140 legacy=0x7ff7a00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.538+0000 7ff79ffff640 1 -- 172.21.15.18:0/3454160601 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0070030 con 0x7ff7a01527e0 2023-06-09T04:39:21.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff79ffff640 1 --2- 172.21.15.18:0/3454160601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00692b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff7900097a0 tx=0x7ff79001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa31bffdc7adc93 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff79f7fe640 1 -- 172.21.15.18:0/3454160601 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900ab600 con 0x7ff7a01527e0 2023-06-09T04:39:21.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff79f7fe640 1 -- 172.21.15.18:0/3454160601 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7900a7050 con 0x7ff7a01527e0 2023-06-09T04:39:21.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff79f7fe640 1 -- 172.21.15.18:0/3454160601 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900ab980 con 0x7ff7a01527e0 2023-06-09T04:39:21.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- 172.21.15.18:0/3454160601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 msgr2=0x7ff7a00692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/3454160601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00692b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff7900097a0 tx=0x7ff79001c460 comp rx=0 tx=0).stop 2023-06-09T04:39:21.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- 172.21.15.18:0/3454160601 shutdown_connections 2023-06-09T04:39:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/3454160601 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a00c3010 0x7ff7a0070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/3454160601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00692b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- 172.21.15.18:0/3454160601 >> 172.21.15.18:0/3454160601 conn(0x7ff7a00afa90 msgr2=0x7ff7a00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- 172.21.15.18:0/3454160601 shutdown_connections 2023-06-09T04:39:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- 172.21.15.18:0/3454160601 wait complete. 2023-06-09T04:39:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 Processor -- start 2023-06-09T04:39:21.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- start start 2023-06-09T04:39:21.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a00c3010 0x7ff7a01519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a015f140 0x7ff7a00adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0151ef0 con 0x7ff7a01527e0 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00b2df0 con 0x7ff7a00c3010 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a65c9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00b1d50 con 0x7ff7a015f140 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52678/0 (socket says 172.21.15.18:52678) 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff797fff640 1 -- 172.21.15.18:0/1213711898 learned_addr learned my addr 172.21.15.18:0/1213711898 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff7a4b66640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a015f140 0x7ff7a00adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.542+0000 7ff79ffff640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a00c3010 0x7ff7a01519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff797fff640 1 -- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a015f140 msgr2=0x7ff7a00adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff797fff640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a015f140 0x7ff7a00adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff797fff640 1 -- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a00c3010 msgr2=0x7ff7a01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff797fff640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a00c3010 0x7ff7a01519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff797fff640 1 -- 172.21.15.18:0/1213711898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900093b0 con 0x7ff7a01527e0 2023-06-09T04:39:21.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff797fff640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00ccbe0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff78800c4d0 tx=0x7ff78800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788005cf0 con 0x7ff7a01527e0 2023-06-09T04:39:21.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788005e50 con 0x7ff7a01527e0 2023-06-09T04:39:21.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a00b2030 con 0x7ff7a01527e0 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788007270 con 0x7ff7a01527e0 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a00b25f0 con 0x7ff7a01527e0 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a0073380 con 0x7ff7a01527e0 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7880073d0 con 0x7ff7a01527e0 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79d7fa640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff780066280 0x7ff780068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff788083440 con 0x7ff7a01527e0 2023-06-09T04:39:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79ffff640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff780066280 0x7ff780068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.546+0000 7ff79ffff640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff780066280 0x7ff780068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff7900ad000 tx=0x7ff7900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.550+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff788050660 con 0x7ff7a01527e0 2023-06-09T04:39:21.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.698+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7a006a120 con 0x7ff7a01527e0 2023-06-09T04:39:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.698+0000 7ff79d7fa640 1 -- 172.21.15.18:0/1213711898 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff788053c80 con 0x7ff7a01527e0 2023-06-09T04:39:21.702 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff780066280 msgr2=0x7ff780068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff780066280 0x7ff780068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff7900ad000 tx=0x7ff7900a6000 comp rx=0 tx=0).stop 2023-06-09T04:39:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 msgr2=0x7ff7a00ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00ccbe0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff78800c4d0 tx=0x7ff78800c990 comp rx=0 tx=0).stop 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 shutdown_connections 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7ff780066280 0x7ff780068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff7a015f140 0x7ff7a00adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a01527e0 0x7ff7a00ccbe0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 --2- 172.21.15.18:0/1213711898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7a00c3010 0x7ff7a01519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 >> 172.21.15.18:0/1213711898 conn(0x7ff7a00afa90 msgr2=0x7ff7a00cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 shutdown_connections 2023-06-09T04:39:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.702+0000 7ff7a65c9640 1 -- 172.21.15.18:0/1213711898 wait complete. 2023-06-09T04:39:21.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:21.847 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.842+0000 7f6c18ce5640 1 Processor -- start 2023-06-09T04:39:21.847 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.842+0000 7f6c18ce5640 1 -- start start 2023-06-09T04:39:21.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c18ce5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c140cbd40 0x7f6c14069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c18ce5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1415de50 con 0x7f6c141591c0 2023-06-09T04:39:21.848 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c18ce5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1415d2d0 con 0x7f6c14159590 2023-06-09T04:39:21.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c18ce5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1415d5b0 con 0x7f6c140cbd40 2023-06-09T04:39:21.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c1259c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6c141591c0 0x7f6c140cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43498/0 (socket says 172.21.15.18:43498) 2023-06-09T04:39:21.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c1259c640 1 -- 172.21.15.18:0/646617253 learned_addr learned my addr 172.21.15.18:0/646617253 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:21.849 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c11d9b640 1 --2- 172.21.15.18:0/646617253 >> v2:172.21.15.18:3300/0 conn(0x7f6c140cbd40 0x7f6c14069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c1159a640 1 -- 172.21.15.18:0/646617253 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712838926 0 0) 0x7f6c1415de50 con 0x7f6c141591c0 2023-06-09T04:39:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c1159a640 1 -- 172.21.15.18:0/646617253 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bfc003530 con 0x7f6c141591c0 2023-06-09T04:39:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c11d9b640 1 -- 172.21.15.18:0/646617253 >> v1:172.21.15.81:6789/0 conn(0x7f6c14159590 legacy=0x7f6c14069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c11d9b640 1 -- 172.21.15.18:0/646617253 >> v1:172.21.15.18:6789/0 conn(0x7f6c141591c0 legacy=0x7f6c140cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c1159a640 1 -- 172.21.15.18:0/646617253 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2171340790 0 0) 0x7f6bfc003530 con 0x7f6c141591c0 2023-06-09T04:39:21.850 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c11d9b640 1 -- 172.21.15.18:0/646617253 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1415d890 con 0x7f6c140cbd40 2023-06-09T04:39:21.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.846+0000 7f6c11d9b640 1 --2- 172.21.15.18:0/646617253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c140cbd40 0x7f6c14069600 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c080097c0 tx=0x7f6c0801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17e6ad17f37dee8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c1159a640 1 -- 172.21.15.18:0/646617253 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c001b80 con 0x7f6c140cbd40 2023-06-09T04:39:21.851 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c1159a640 1 -- 172.21.15.18:0/646617253 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080a7050 con 0x7f6c140cbd40 2023-06-09T04:39:21.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c1159a640 1 -- 172.21.15.18:0/646617253 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080ab600 con 0x7f6c140cbd40 2023-06-09T04:39:21.852 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/646617253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c140cbd40 msgr2=0x7f6c14069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/646617253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c140cbd40 0x7f6c14069600 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c080097c0 tx=0x7f6c0801c370 comp rx=0 tx=0).stop 2023-06-09T04:39:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/646617253 shutdown_connections 2023-06-09T04:39:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/646617253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c140cbd40 0x7f6c14069600 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/646617253 >> 172.21.15.18:0/646617253 conn(0x7f6c140afa90 msgr2=0x7f6c140afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/646617253 shutdown_connections 2023-06-09T04:39:21.853 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/646617253 wait complete. 2023-06-09T04:39:21.854 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 Processor -- start 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- start start 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c140cbd40 0x7f6c141599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6c141591c0 0x7f6c1414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 0x7f6c1415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1415c600 con 0x7f6c14159590 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141503a0 con 0x7f6c140cbd40 2023-06-09T04:39:21.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141647a0 con 0x7f6c141591c0 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 0x7f6c1415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 0x7f6c1415a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52692/0 (socket says 172.21.15.18:52692) 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 -- 172.21.15.18:0/598550240 learned_addr learned my addr 172.21.15.18:0/598550240 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c11d9b640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6c141591c0 0x7f6c1414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c1259c640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c140cbd40 0x7f6c141599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 -- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6c141591c0 msgr2=0x7f6c1414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6c141591c0 0x7f6c1414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 -- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c140cbd40 msgr2=0x7f6c141599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:21.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c140cbd40 0x7f6c141599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:21.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 -- 172.21.15.18:0/598550240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08009420 con 0x7f6c14159590 2023-06-09T04:39:21.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c12d9d640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 0x7f6c1415a240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c3c0 tx=0x7f6c0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04005220 con 0x7f6c14159590 2023-06-09T04:39:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04005380 con 0x7f6c14159590 2023-06-09T04:39:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04007270 con 0x7f6c14159590 2023-06-09T04:39:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c14164a80 con 0x7f6c14159590 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.850+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1415c290 con 0x7f6c14159590 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.854+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1415c0f0 con 0x7f6c14159590 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.854+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c040073d0 con 0x7f6c14159590 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.854+0000 7f6c02ffd640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6bf4066280 0x7f6bf4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.854+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c040834a0 con 0x7f6c14159590 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.854+0000 7f6c1259c640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6bf4066280 0x7f6bf4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:21.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.854+0000 7f6c1259c640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6bf4066280 0x7f6bf4068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c001390 tx=0x7f6c0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:21.858+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c1415c0f0 con 0x7f6c14159590 2023-06-09T04:39:22.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.010+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c1415c0f0 con 0x7f6c14159590 2023-06-09T04:39:22.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.010+0000 7f6c02ffd640 1 -- 172.21.15.18:0/598550240 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c1415c0f0 con 0x7f6c14159590 2023-06-09T04:39:22.014 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6bf4066280 msgr2=0x7f6bf4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6bf4066280 0x7f6bf4068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c001390 tx=0x7f6c0c009040 comp rx=0 tx=0).stop 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 msgr2=0x7f6c1415a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 0x7f6c1415a240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c3c0 tx=0x7f6c0400c880 comp rx=0 tx=0).stop 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 shutdown_connections 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c14159590 0x7f6c1415a240 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6bf4066280 0x7f6bf4068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6c141591c0 0x7f6c1414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 --2- 172.21.15.18:0/598550240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c140cbd40 0x7f6c141599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 >> 172.21.15.18:0/598550240 conn(0x7f6c140afa90 msgr2=0x7f6c14069600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 shutdown_connections 2023-06-09T04:39:22.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.014+0000 7f6c18ce5640 1 -- 172.21.15.18:0/598550240 wait complete. 2023-06-09T04:39:22.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a6317640 1 Processor -- start 2023-06-09T04:39:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a6317640 1 -- start start 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a6317640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 0x7f60a015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a6317640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00cd820 con 0x7f60a00ccd70 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a6317640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00cc2a0 con 0x7f60a0159300 2023-06-09T04:39:22.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a6317640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00ca2a0 con 0x7f60a00cbe00 2023-06-09T04:39:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f60a00ccd70 0x7f60a00cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43508/0 (socket says 172.21.15.18:43508) 2023-06-09T04:39:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 -- 172.21.15.18:0/1748476362 learned_addr learned my addr 172.21.15.18:0/1748476362 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609f7fe640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 0x7f60a015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754884364 0 0) 0x7f60a00cd820 con 0x7f60a00ccd70 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6088003530 con 0x7f60a00ccd70 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2163890593 0 0) 0x7f6088003530 con 0x7f60a00ccd70 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 msgr2=0x7f60a015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 0x7f60a015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 >> v1:172.21.15.81:6789/0 conn(0x7f60a0159300 legacy=0x7f60a00cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00ca4b0 con 0x7f60a00ccd70 2023-06-09T04:39:22.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f6098001a00 con 0x7f60a00ccd70 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 >> v1:172.21.15.18:6789/0 conn(0x7f60a00ccd70 legacy=0x7f60a00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60880039b0 0x7f6088003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 0x7f60880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f6088005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00ca2a0 con 0x7f6088004d10 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608800ba40 con 0x7f60880039b0 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608800bbd0 con 0x7f60a00cbe00 2023-06-09T04:39:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f6088005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609ffff640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60880039b0 0x7f6088003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609f7fe640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 0x7f60880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 -- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 msgr2=0x7f60880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00cbe00 0x7f60880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 -- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60880039b0 msgr2=0x7f6088003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60880039b0 0x7f6088003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f60a48b4640 1 -- 172.21.15.18:0/1748476362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088003530 con 0x7f6088004d10 2023-06-09T04:39:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.154+0000 7f609ffff640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60880039b0 0x7f6088003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:22.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a48b4640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f6088005180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f609800a810 tx=0x7f609801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132a694c3e2674e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980ad630 con 0x7f6088004d10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980a8070 con 0x7f6088004d10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f609effd640 1 -- 172.21.15.18:0/1748476362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980ad9d0 con 0x7f6088004d10 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 -- 172.21.15.18:0/1748476362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 msgr2=0x7f6088005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 --2- 172.21.15.18:0/1748476362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f6088005180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f609800a810 tx=0x7f609801d300 comp rx=0 tx=0).stop 2023-06-09T04:39:22.165 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a48b4640 1 -- 172.21.15.18:0/1748476362 reap_dead start 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 -- 172.21.15.18:0/1748476362 shutdown_connections 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 -- 172.21.15.18:0/1748476362 >> 172.21.15.18:0/1748476362 conn(0x7f60a006f850 msgr2=0x7f60a006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 -- 172.21.15.18:0/1748476362 shutdown_connections 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 -- 172.21.15.18:0/1748476362 wait complete. 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 Processor -- start 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.158+0000 7f60a6317640 1 -- start start 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f60a0157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60a015bb40 0x7f60a015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00c4190 0x7f60a00c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015c4f0 con 0x7f6088004d10 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00c4b40 con 0x7f60a015bb40 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00c5330 con 0x7f60a00c4190 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f60a0157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f60a0157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52718/0 (socket says 172.21.15.18:52718) 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 -- 172.21.15.18:0/2322252184 learned_addr learned my addr 172.21.15.18:0/2322252184 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609f7fe640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60a015bb40 0x7f60a015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a48b4640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00c4190 0x7f60a00c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 -- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00c4190 msgr2=0x7f60a00c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00c4190 0x7f60a00c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 -- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60a015bb40 msgr2=0x7f60a015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60a015bb40 0x7f60a015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 -- 172.21.15.18:0/2322252184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00b24c0 con 0x7f6088004d10 2023-06-09T04:39:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609ffff640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f60a0157730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6090010f40 tx=0x7f609000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090005270 con 0x7f6088004d10 2023-06-09T04:39:22.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609000d030 con 0x7f6088004d10 2023-06-09T04:39:22.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a00c4d70 con 0x7f6088004d10 2023-06-09T04:39:22.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609000ee50 con 0x7f6088004d10 2023-06-09T04:39:22.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a006add0 con 0x7f6088004d10 2023-06-09T04:39:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a006eb20 con 0x7f6088004d10 2023-06-09T04:39:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6090003600 con 0x7f6088004d10 2023-06-09T04:39:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609cff9640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f608c066280 0x7f608c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6090087810 con 0x7f6088004d10 2023-06-09T04:39:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.162+0000 7f609f7fe640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f608c066280 0x7f608c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.166+0000 7f609f7fe640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f608c066280 0x7f608c068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f60a00ca270 tx=0x7f6094008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.170+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60900549a0 con 0x7f6088004d10 2023-06-09T04:39:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.326+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f60a00b4000 con 0x7f6088004d10 2023-06-09T04:39:22.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f609cff9640 1 -- 172.21.15.18:0/2322252184 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6090057fc0 con 0x7f6088004d10 2023-06-09T04:39:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f608c066280 msgr2=0x7f608c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f608c066280 0x7f608c068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f60a00ca270 tx=0x7f6094008040 comp rx=0 tx=0).stop 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 msgr2=0x7f60a0157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f60a0157730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6090010f40 tx=0x7f609000e530 comp rx=0 tx=0).stop 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 shutdown_connections 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f608c066280 0x7f608c068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60a00c4190 0x7f60a00c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60a015bb40 0x7f60a015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 --2- 172.21.15.18:0/2322252184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6088004d10 0x7f60a0157730 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 >> 172.21.15.18:0/2322252184 conn(0x7f60a006f850 msgr2=0x7f60a0158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 shutdown_connections 2023-06-09T04:39:22.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.330+0000 7f60a6317640 1 -- 172.21.15.18:0/2322252184 wait complete. 2023-06-09T04:39:22.349 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-06-09T04:39:22.349 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:39:22.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:22.478 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.474+0000 7f66a736f640 1 Processor -- start 2023-06-09T04:39:22.479 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.474+0000 7f66a736f640 1 -- start start 2023-06-09T04:39:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a736f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f66a0159320 0x7f66a015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a736f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f66a015d680 0x7f66a006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a736f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a015cf10 con 0x7f66a015dad0 2023-06-09T04:39:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a736f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a015a920 con 0x7f66a015d680 2023-06-09T04:39:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a736f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a00c81b0 con 0x7f66a0159320 2023-06-09T04:39:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f66a015d680 0x7f66a006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f66a015d680 0x7f66a006fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52732/0 (socket says 172.21.15.18:52732) 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 -- 172.21.15.18:0/230943572 learned_addr learned my addr 172.21.15.18:0/230943572 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a510b640 1 --2- 172.21.15.18:0/230943572 >> v2:172.21.15.81:3300/0 conn(0x7f66a0159320 0x7f66a015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 -- 172.21.15.18:0/230943572 >> v2:172.21.15.81:3300/0 conn(0x7f66a0159320 msgr2=0x7f66a015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 --2- 172.21.15.18:0/230943572 >> v2:172.21.15.81:3300/0 conn(0x7f66a0159320 0x7f66a015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 -- 172.21.15.18:0/230943572 >> v1:172.21.15.81:6789/0 conn(0x7f66a015dad0 legacy=0x7f66a00692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 -- 172.21.15.18:0/230943572 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00c8490 con 0x7f66a015d680 2023-06-09T04:39:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a510b640 1 --2- 172.21.15.18:0/230943572 >> v2:172.21.15.81:3300/0 conn(0x7f66a0159320 0x7f66a015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:22.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f66a490a640 1 --2- 172.21.15.18:0/230943572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015d680 0x7f66a006fb60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f66a006f610 tx=0x7f669001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb78e1ef8ca4a54 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f6697fff640 1 -- 172.21.15.18:0/230943572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900ab600 con 0x7f66a015d680 2023-06-09T04:39:22.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f6697fff640 1 -- 172.21.15.18:0/230943572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66900ab760 con 0x7f66a015d680 2023-06-09T04:39:22.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.478+0000 7f6697fff640 1 -- 172.21.15.18:0/230943572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900abaf0 con 0x7f66a015d680 2023-06-09T04:39:22.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- 172.21.15.18:0/230943572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015d680 msgr2=0x7f66a006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 --2- 172.21.15.18:0/230943572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015d680 0x7f66a006fb60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f66a006f610 tx=0x7f669001c400 comp rx=0 tx=0).stop 2023-06-09T04:39:22.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- 172.21.15.18:0/230943572 shutdown_connections 2023-06-09T04:39:22.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 --2- 172.21.15.18:0/230943572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015d680 0x7f66a006fb60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 --2- 172.21.15.18:0/230943572 >> v2:172.21.15.81:3300/0 conn(0x7f66a0159320 0x7f66a015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- 172.21.15.18:0/230943572 >> 172.21.15.18:0/230943572 conn(0x7f66a00b0240 msgr2=0x7f66a00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- 172.21.15.18:0/230943572 shutdown_connections 2023-06-09T04:39:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- 172.21.15.18:0/230943572 wait complete. 2023-06-09T04:39:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 Processor -- start 2023-06-09T04:39:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- start start 2023-06-09T04:39:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a0159320 0x7f66a0150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66a015d680 0x7f66a014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 0x7f66a01f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01f4000 con 0x7f66a015dad0 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a014d100 con 0x7f66a0159320 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a736f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01f30c0 con 0x7f66a015d680 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 0x7f66a01f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 0x7f66a01f2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52744/0 (socket says 172.21.15.18:52744) 2023-06-09T04:39:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 -- 172.21.15.18:0/1328693695 learned_addr learned my addr 172.21.15.18:0/1328693695 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a510b640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a0159320 0x7f66a0150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a490a640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66a015d680 0x7f66a014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 -- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66a015d680 msgr2=0x7f66a014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66a015d680 0x7f66a014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 -- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a0159320 msgr2=0x7f66a0150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a0159320 0x7f66a0150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.482+0000 7f66a590c640 1 -- 172.21.15.18:0/1328693695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900094d0 con 0x7f66a015dad0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f66a590c640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 0x7f66a01f2b80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f669800b970 tx=0x7f669800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800cb40 con 0x7f66a015dad0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669800cca0 con 0x7f66a015dad0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a01f3380 con 0x7f66a015dad0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698014680 con 0x7f66a015dad0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01f3940 con 0x7f66a015dad0 2023-06-09T04:39:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a01f4140 con 0x7f66a015dad0 2023-06-09T04:39:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f669801d3b0 con 0x7f66a015dad0 2023-06-09T04:39:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f6695ffb640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6684066280 0x7f6684068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6698083d60 con 0x7f66a015dad0 2023-06-09T04:39:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f66a510b640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6684066280 0x7f6684068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.486+0000 7f66a510b640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6684066280 0x7f6684068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66a01ef5d0 tx=0x7f669c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.490+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66a01f4140 con 0x7f66a015dad0 2023-06-09T04:39:22.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.646+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66a01f4140 con 0x7f66a015dad0 2023-06-09T04:39:22.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.646+0000 7f6695ffb640 1 -- 172.21.15.18:0/1328693695 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f66a01f4140 con 0x7f66a015dad0 2023-06-09T04:39:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:22.651 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:22.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6684066280 msgr2=0x7f6684068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6684066280 0x7f6684068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66a01ef5d0 tx=0x7f669c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 msgr2=0x7f66a01f2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 0x7f66a01f2b80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f669800b970 tx=0x7f669800be30 comp rx=0 tx=0).stop 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 shutdown_connections 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66a015dad0 0x7f66a01f2b80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6684066280 0x7f6684068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f66a015d680 0x7f66a014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 --2- 172.21.15.18:0/1328693695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a0159320 0x7f66a0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 >> 172.21.15.18:0/1328693695 conn(0x7f66a00b0240 msgr2=0x7f66a015c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 shutdown_connections 2023-06-09T04:39:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.650+0000 7f66a736f640 1 -- 172.21.15.18:0/1328693695 wait complete. 2023-06-09T04:39:22.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:22.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:22.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.794+0000 7fe79ebfc640 1 Processor -- start 2023-06-09T04:39:22.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.794+0000 7fe79ebfc640 1 -- start start 2023-06-09T04:39:22.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79ebfc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7981595b0 0x7fe7980b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79ebfc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe7980cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79ebfc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe798159980 con 0x7fe7980cc9a0 2023-06-09T04:39:22.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79ebfc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980cbfc0 con 0x7fe7981595b0 2023-06-09T04:39:22.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79ebfc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980ce710 con 0x7fe7980cf890 2023-06-09T04:39:22.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe797fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe7980cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7981595b0 0x7fe7980b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7981595b0 0x7fe7980b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:41896/0 (socket says 172.21.15.18:41896) 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe797fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe7980cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:34594/0 (socket says 172.21.15.18:34594) 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 -- 172.21.15.18:0/2580186124 learned_addr learned my addr 172.21.15.18:0/2580186124 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79d199640 1 --1- 172.21.15.18:0/2580186124 >> v1:172.21.15.81:6789/0 conn(0x7fe7980cc9a0 0x7fe7980b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:56576/0 (socket says 172.21.15.18:56576) 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 -- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 msgr2=0x7fe7980cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 --2- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe7980cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 -- 172.21.15.18:0/2580186124 >> v1:172.21.15.81:6789/0 conn(0x7fe7980cc9a0 legacy=0x7fe7980b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe79c998640 1 -- 172.21.15.18:0/2580186124 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980cabb0 con 0x7fe7981595b0 2023-06-09T04:39:22.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.798+0000 7fe797fff640 1 --2- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe7980cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:39:22.803 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 --2- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7980b2bc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009870 tx=0x7fe78c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db60bd0deac0f9a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe7977fe640 1 -- 172.21.15.18:0/2580186124 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0ab650 con 0x7fe7981595b0 2023-06-09T04:39:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe7977fe640 1 -- 172.21.15.18:0/2580186124 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0ab7b0 con 0x7fe7981595b0 2023-06-09T04:39:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe7977fe640 1 -- 172.21.15.18:0/2580186124 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0abb40 con 0x7fe7981595b0 2023-06-09T04:39:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 msgr2=0x7fe7980b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7980b2bc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009870 tx=0x7fe78c01c540 comp rx=0 tx=0).stop 2023-06-09T04:39:22.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2580186124 shutdown_connections 2023-06-09T04:39:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe7980cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2580186124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7980b2bc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2580186124 >> 172.21.15.18:0/2580186124 conn(0x7fe79806ce60 msgr2=0x7fe79806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2580186124 shutdown_connections 2023-06-09T04:39:22.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2580186124 wait complete. 2023-06-09T04:39:22.806 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 Processor -- start 2023-06-09T04:39:22.806 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- start start 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 0x7fe79814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe79806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7981554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79814ed10 con 0x7fe7980cc9a0 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79814ff60 con 0x7fe7981595b0 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe798150240 con 0x7fe7980cf890 2023-06-09T04:39:22.807 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 0x7fe79814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 0x7fe79814e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52760/0 (socket says 172.21.15.18:52760) 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 -- 172.21.15.18:0/2655396629 learned_addr learned my addr 172.21.15.18:0/2655396629 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe797fff640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe79806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79d199640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7981554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 -- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 msgr2=0x7fe79806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe79806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.808 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 -- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 msgr2=0x7fe7981554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7981554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 -- 172.21.15.18:0/2655396629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe784009420 con 0x7fe7980cc9a0 2023-06-09T04:39:22.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe797fff640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe79806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:22.809 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79c998640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 0x7fe79814e7d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe78c01cde0 tx=0x7fe78c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0be5f0 con 0x7fe7980cc9a0 2023-06-09T04:39:22.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0be750 con 0x7fe7980cc9a0 2023-06-09T04:39:22.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c0094d0 con 0x7fe7980cc9a0 2023-06-09T04:39:22.810 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0beb00 con 0x7fe7980cc9a0 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.802+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7980ce9f0 con 0x7fe7980cc9a0 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.806+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7980b2dc0 con 0x7fe7980cc9a0 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.806+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe78c0b43f0 con 0x7fe7980cc9a0 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.806+0000 7fe7957fa640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe77c066280 0x7fe77c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.806+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe78c11ed50 con 0x7fe7980cc9a0 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.806+0000 7fe797fff640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe77c066280 0x7fe77c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:22.811 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.806+0000 7fe797fff640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe77c066280 0x7fe77c068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7981f7a40 tx=0x7fe784008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:22.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.810+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe78c0ec140 con 0x7fe7980cc9a0 2023-06-09T04:39:22.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.958+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe798073380 con 0x7fe7980cc9a0 2023-06-09T04:39:22.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.958+0000 7fe7957fa640 1 -- 172.21.15.18:0/2655396629 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe78c0c40a0 con 0x7fe7980cc9a0 2023-06-09T04:39:22.961 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:22.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe77c066280 msgr2=0x7fe77c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe77c066280 0x7fe77c068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7981f7a40 tx=0x7fe784008040 comp rx=0 tx=0).stop 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 msgr2=0x7fe79814e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 0x7fe79814e7d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe78c01cde0 tx=0x7fe78c01ad80 comp rx=0 tx=0).stop 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 shutdown_connections 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7981595b0 0x7fe7981554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe77c066280 0x7fe77c068730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7980cf890 0x7fe79806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 --2- 172.21.15.18:0/2655396629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7980cc9a0 0x7fe79814e7d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:22.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 >> 172.21.15.18:0/2655396629 conn(0x7fe79806ce60 msgr2=0x7fe798162dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:22.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 shutdown_connections 2023-06-09T04:39:22.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:22.962+0000 7fe79ebfc640 1 -- 172.21.15.18:0/2655396629 wait complete. 2023-06-09T04:39:22.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.098+0000 7fdb647d6640 1 Processor -- start 2023-06-09T04:39:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.098+0000 7fdb647d6640 1 -- start start 2023-06-09T04:39:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb647d6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 0x7fdb5c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb647d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdb5c0cf890 0x7fdb5c0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb647d6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5c159980 con 0x7fdb5c0cc9a0 2023-06-09T04:39:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb647d6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5c0cbfc0 con 0x7fdb5c0cf890 2023-06-09T04:39:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb647d6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0ce710 con 0x7fdb5c1595b0 2023-06-09T04:39:23.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62d73640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdb5c0cc9a0 0x7fdb5c0b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43520/0 (socket says 172.21.15.18:43520) 2023-06-09T04:39:23.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62d73640 1 -- 172.21.15.18:0/3084762942 learned_addr learned my addr 172.21.15.18:0/3084762942 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 0x7fdb5c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61d71640 1 --2- 172.21.15.18:0/3084762942 >> v2:172.21.15.81:3300/0 conn(0x7fdb5c0cf890 0x7fdb5c0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800772668 0 0) 0x7fdb5c159980 con 0x7fdb5c0cc9a0 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb48003530 con 0x7fdb5c0cc9a0 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651192001 0 0) 0x7fdb48003530 con 0x7fdb5c0cc9a0 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 msgr2=0x7fdb5c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 0x7fdb5c0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 >> v2:172.21.15.81:3300/0 conn(0x7fdb5c0cf890 msgr2=0x7fdb5c0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 --2- 172.21.15.18:0/3084762942 >> v2:172.21.15.81:3300/0 conn(0x7fdb5c0cf890 0x7fdb5c0cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0cabb0 con 0x7fdb5c0cc9a0 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fdb50001680 con 0x7fdb5c0cc9a0 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 >> v1:172.21.15.18:6789/0 conn(0x7fdb5c0cc9a0 legacy=0x7fdb5c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb48003980 0x7fdb48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 0x7fdb480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb48004d10 0x7fdb48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0cbfc0 con 0x7fdb48003980 2023-06-09T04:39:23.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0ce710 con 0x7fdb48004d10 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4800b990 con 0x7fdb5c1595b0 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb48003980 0x7fdb48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb61d71640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 0x7fdb480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62d73640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb48004d10 0x7fdb48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 -- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 msgr2=0x7fdb480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb5c1595b0 0x7fdb480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 -- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb48004d10 msgr2=0x7fdb48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb48004d10 0x7fdb48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.110 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.102+0000 7fdb62572640 1 -- 172.21.15.18:0/3084762942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48003530 con 0x7fdb48003980 2023-06-09T04:39:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb62572640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb48003980 0x7fdb48003d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009fc0 tx=0x7fdb5401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1950c007a843b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540a5a50 con 0x7fdb48003980 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400f040 con 0x7fdb48003980 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb61570640 1 -- 172.21.15.18:0/3084762942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540a5df0 con 0x7fdb48003980 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 -- 172.21.15.18:0/3084762942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb48003980 msgr2=0x7fdb48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 --2- 172.21.15.18:0/3084762942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb48003980 0x7fdb48003d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009fc0 tx=0x7fdb5401cc00 comp rx=0 tx=0).stop 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb62d73640 1 -- 172.21.15.18:0/3084762942 reap_dead start 2023-06-09T04:39:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 -- 172.21.15.18:0/3084762942 shutdown_connections 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 -- 172.21.15.18:0/3084762942 >> 172.21.15.18:0/3084762942 conn(0x7fdb5c06ce60 msgr2=0x7fdb5c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 -- 172.21.15.18:0/3084762942 shutdown_connections 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 -- 172.21.15.18:0/3084762942 wait complete. 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 Processor -- start 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 -- start start 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.106+0000 7fdb647d6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb48003980 0x7fdb5c0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5c0c4dd0 0x7fdb5c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 0x7fdb5c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0c60f0 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0c5240 con 0x7fdb5c0c4dd0 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c14b620 con 0x7fdb48003980 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 0x7fdb5c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 0x7fdb5c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52778/0 (socket says 172.21.15.18:52778) 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 -- 172.21.15.18:0/4190610178 learned_addr learned my addr 172.21.15.18:0/4190610178 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62572640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb48003980 0x7fdb5c0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.114 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb61d71640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5c0c4dd0 0x7fdb5c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 -- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb48003980 msgr2=0x7fdb5c0c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb48003980 0x7fdb5c0c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 -- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5c0c4dd0 msgr2=0x7fdb5c15b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5c0c4dd0 0x7fdb5c15b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 -- 172.21.15.18:0/4190610178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0ce9f0 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62d73640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 0x7fdb5c15c160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001060 tx=0x7fdb5000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000eda0 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.116 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb50014480 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c15c6a0 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50014830 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c0c5750 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5c0c6230 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb5001d3b0 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb4effd640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb40066280 0x7fdb40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb50083020 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62572640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb40066280 0x7fdb40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.110+0000 7fdb62572640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb40066280 0x7fdb40068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb540af000 tx=0x7fdb540a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.118 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.114+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb5c0c6230 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.270+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb5c0c6230 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb4effd640 1 -- 172.21.15.18:0/4190610178 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb5c0c6230 con 0x7fdb5c15bcc0 2023-06-09T04:39:23.276 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb40066280 msgr2=0x7fdb40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb40066280 0x7fdb40068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb540af000 tx=0x7fdb540a7040 comp rx=0 tx=0).stop 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 msgr2=0x7fdb5c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 0x7fdb5c15c160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001060 tx=0x7fdb5000e7c0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 shutdown_connections 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb5c15bcc0 0x7fdb5c15c160 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb5c0c4dd0 0x7fdb5c15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdb40066280 0x7fdb40068730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 --2- 172.21.15.18:0/4190610178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdb48003980 0x7fdb5c0c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 >> 172.21.15.18:0/4190610178 conn(0x7fdb5c06ce60 msgr2=0x7fdb5c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 shutdown_connections 2023-06-09T04:39:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.274+0000 7fdb647d6640 1 -- 172.21.15.18:0/4190610178 wait complete. 2023-06-09T04:39:23.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:23.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.418+0000 7f8643dc4640 1 Processor -- start 2023-06-09T04:39:23.422 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.418+0000 7f8643dc4640 1 -- start start 2023-06-09T04:39:23.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.418+0000 7f8643dc4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f863c0b40e0 0x7f863c15f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.418+0000 7f8643dc4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c15fd40 con 0x7f863c15b600 2023-06-09T04:39:23.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.418+0000 7f8643dc4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c160020 con 0x7f863c15f280 2023-06-09T04:39:23.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.418+0000 7f8643dc4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0cfce0 con 0x7f863c0b40e0 2023-06-09T04:39:23.423 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8642361640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f863c0b40e0 0x7f863c15f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8641b60640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f863c15b600 0x7f863c0b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43534/0 (socket says 172.21.15.18:43534) 2023-06-09T04:39:23.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8641b60640 1 -- 172.21.15.18:0/964122188 learned_addr learned my addr 172.21.15.18:0/964122188 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:23.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8642361640 1 -- 172.21.15.18:0/964122188 >> v1:172.21.15.81:6789/0 conn(0x7f863c15f280 legacy=0x7f863c0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.424 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8642361640 1 -- 172.21.15.18:0/964122188 >> v1:172.21.15.18:6789/0 conn(0x7f863c15b600 legacy=0x7f863c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8642361640 1 -- 172.21.15.18:0/964122188 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0cfef0 con 0x7f863c0b40e0 2023-06-09T04:39:23.425 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8642361640 1 --2- 172.21.15.18:0/964122188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c0b40e0 0x7f863c15f700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f86380097c0 tx=0x7f863801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d689cb90870335d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8640b5e640 1 -- 172.21.15.18:0/964122188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380a8050 con 0x7f863c0b40e0 2023-06-09T04:39:23.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8640b5e640 1 -- 172.21.15.18:0/964122188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86380ac5f0 con 0x7f863c0b40e0 2023-06-09T04:39:23.426 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8640b5e640 1 -- 172.21.15.18:0/964122188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86380ac980 con 0x7f863c0b40e0 2023-06-09T04:39:23.427 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 -- 172.21.15.18:0/964122188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c0b40e0 msgr2=0x7f863c15f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.427 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 --2- 172.21.15.18:0/964122188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c0b40e0 0x7f863c15f700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f86380097c0 tx=0x7f863801c480 comp rx=0 tx=0).stop 2023-06-09T04:39:23.427 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 -- 172.21.15.18:0/964122188 shutdown_connections 2023-06-09T04:39:23.427 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 --2- 172.21.15.18:0/964122188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c0b40e0 0x7f863c15f700 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.427 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 -- 172.21.15.18:0/964122188 >> 172.21.15.18:0/964122188 conn(0x7f863c0d2120 msgr2=0x7f863c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 -- 172.21.15.18:0/964122188 shutdown_connections 2023-06-09T04:39:23.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.422+0000 7f8643dc4640 1 -- 172.21.15.18:0/964122188 wait complete. 2023-06-09T04:39:23.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 Processor -- start 2023-06-09T04:39:23.428 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 -- start start 2023-06-09T04:39:23.429 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f863c0b40e0 0x7f863c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 0x7f863c1f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c15f280 0x7f863c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c15c330 con 0x7f863c15b600 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c151410 con 0x7f863c15f280 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c15bd00 con 0x7f863c0b40e0 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 0x7f863c1f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 0x7f863c1f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52804/0 (socket says 172.21.15.18:52804) 2023-06-09T04:39:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 -- 172.21.15.18:0/2025221352 learned_addr learned my addr 172.21.15.18:0/2025221352 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8641b60640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f863c0b40e0 0x7f863c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8642361640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c15f280 0x7f863c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 -- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f863c0b40e0 msgr2=0x7f863c150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f863c0b40e0 0x7f863c150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 -- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c15f280 msgr2=0x7f863c0b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.432 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c15f280 0x7f863c0b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 -- 172.21.15.18:0/2025221352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8638009420 con 0x7f863c15b600 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8641b60640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f863c0b40e0 0x7f863c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f864135f640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 0x7f863c1f6dc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f862c00c3f0 tx=0x7f862c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0052d0 con 0x7f863c15b600 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c005430 con 0x7f863c15b600 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c1f7840 con 0x7f863c15b600 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c003840 con 0x7f863c15b600 2023-06-09T04:39:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.426+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c15bf50 con 0x7f863c15b600 2023-06-09T04:39:23.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.430+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c15c470 con 0x7f863c15b600 2023-06-09T04:39:23.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.430+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f862c0039a0 con 0x7f863c15b600 2023-06-09T04:39:23.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.430+0000 7f86327fc640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8620066280 0x7f8620068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.430+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f862c083590 con 0x7f863c15b600 2023-06-09T04:39:23.435 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.430+0000 7f8641b60640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8620066280 0x7f8620068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.435 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.430+0000 7f8641b60640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8620066280 0x7f8620068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8634005c10 tx=0x7f8634009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.437 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.434+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f863c15c470 con 0x7f863c15b600 2023-06-09T04:39:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.586+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f863c15c470 con 0x7f863c15b600 2023-06-09T04:39:23.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.586+0000 7f86327fc640 1 -- 172.21.15.18:0/2025221352 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f863c15c470 con 0x7f863c15b600 2023-06-09T04:39:23.591 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8620066280 msgr2=0x7f8620068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8620066280 0x7f8620068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8634005c10 tx=0x7f8634009040 comp rx=0 tx=0).stop 2023-06-09T04:39:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 msgr2=0x7f863c1f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 0x7f863c1f6dc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f862c00c3f0 tx=0x7f862c00c8b0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 shutdown_connections 2023-06-09T04:39:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f863c15f280 0x7f863c0b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f863c15b600 0x7f863c1f6dc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8620066280 0x7f8620068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 --2- 172.21.15.18:0/2025221352 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f863c0b40e0 0x7f863c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 >> 172.21.15.18:0/2025221352 conn(0x7f863c0d2120 msgr2=0x7f863c0cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 shutdown_connections 2023-06-09T04:39:23.595 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.590+0000 7f8643dc4640 1 -- 172.21.15.18:0/2025221352 wait complete. 2023-06-09T04:39:23.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:23.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cc04ae640 1 Processor -- start 2023-06-09T04:39:23.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cc04ae640 1 -- start start 2023-06-09T04:39:23.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cc04ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0cb815cf90 0x7f0cb8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cc04ae640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb8159b40 con 0x7f0cb81503d0 2023-06-09T04:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cc04ae640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb815de10 con 0x7f0cb815a510 2023-06-09T04:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cc04ae640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb80cabb0 con 0x7f0cb815cf90 2023-06-09T04:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cbda49640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0cb815cf90 0x7f0cb8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cbe24a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0cb81503d0 0x7f0cb8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43546/0 (socket says 172.21.15.18:43546) 2023-06-09T04:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cbe24a640 1 -- 172.21.15.18:0/3297433485 learned_addr learned my addr 172.21.15.18:0/3297433485 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cbda49640 1 -- 172.21.15.18:0/3297433485 >> v1:172.21.15.81:6789/0 conn(0x7f0cb815a510 legacy=0x7f0cb806c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cbda49640 1 -- 172.21.15.18:0/3297433485 >> v1:172.21.15.18:6789/0 conn(0x7f0cb81503d0 legacy=0x7f0cb8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.730+0000 7f0cbda49640 1 -- 172.21.15.18:0/3297433485 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb815d570 con 0x7f0cb815cf90 2023-06-09T04:39:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cbda49640 1 --2- 172.21.15.18:0/3297433485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb815cf90 0x7f0cb8159fd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097c0 tx=0x7f0cb401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7818ae8d5b1eb5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cbd248640 1 -- 172.21.15.18:0/3297433485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40ab600 con 0x7f0cb815cf90 2023-06-09T04:39:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cbd248640 1 -- 172.21.15.18:0/3297433485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb40a7050 con 0x7f0cb815cf90 2023-06-09T04:39:23.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cbd248640 1 -- 172.21.15.18:0/3297433485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40ab980 con 0x7f0cb815cf90 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3297433485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb815cf90 msgr2=0x7f0cb8159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3297433485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb815cf90 0x7f0cb8159fd0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097c0 tx=0x7f0cb401c440 comp rx=0 tx=0).stop 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3297433485 shutdown_connections 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3297433485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb815cf90 0x7f0cb8159fd0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3297433485 >> 172.21.15.18:0/3297433485 conn(0x7f0cb80b0b10 msgr2=0x7f0cb80ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3297433485 shutdown_connections 2023-06-09T04:39:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3297433485 wait complete. 2023-06-09T04:39:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 Processor -- start 2023-06-09T04:39:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.734+0000 7f0cc04ae640 1 -- start start 2023-06-09T04:39:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 0x7f0cb8153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cb815a510 0x7f0cb814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb815cf90 0x7f0cb814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb81489a0 con 0x7f0cb81503d0 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb81510c0 con 0x7f0cb815cf90 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814e930 con 0x7f0cb815a510 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 0x7f0cb8153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 0x7f0cb8153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52818/0 (socket says 172.21.15.18:52818) 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 -- 172.21.15.18:0/3828646376 learned_addr learned my addr 172.21.15.18:0/3828646376 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbda49640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cb815a510 0x7f0cb814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbea4b640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb815cf90 0x7f0cb814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 -- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cb815a510 msgr2=0x7f0cb814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cb815a510 0x7f0cb814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 -- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb815cf90 msgr2=0x7f0cb814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb815cf90 0x7f0cb814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 -- 172.21.15.18:0/3828646376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4009420 con 0x7f0cb81503d0 2023-06-09T04:39:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbe24a640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 0x7f0cb8153100 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800c430 tx=0x7f0ca800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8005cf0 con 0x7f0cb81503d0 2023-06-09T04:39:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8005e50 con 0x7f0cb81503d0 2023-06-09T04:39:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80072d0 con 0x7f0cb81503d0 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb814ec10 con 0x7f0cb81503d0 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb814f1d0 con 0x7f0cb81503d0 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb8151200 con 0x7f0cb81503d0 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ca8007430 con 0x7f0cb81503d0 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0caeffd640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c9c0662b0 0x7f0c9c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0ca80833c0 con 0x7f0cb81503d0 2023-06-09T04:39:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.738+0000 7f0cbda49640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c9c0662b0 0x7f0c9c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.742+0000 7f0cbda49640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c9c0662b0 0x7f0c9c068760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40ad000 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:23.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.742+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ca8050690 con 0x7f0cb81503d0 2023-06-09T04:39:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.894+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cb81507a0 con 0x7f0cb81503d0 2023-06-09T04:39:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.894+0000 7f0caeffd640 1 -- 172.21.15.18:0/3828646376 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ca8053cb0 con 0x7f0cb81503d0 2023-06-09T04:39:23.899 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c9c0662b0 msgr2=0x7f0c9c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c9c0662b0 0x7f0c9c068760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40ad000 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2023-06-09T04:39:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 msgr2=0x7f0cb8153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 0x7f0cb8153100 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800c430 tx=0x7f0ca800c8f0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 shutdown_connections 2023-06-09T04:39:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cb815cf90 0x7f0cb814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0c9c0662b0 0x7f0c9c068760 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cb815a510 0x7f0cb814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 --2- 172.21.15.18:0/3828646376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cb81503d0 0x7f0cb8153100 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 >> 172.21.15.18:0/3828646376 conn(0x7f0cb80b0b10 msgr2=0x7f0cb815aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 shutdown_connections 2023-06-09T04:39:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:23.898+0000 7f0cc04ae640 1 -- 172.21.15.18:0/3828646376 wait complete. 2023-06-09T04:39:23.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 Processor -- start 2023-06-09T04:39:24.032 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 -- start start 2023-06-09T04:39:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 0x7f5898158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5898158dd0 0x7f589815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980c8f30 con 0x7f58980ca1b0 2023-06-09T04:39:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980ce0f0 con 0x7f5898158dd0 2023-06-09T04:39:24.033 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f589c94f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980c9210 con 0x7f58980c89c0 2023-06-09T04:39:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 0x7f5898158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5896d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5898158dd0 0x7f589815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 0x7f5898158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:34644/0 (socket says 172.21.15.18:34644) 2023-06-09T04:39:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 -- 172.21.15.18:0/4271575318 learned_addr learned my addr 172.21.15.18:0/4271575318 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:24.034 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 -- 172.21.15.18:0/4271575318 >> v2:172.21.15.81:3300/0 conn(0x7f5898158dd0 msgr2=0x7f589815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 --2- 172.21.15.18:0/4271575318 >> v2:172.21.15.81:3300/0 conn(0x7f5898158dd0 0x7f589815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 -- 172.21.15.18:0/4271575318 >> v1:172.21.15.81:6789/0 conn(0x7f58980ca1b0 legacy=0x7f58980cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.035 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.030+0000 7f5895d9b640 1 -- 172.21.15.18:0/4271575318 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980c94f0 con 0x7f58980c89c0 2023-06-09T04:39:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f5895d9b640 1 --2- 172.21.15.18:0/4271575318 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 0x7f5898158890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f588c009870 tx=0x7f588c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d6f6a3a65bac09 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589559a640 1 -- 172.21.15.18:0/4271575318 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0ad640 con 0x7f58980c89c0 2023-06-09T04:39:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589559a640 1 -- 172.21.15.18:0/4271575318 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c0ad7a0 con 0x7f58980c89c0 2023-06-09T04:39:24.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589559a640 1 -- 172.21.15.18:0/4271575318 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0adb30 con 0x7f58980c89c0 2023-06-09T04:39:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- 172.21.15.18:0/4271575318 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 msgr2=0x7f5898158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 --2- 172.21.15.18:0/4271575318 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 0x7f5898158890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f588c009870 tx=0x7f588c01c480 comp rx=0 tx=0).stop 2023-06-09T04:39:24.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- 172.21.15.18:0/4271575318 shutdown_connections 2023-06-09T04:39:24.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 --2- 172.21.15.18:0/4271575318 >> v2:172.21.15.81:3300/0 conn(0x7f5898158dd0 0x7f589815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 --2- 172.21.15.18:0/4271575318 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980c89c0 0x7f5898158890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- 172.21.15.18:0/4271575318 >> 172.21.15.18:0/4271575318 conn(0x7f58980b0b10 msgr2=0x7f58980ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- 172.21.15.18:0/4271575318 shutdown_connections 2023-06-09T04:39:24.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- 172.21.15.18:0/4271575318 wait complete. 2023-06-09T04:39:24.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 Processor -- start 2023-06-09T04:39:24.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- start start 2023-06-09T04:39:24.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58980c89c0 0x7f5898146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980ca1b0 0x7f5898152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 0x7f58981528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898150fc0 con 0x7f5898158dd0 2023-06-09T04:39:24.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898151860 con 0x7f58980c89c0 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f589c94f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898152f00 con 0x7f58980ca1b0 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f5896d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 0x7f58981528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f5896d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 0x7f58981528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52826/0 (socket says 172.21.15.18:52826) 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.034+0000 7f5896d9d640 1 -- 172.21.15.18:0/2370095430 learned_addr learned my addr 172.21.15.18:0/2370095430 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5895d9b640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980ca1b0 0x7f5898152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5896d9d640 1 -- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980ca1b0 msgr2=0x7f5898152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f589659c640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58980c89c0 0x7f5898146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5896d9d640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980ca1b0 0x7f5898152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5896d9d640 1 -- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58980c89c0 msgr2=0x7f5898146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5896d9d640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58980c89c0 0x7f5898146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5896d9d640 1 -- 172.21.15.18:0/2370095430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0094d0 con 0x7f5898158dd0 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5895d9b640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980ca1b0 0x7f5898152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5896d9d640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 0x7f58981528d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f589000efc0 tx=0x7f589000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890009ba0 con 0x7f5898158dd0 2023-06-09T04:39:24.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000f040 con 0x7f5898158dd0 2023-06-09T04:39:24.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898151210 con 0x7f5898158dd0 2023-06-09T04:39:24.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900146c0 con 0x7f5898158dd0 2023-06-09T04:39:24.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589815b050 con 0x7f5898158dd0 2023-06-09T04:39:24.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58981519d0 con 0x7f5898158dd0 2023-06-09T04:39:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5890014820 con 0x7f5898158dd0 2023-06-09T04:39:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5886ffd640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5878066280 0x7f5878068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5890084c40 con 0x7f5898158dd0 2023-06-09T04:39:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f589659c640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5878066280 0x7f5878068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.038+0000 7f589659c640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5878066280 0x7f5878068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5888000f70 tx=0x7f5888009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.042+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5890051cc0 con 0x7f5898158dd0 2023-06-09T04:39:24.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.194+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5898073380 con 0x7f5898158dd0 2023-06-09T04:39:24.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f5886ffd640 1 -- 172.21.15.18:0/2370095430 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5890018020 con 0x7f5898158dd0 2023-06-09T04:39:24.200 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:24.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5878066280 msgr2=0x7f5878068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5878066280 0x7f5878068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5888000f70 tx=0x7f5888009040 comp rx=0 tx=0).stop 2023-06-09T04:39:24.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 msgr2=0x7f58981528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 0x7f58981528d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f589000efc0 tx=0x7f589000c490 comp rx=0 tx=0).stop 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 shutdown_connections 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5898158dd0 0x7f58981528d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5878066280 0x7f5878068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58980ca1b0 0x7f5898152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 --2- 172.21.15.18:0/2370095430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58980c89c0 0x7f5898146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 >> 172.21.15.18:0/2370095430 conn(0x7f58980b0b10 msgr2=0x7f589806cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 shutdown_connections 2023-06-09T04:39:24.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.198+0000 7f589c94f640 1 -- 172.21.15.18:0/2370095430 wait complete. 2023-06-09T04:39:24.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:39:24.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 Processor -- start 2023-06-09T04:39:24.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 -- start start 2023-06-09T04:39:24.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4a4069440 0x7fc4a4069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 0x7fc4a4159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a4159b50 con 0x7fc4a415cfa0 2023-06-09T04:39:24.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a415d4d0 con 0x7fc4a4069440 2023-06-09T04:39:24.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4abf42640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a415d7b0 con 0x7fc4a40c8ab0 2023-06-09T04:39:24.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4a94dd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4a415cfa0 0x7fc4a40ca420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43560/0 (socket says 172.21.15.18:43560) 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4a94dd640 1 -- 172.21.15.18:0/1260171236 learned_addr learned my addr 172.21.15.18:0/1260171236 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4aa4df640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 0x7fc4a4159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4a9cde640 1 --2- 172.21.15.18:0/1260171236 >> v2:172.21.15.81:3300/0 conn(0x7fc4a4069440 0x7fc4a4069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167201646 0 0) 0x7fc4a4159b50 con 0x7fc4a415cfa0 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc490003530 con 0x7fc4a415cfa0 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.330+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2221758161 0 0) 0x7fc490003530 con 0x7fc4a415cfa0 2023-06-09T04:39:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 msgr2=0x7fc4a4159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 0x7fc4a4159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 >> v2:172.21.15.81:3300/0 conn(0x7fc4a4069440 msgr2=0x7fc4a4069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 --2- 172.21.15.18:0/1260171236 >> v2:172.21.15.81:3300/0 conn(0x7fc4a4069440 0x7fc4a4069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a415da90 con 0x7fc4a415cfa0 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fc494001680 con 0x7fc4a415cfa0 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 >> v1:172.21.15.18:6789/0 conn(0x7fc4a415cfa0 legacy=0x7fc4a40ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 0x7fc490003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490003f00 0x7fc4900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc490005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a415d4d0 con 0x7fc490004d10 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a415d7b0 con 0x7fc490003f00 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49000ba70 con 0x7fc4a40c8ab0 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc490005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a94dd640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490003f00 0x7fc4900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a9cde640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 0x7fc490003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 -- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 msgr2=0x7fc490003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40c8ab0 0x7fc490003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 -- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490003f00 msgr2=0x7fc4900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc490003f00 0x7fc4900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 -- 172.21.15.18:0/1260171236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490003530 con 0x7fc490004d10 2023-06-09T04:39:24.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc490005180 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009f90 tx=0x7fc49c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d97f9dbb2cbe8bb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0a5a60 con 0x7fc490004d10 2023-06-09T04:39:24.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00f040 con 0x7fc490004d10 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4a8cdc640 1 -- 172.21.15.18:0/1260171236 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0a5e00 con 0x7fc490004d10 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4abf42640 1 -- 172.21.15.18:0/1260171236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 msgr2=0x7fc490005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4abf42640 1 --2- 172.21.15.18:0/1260171236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc490005180 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009f90 tx=0x7fc49c01cb60 comp rx=0 tx=0).stop 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4aa4df640 1 -- 172.21.15.18:0/1260171236 reap_dead start 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4abf42640 1 -- 172.21.15.18:0/1260171236 shutdown_connections 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4abf42640 1 -- 172.21.15.18:0/1260171236 >> 172.21.15.18:0/1260171236 conn(0x7fc4a40cb960 msgr2=0x7fc4a40ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4abf42640 1 -- 172.21.15.18:0/1260171236 shutdown_connections 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.334+0000 7fc4abf42640 1 -- 172.21.15.18:0/1260171236 wait complete. 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 Processor -- start 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- start start 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc4a41f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40b2460 0x7fc4a40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40b28b0 0x7fc4a40b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40b13e0 con 0x7fc490004d10 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40b16a0 con 0x7fc4a40b2460 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40b1980 con 0x7fc4a40b28b0 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc4a41f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc4a41f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52844/0 (socket says 172.21.15.18:52844) 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 -- 172.21.15.18:0/92530641 learned_addr learned my addr 172.21.15.18:0/92530641 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a94dd640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40b2460 0x7fc4a40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4aa4df640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40b28b0 0x7fc4a40b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 -- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40b28b0 msgr2=0x7fc4a40b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40b28b0 0x7fc4a40b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 -- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40b2460 msgr2=0x7fc4a40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40b2460 0x7fc4a40b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 -- 172.21.15.18:0/92530641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40b1c60 con 0x7fc490004d10 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a94dd640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40b2460 0x7fc4a40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4a9cde640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc4a41f13d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0011660 tx=0x7fc4a0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000f9c0 con 0x7fc490004d10 2023-06-09T04:39:24.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a000fb20 con 0x7fc490004d10 2023-06-09T04:39:24.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a40b1f40 con 0x7fc490004d10 2023-06-09T04:39:24.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000fe90 con 0x7fc490004d10 2023-06-09T04:39:24.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a41f1ae0 con 0x7fc490004d10 2023-06-09T04:39:24.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.338+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a406a0a0 con 0x7fc490004d10 2023-06-09T04:39:24.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.342+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4a0015460 con 0x7fc490004d10 2023-06-09T04:39:24.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.342+0000 7fc49a7fc640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc4880662b0 0x7fc488068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.342+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc4a0084900 con 0x7fc490004d10 2023-06-09T04:39:24.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.342+0000 7fc4a94dd640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc4880662b0 0x7fc488068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.348 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.342+0000 7fc4a94dd640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc4880662b0 0x7fc488068760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4a41517c0 tx=0x7fc494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.349 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.346+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4a0051a90 con 0x7fc490004d10 2023-06-09T04:39:24.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.502+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4a4069dc0 con 0x7fc490004d10 2023-06-09T04:39:24.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.502+0000 7fc49a7fc640 1 -- 172.21.15.18:0/92530641 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc4a00550b0 con 0x7fc490004d10 2023-06-09T04:39:24.506 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2023-06-09T04:39:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc4880662b0 msgr2=0x7fc488068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc4880662b0 0x7fc488068760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4a41517c0 tx=0x7fc494009040 comp rx=0 tx=0).stop 2023-06-09T04:39:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 msgr2=0x7fc4a41f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc4a41f13d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0011660 tx=0x7fc4a0011b20 comp rx=0 tx=0).stop 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 shutdown_connections 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fc4880662b0 0x7fc488068760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc4a40b28b0 0x7fc4a40b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40b2460 0x7fc4a40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 --2- 172.21.15.18:0/92530641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc490004d10 0x7fc4a41f13d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 >> 172.21.15.18:0/92530641 conn(0x7fc4a40cb960 msgr2=0x7fc4a4159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 shutdown_connections 2023-06-09T04:39:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.506+0000 7fc4abf42640 1 -- 172.21.15.18:0/92530641 wait complete. 2023-06-09T04:39:24.524 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2023-06-09T04:39:24.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:24.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-06-09T04:39:24.539 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:24.540 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-06-09T04:39:24.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:24.540 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T04:39:24.588 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-09T04:39:24.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:24.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 Processor -- start 2023-06-09T04:39:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 -- start start 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 0x7f2e1815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e18070270 0x7f2e1806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1815cf10 con 0x7f2e1815d680 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1815a920 con 0x7f2e18070270 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1fe25640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c81b0 con 0x7f2e18159320 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1d3c0640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2e1815d680 0x7f2e1806fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43566/0 (socket says 172.21.15.18:43566) 2023-06-09T04:39:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1d3c0640 1 -- 172.21.15.18:0/130878674 learned_addr learned my addr 172.21.15.18:0/130878674 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:24.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1dbc1640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 0x7f2e1815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 --2- 172.21.15.18:0/130878674 >> v2:172.21.15.81:3300/0 conn(0x7f2e18070270 0x7f2e1806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133757658 0 0) 0x7f2e1815cf10 con 0x7f2e1815d680 2023-06-09T04:39:24.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e04003530 con 0x7f2e1815d680 2023-06-09T04:39:24.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288379120 0 0) 0x7f2e04003530 con 0x7f2e1815d680 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 msgr2=0x7f2e1815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 0x7f2e1815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 >> v2:172.21.15.81:3300/0 conn(0x7f2e18070270 msgr2=0x7f2e1806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 --2- 172.21.15.18:0/130878674 >> v2:172.21.15.81:3300/0 conn(0x7f2e18070270 0x7f2e1806bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180c8490 con 0x7f2e1815d680 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f2e08001680 con 0x7f2e1815d680 2023-06-09T04:39:24.704 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 >> v1:172.21.15.18:6789/0 conn(0x7f2e1815d680 legacy=0x7f2e1806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 0x7f2e04003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e04003f00 0x7f2e040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e04004d10 0x7f2e04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1815a920 con 0x7f2e04004d10 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180c81b0 con 0x7f2e04003f00 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0400b9c0 con 0x7f2e18159320 2023-06-09T04:39:24.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e04004d10 0x7f2e04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1d3c0640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e04003f00 0x7f2e040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1dbc1640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 0x7f2e04003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 -- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 msgr2=0x7f2e04003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e18159320 0x7f2e04003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 -- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e04003f00 msgr2=0x7f2e040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e04003f00 0x7f2e040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.698+0000 7f2e1e3c2640 1 -- 172.21.15.18:0/130878674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04003530 con 0x7f2e04004d10 2023-06-09T04:39:24.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1e3c2640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e04004d10 0x7f2e04005180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009f90 tx=0x7f2e1001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18dee2d93eb78ae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100a5b60 con 0x7f2e04004d10 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000f040 con 0x7f2e04004d10 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1cbbf640 1 -- 172.21.15.18:0/130878674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100ad440 con 0x7f2e04004d10 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- 172.21.15.18:0/130878674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e04004d10 msgr2=0x7f2e04005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/130878674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e04004d10 0x7f2e04005180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009f90 tx=0x7f2e1001cc00 comp rx=0 tx=0).stop 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1e3c2640 1 -- 172.21.15.18:0/130878674 reap_dead start 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- 172.21.15.18:0/130878674 shutdown_connections 2023-06-09T04:39:24.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- 172.21.15.18:0/130878674 >> 172.21.15.18:0/130878674 conn(0x7f2e180b0240 msgr2=0x7f2e180cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- 172.21.15.18:0/130878674 shutdown_connections 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- 172.21.15.18:0/130878674 wait complete. 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 Processor -- start 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- start start 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 0x7f2e181f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e180ca9d0 0x7f2e181eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e181ee310 0x7f2e18157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181f2e90 con 0x7f2e180ca600 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18145f10 con 0x7f2e181ee310 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1fe25640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181461f0 con 0x7f2e180ca9d0 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1dbc1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 0x7f2e181f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1dbc1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 0x7f2e181f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52860/0 (socket says 172.21.15.18:52860) 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.702+0000 7f2e1dbc1640 1 -- 172.21.15.18:0/2271509869 learned_addr learned my addr 172.21.15.18:0/2271509869 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1e3c2640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e181ee310 0x7f2e18157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1dbc1640 1 -- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e180ca9d0 msgr2=0x7f2e181eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1dbc1640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e180ca9d0 0x7f2e181eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1dbc1640 1 -- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e181ee310 msgr2=0x7f2e18157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1dbc1640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e181ee310 0x7f2e18157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1dbc1640 1 -- 172.21.15.18:0/2271509869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e181464d0 con 0x7f2e180ca600 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1dbc1640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 0x7f2e181f2950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2e140115e0 tx=0x7f2e14011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400f8f0 con 0x7f2e180ca600 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1400fa50 con 0x7f2e180ca600 2023-06-09T04:39:24.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e181467b0 con 0x7f2e180ca600 2023-06-09T04:39:24.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400fdc0 con 0x7f2e180ca600 2023-06-09T04:39:24.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181ee780 con 0x7f2e180ca600 2023-06-09T04:39:24.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e180ce690 con 0x7f2e180ca600 2023-06-09T04:39:24.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e14015460 con 0x7f2e180ca600 2023-06-09T04:39:24.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e0e7fc640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dfc0662b0 0x7f2dfc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:24.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e14084470 con 0x7f2e180ca600 2023-06-09T04:39:24.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1d3c0640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dfc0662b0 0x7f2dfc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:24.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.706+0000 7f2e1d3c0640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dfc0662b0 0x7f2dfc068760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2e080017b0 tx=0x7f2e08001500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:24.714 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.710+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e14051690 con 0x7f2e180ca600 2023-06-09T04:39:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.890+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e1806cdd0 con 0x7f2e180ca600 2023-06-09T04:39:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e0e7fc640 1 -- 172.21.15.18:0/2271509869 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f2e14054cb0 con 0x7f2e180ca600 2023-06-09T04:39:24.896 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:24.896 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:39:24.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dfc0662b0 msgr2=0x7f2dfc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dfc0662b0 0x7f2dfc068760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2e080017b0 tx=0x7f2e08001500 comp rx=0 tx=0).stop 2023-06-09T04:39:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 msgr2=0x7f2e181f2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 0x7f2e181f2950 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2e140115e0 tx=0x7f2e14011aa0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 shutdown_connections 2023-06-09T04:39:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e181ee310 0x7f2e18157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dfc0662b0 0x7f2dfc068760 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e180ca9d0 0x7f2e181eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 --2- 172.21.15.18:0/2271509869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e180ca600 0x7f2e181f2950 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 >> 172.21.15.18:0/2271509869 conn(0x7f2e180b0240 msgr2=0x7f2e1815c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 shutdown_connections 2023-06-09T04:39:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:24.894+0000 7f2e1fe25640 1 -- 172.21.15.18:0/2271509869 wait complete. 2023-06-09T04:39:24.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:25.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 Processor -- start 2023-06-09T04:39:25.036 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 -- start start 2023-06-09T04:39:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38f80cbe00 0x7f38f815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.037 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f80ccd70 0x7f38f80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f80cd820 con 0x7f38f8159300 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f80ca2a0 con 0x7f38f80cbe00 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fedfa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f815dee0 con 0x7f38f80ccd70 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38f80cbe00 0x7f38f815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38f80cbe00 0x7f38f815d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52868/0 (socket says 172.21.15.18:52868) 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 -- 172.21.15.18:0/321922371 learned_addr learned my addr 172.21.15.18:0/321922371 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:25.038 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fcb96640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f38f8159300 0x7f38f80cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43570/0 (socket says 172.21.15.18:43570) 2023-06-09T04:39:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38fd397640 1 --2- 172.21.15.18:0/321922371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f80ccd70 0x7f38f80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 -- 172.21.15.18:0/321922371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f80ccd70 msgr2=0x7f38f80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 --2- 172.21.15.18:0/321922371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f80ccd70 0x7f38f80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 -- 172.21.15.18:0/321922371 >> v1:172.21.15.18:6789/0 conn(0x7f38f8159300 legacy=0x7f38f80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f7fff640 1 -- 172.21.15.18:0/321922371 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80cc2a0 con 0x7f38f80cbe00 2023-06-09T04:39:25.039 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.034+0000 7f38f77fe640 1 -- 172.21.15.18:0/321922371 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691768842 0 0) 0x7f38f80cd820 con 0x7f38f8159300 2023-06-09T04:39:25.040 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 --2- 172.21.15.18:0/321922371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80cbe00 0x7f38f815d9a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009870 tx=0x7f38e801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f3cca02e32b5e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f77fe640 1 -- 172.21.15.18:0/321922371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80ab600 con 0x7f38f80cbe00 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f77fe640 1 -- 172.21.15.18:0/321922371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e80a7050 con 0x7f38f80cbe00 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f77fe640 1 -- 172.21.15.18:0/321922371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80ab980 con 0x7f38f80cbe00 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- 172.21.15.18:0/321922371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80cbe00 msgr2=0x7f38f815d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 --2- 172.21.15.18:0/321922371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80cbe00 0x7f38f815d9a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009870 tx=0x7f38e801c540 comp rx=0 tx=0).stop 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- 172.21.15.18:0/321922371 shutdown_connections 2023-06-09T04:39:25.041 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 --2- 172.21.15.18:0/321922371 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f80ccd70 0x7f38f80cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 --2- 172.21.15.18:0/321922371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80cbe00 0x7f38f815d9a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- 172.21.15.18:0/321922371 >> 172.21.15.18:0/321922371 conn(0x7f38f806f850 msgr2=0x7f38f806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- 172.21.15.18:0/321922371 shutdown_connections 2023-06-09T04:39:25.042 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- 172.21.15.18:0/321922371 wait complete. 2023-06-09T04:39:25.043 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 Processor -- start 2023-06-09T04:39:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- start start 2023-06-09T04:39:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38f80cbe00 0x7f38f806c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 0x7f38f80b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f8159300 0x7f38f806ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f806c320 con 0x7f38f80ccd70 2023-06-09T04:39:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f806cc60 con 0x7f38f80cbe00 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fedfa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f806b6a0 con 0x7f38f8159300 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 0x7f38f80b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 0x7f38f80b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52874/0 (socket says 172.21.15.18:52874) 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 -- 172.21.15.18:0/2754726558 learned_addr learned my addr 172.21.15.18:0/2754726558 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fd397640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f8159300 0x7f38f806ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 -- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f8159300 msgr2=0x7f38f806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f8159300 0x7f38f806ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38fcb96640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38f80cbe00 0x7f38f806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 -- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38f80cbe00 msgr2=0x7f38f806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38f80cbe00 0x7f38f806c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.038+0000 7f38f7fff640 1 -- 172.21.15.18:0/2754726558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80094d0 con 0x7f38f80ccd70 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f7fff640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 0x7f38f80b3a50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f38e801abf0 tx=0x7f38e80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80b37d0 con 0x7f38f80ccd70 2023-06-09T04:39:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e80b3930 con 0x7f38f80ccd70 2023-06-09T04:39:25.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f806b980 con 0x7f38f80ccd70 2023-06-09T04:39:25.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80b3ce0 con 0x7f38f80ccd70 2023-06-09T04:39:25.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f806bf40 con 0x7f38f80ccd70 2023-06-09T04:39:25.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f8073380 con 0x7f38f80ccd70 2023-06-09T04:39:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38e80b2070 con 0x7f38f80ccd70 2023-06-09T04:39:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f57fa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f38d8066280 0x7f38d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38e811e2e0 con 0x7f38f80ccd70 2023-06-09T04:39:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38fcb96640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f38d8066280 0x7f38d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.042+0000 7f38fcb96640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f38d8066280 0x7f38d8068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f38e0000f70 tx=0x7f38e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.046+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38e80eb500 con 0x7f38f80ccd70 2023-06-09T04:39:25.205 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.202+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38f806eb20 con 0x7f38f80ccd70 2023-06-09T04:39:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38f57fa640 1 -- 172.21.15.18:0/2754726558 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f38e80bb310 con 0x7f38f80ccd70 2023-06-09T04:39:25.208 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:25.208 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f38d8066280 msgr2=0x7f38d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f38d8066280 0x7f38d8068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f38e0000f70 tx=0x7f38e0009040 comp rx=0 tx=0).stop 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 msgr2=0x7f38f80b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 0x7f38f80b3a50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f38e801abf0 tx=0x7f38e80192e0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 shutdown_connections 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f38d8066280 0x7f38d8068730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f38f8159300 0x7f38f806ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38f80ccd70 0x7f38f80b3a50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 --2- 172.21.15.18:0/2754726558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38f80cbe00 0x7f38f806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 >> 172.21.15.18:0/2754726558 conn(0x7f38f806f850 msgr2=0x7f38f80b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 shutdown_connections 2023-06-09T04:39:25.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.206+0000 7f38fedfa640 1 -- 172.21.15.18:0/2754726558 wait complete. 2023-06-09T04:39:25.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:09.867274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:10.515918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:38:13.609201+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:39:25.227 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17ed090640 1 Processor -- start 2023-06-09T04:39:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17ed090640 1 -- start start 2023-06-09T04:39:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17ed090640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f17e815b7e0 0x7f17e815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17ed090640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e815bbb0 con 0x7f17e815f800 2023-06-09T04:39:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17ed090640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e815fd80 con 0x7f17e80cce90 2023-06-09T04:39:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17ed090640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80ca3c0 con 0x7f17e815b7e0 2023-06-09T04:39:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f17e815f800 0x7f17e80cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43584/0 (socket says 172.21.15.18:43584) 2023-06-09T04:39:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 -- 172.21.15.18:0/3086487926 learned_addr learned my addr 172.21.15.18:0/3086487926 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:25.359 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e6d9d640 1 --2- 172.21.15.18:0/3086487926 >> v2:172.21.15.81:3300/0 conn(0x7f17e815b7e0 0x7f17e815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833231218 0 0) 0x7f17e815bbb0 con 0x7f17e815f800 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d4003530 con 0x7f17e815f800 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616185829 0 0) 0x7f17d4003530 con 0x7f17e815f800 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 >> v2:172.21.15.81:3300/0 conn(0x7f17e815b7e0 msgr2=0x7f17e815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 --2- 172.21.15.18:0/3086487926 >> v2:172.21.15.81:3300/0 conn(0x7f17e815b7e0 0x7f17e815f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 >> v1:172.21.15.81:6789/0 conn(0x7f17e80cce90 legacy=0x7f17e80cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.360 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8160060 con 0x7f17e815f800 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f17d8001680 con 0x7f17e815f800 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 >> v1:172.21.15.18:6789/0 conn(0x7f17e815f800 legacy=0x7f17e80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17d4003980 0x7f17d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d40047d0 0x7f17d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d4005180 0x7f17d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80ca3c0 con 0x7f17d40047d0 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d400c000 con 0x7f17d4003980 2023-06-09T04:39:25.361 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d400c1c0 con 0x7f17d4005180 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d40047d0 0x7f17d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e6d9d640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17d4003980 0x7f17d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e759e640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d4005180 0x7f17d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 -- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d4005180 msgr2=0x7f17d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d4005180 0x7f17d400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 -- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17d4003980 msgr2=0x7f17d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17d4003980 0x7f17d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e659c640 1 -- 172.21.15.18:0/3086487926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4003530 con 0x7f17d40047d0 2023-06-09T04:39:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.354+0000 7f17e759e640 1 -- 172.21.15.18:0/3086487926 reap_dead start 2023-06-09T04:39:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17e659c640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d40047d0 0x7f17d4004c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c240 tx=0x7f17d801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf97f8a8262eebed server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80058e0 con 0x7f17d40047d0 2023-06-09T04:39:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8005a40 con 0x7f17d40047d0 2023-06-09T04:39:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17e5d9b640 1 -- 172.21.15.18:0/3086487926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8005e70 con 0x7f17d40047d0 2023-06-09T04:39:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 -- 172.21.15.18:0/3086487926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d40047d0 msgr2=0x7f17d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d40047d0 0x7f17d4004c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c240 tx=0x7f17d801f3b0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 -- 172.21.15.18:0/3086487926 shutdown_connections 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 --2- 172.21.15.18:0/3086487926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17d40047d0 0x7f17d4004c40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 -- 172.21.15.18:0/3086487926 >> 172.21.15.18:0/3086487926 conn(0x7f17e806ce60 msgr2=0x7f17e806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 -- 172.21.15.18:0/3086487926 shutdown_connections 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 -- 172.21.15.18:0/3086487926 wait complete. 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 Processor -- start 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.358+0000 7f17ed090640 1 -- start start 2023-06-09T04:39:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d40047d0 0x7f17e80c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 0x7f17e8154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e80c9e70 0x7f17e806af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e815ac80 con 0x7f17e80c9a00 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e815a470 con 0x7f17e80c9e70 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80c8580 con 0x7f17d40047d0 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 0x7f17e8154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 0x7f17e8154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52904/0 (socket says 172.21.15.18:52904) 2023-06-09T04:39:25.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 -- 172.21.15.18:0/1094129835 learned_addr learned my addr 172.21.15.18:0/1094129835 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e759e640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e80c9e70 0x7f17e806af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e6d9d640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d40047d0 0x7f17e80c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 -- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d40047d0 msgr2=0x7f17e80c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d40047d0 0x7f17e80c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 -- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e80c9e70 msgr2=0x7f17e806af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e80c9e70 0x7f17e806af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 -- 172.21.15.18:0/1094129835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e815a6c0 con 0x7f17e80c9a00 2023-06-09T04:39:25.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e659c640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 0x7f17e8154970 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f17d8001940 tx=0x7f17d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80b7070 con 0x7f17e80c9a00 2023-06-09T04:39:25.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8000ee0 con 0x7f17e80c9a00 2023-06-09T04:39:25.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8001660 con 0x7f17e80c9a00 2023-06-09T04:39:25.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e815a9a0 con 0x7f17e80c9a00 2023-06-09T04:39:25.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e8154eb0 con 0x7f17e80c9a00 2023-06-09T04:39:25.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e80b0a40 con 0x7f17e80c9a00 2023-06-09T04:39:25.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17d8005bb0 con 0x7f17e80c9a00 2023-06-09T04:39:25.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17df7fe640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f17c80662b0 0x7f17c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17d8120ba0 con 0x7f17e80c9a00 2023-06-09T04:39:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.362+0000 7f17e6d9d640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f17c80662b0 0x7f17c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.366+0000 7f17e6d9d640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f17c80662b0 0x7f17c8068760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f17e804eff0 tx=0x7f17d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.366+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17e80b0a40 con 0x7f17e80c9a00 2023-06-09T04:39:25.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17e80b0a40 con 0x7f17e80c9a00 2023-06-09T04:39:25.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17df7fe640 1 -- 172.21.15.18:0/1094129835 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17e80b0a40 con 0x7f17e80c9a00 2023-06-09T04:39:25.524 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f17c80662b0 msgr2=0x7f17c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f17c80662b0 0x7f17c8068760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f17e804eff0 tx=0x7f17d0008040 comp rx=0 tx=0).stop 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 msgr2=0x7f17e8154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 0x7f17e8154970 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f17d8001940 tx=0x7f17d4005800 comp rx=0 tx=0).stop 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 shutdown_connections 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e80c9e70 0x7f17e806af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17e80c9a00 0x7f17e8154970 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f17c80662b0 0x7f17c8068760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 --2- 172.21.15.18:0/1094129835 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17d40047d0 0x7f17e80c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 >> 172.21.15.18:0/1094129835 conn(0x7f17e806ce60 msgr2=0x7f17e80b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 shutdown_connections 2023-06-09T04:39:25.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.522+0000 7f17ed090640 1 -- 172.21.15.18:0/1094129835 wait complete. 2023-06-09T04:39:25.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 Processor -- start 2023-06-09T04:39:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 -- start start 2023-06-09T04:39:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda481579a0 0x7fda480cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda4806fbd0 0x7fda48070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4815bcb0 con 0x7fda480ad220 2023-06-09T04:39:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480699a0 con 0x7fda4806fbd0 2023-06-09T04:39:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4e57d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda48070550 con 0x7fda481579a0 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4cb1a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda4806fbd0 0x7fda48070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda3ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda480ad220 0x7fda4815b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43596/0 (socket says 172.21.15.18:43596) 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda3ffff640 1 -- 172.21.15.18:0/2876752331 learned_addr learned my addr 172.21.15.18:0/2876752331 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda47fff640 1 --2- 172.21.15.18:0/2876752331 >> v2:172.21.15.81:3300/0 conn(0x7fda481579a0 0x7fda480cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2876752331 >> v2:172.21.15.81:3300/0 conn(0x7fda481579a0 msgr2=0x7fda480cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4cb1a640 1 --2- 172.21.15.18:0/2876752331 >> v2:172.21.15.81:3300/0 conn(0x7fda481579a0 0x7fda480cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2876752331 >> v1:172.21.15.18:6789/0 conn(0x7fda480ad220 legacy=0x7fda4815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda477fe640 1 -- 172.21.15.18:0/2876752331 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741274290 0 0) 0x7fda30001120 con 0x7fda480ad220 2023-06-09T04:39:25.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.662+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2876752331 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4815bef0 con 0x7fda4806fbd0 2023-06-09T04:39:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 --2- 172.21.15.18:0/2876752331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4806fbd0 0x7fda48070010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fda480cb3b0 tx=0x7fda4001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b728c288cd571fab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda477fe640 1 -- 172.21.15.18:0/2876752331 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400a5920 con 0x7fda4806fbd0 2023-06-09T04:39:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda477fe640 1 -- 172.21.15.18:0/2876752331 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda400a5a80 con 0x7fda4806fbd0 2023-06-09T04:39:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda477fe640 1 -- 172.21.15.18:0/2876752331 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400a5e10 con 0x7fda4806fbd0 2023-06-09T04:39:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2876752331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4806fbd0 msgr2=0x7fda48070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2876752331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4806fbd0 0x7fda48070010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fda480cb3b0 tx=0x7fda4001c8e0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2876752331 shutdown_connections 2023-06-09T04:39:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2876752331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4806fbd0 0x7fda48070010 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2876752331 >> v2:172.21.15.81:3300/0 conn(0x7fda481579a0 0x7fda480cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2876752331 >> 172.21.15.18:0/2876752331 conn(0x7fda480afa90 msgr2=0x7fda480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2876752331 shutdown_connections 2023-06-09T04:39:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2876752331 wait complete. 2023-06-09T04:39:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 Processor -- start 2023-06-09T04:39:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- start start 2023-06-09T04:39:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda4806fbd0 0x7fda480b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda481579a0 0x7fda481599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 0x7fda48159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480b14f0 con 0x7fda48141d90 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4815a440 con 0x7fda481579a0 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4814a620 con 0x7fda4806fbd0 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 0x7fda48159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 0x7fda48159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52920/0 (socket says 172.21.15.18:52920) 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2093408429 learned_addr learned my addr 172.21.15.18:0/2093408429 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda47fff640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda4806fbd0 0x7fda480b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda3ffff640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda481579a0 0x7fda481599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda4806fbd0 msgr2=0x7fda480b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda4806fbd0 0x7fda480b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda481579a0 msgr2=0x7fda481599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda481579a0 0x7fda481599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 -- 172.21.15.18:0/2093408429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009a70 con 0x7fda48141d90 2023-06-09T04:39:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda3ffff640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda481579a0 0x7fda481599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4cb1a640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 0x7fda48159f00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fda4001a510 tx=0x7fda40019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400ba070 con 0x7fda48141d90 2023-06-09T04:39:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda400b5490 con 0x7fda48141d90 2023-06-09T04:39:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda480b0bc0 con 0x7fda48141d90 2023-06-09T04:39:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400b5840 con 0x7fda48141d90 2023-06-09T04:39:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.666+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda480b1180 con 0x7fda48141d90 2023-06-09T04:39:25.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.670+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda480b1340 con 0x7fda48141d90 2023-06-09T04:39:25.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.670+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda400be070 con 0x7fda48141d90 2023-06-09T04:39:25.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.670+0000 7fda457fa640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda280662b0 0x7fda28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.675 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.670+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda40120270 con 0x7fda48141d90 2023-06-09T04:39:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.670+0000 7fda47fff640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda280662b0 0x7fda28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.670+0000 7fda47fff640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda280662b0 0x7fda28068760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fda38006fd0 tx=0x7fda38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.676 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.674+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda400ed490 con 0x7fda48141d90 2023-06-09T04:39:25.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.818+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda48073380 con 0x7fda48141d90 2023-06-09T04:39:25.824 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda457fa640 1 -- 172.21.15.18:0/2093408429 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda400f0ab0 con 0x7fda48141d90 2023-06-09T04:39:25.824 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda280662b0 msgr2=0x7fda28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda280662b0 0x7fda28068760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fda38006fd0 tx=0x7fda38008040 comp rx=0 tx=0).stop 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 msgr2=0x7fda48159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 0x7fda48159f00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fda4001a510 tx=0x7fda40019680 comp rx=0 tx=0).stop 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 shutdown_connections 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda48141d90 0x7fda48159f00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda481579a0 0x7fda481599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fda280662b0 0x7fda28068760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 --2- 172.21.15.18:0/2093408429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda4806fbd0 0x7fda480b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 >> 172.21.15.18:0/2093408429 conn(0x7fda480afa90 msgr2=0x7fda480aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 shutdown_connections 2023-06-09T04:39:25.827 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.822+0000 7fda4e57d640 1 -- 172.21.15.18:0/2093408429 wait complete. 2023-06-09T04:39:25.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:39:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 Processor -- start 2023-06-09T04:39:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 -- start start 2023-06-09T04:39:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95501591c0 0x7f95500cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9550159590 0x7f95500cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95500acdf0 0x7f955006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955015de50 con 0x7f95500acdf0 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955015d2d0 con 0x7f9550159590 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f95585e5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955015d5b0 con 0x7f95501591c0 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95500acdf0 0x7f955006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95500acdf0 0x7f955006bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52926/0 (socket says 172.21.15.18:52926) 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 -- 172.21.15.18:0/3524945608 learned_addr learned my addr 172.21.15.18:0/3524945608 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9555b80640 1 --2- 172.21.15.18:0/3524945608 >> v2:172.21.15.81:3300/0 conn(0x7f9550159590 0x7f95500cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556381640 1 --2- 172.21.15.18:0/3524945608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95501591c0 0x7f95500cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.958 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 -- 172.21.15.18:0/3524945608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95501591c0 msgr2=0x7f95500cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 --2- 172.21.15.18:0/3524945608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95501591c0 0x7f95500cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 -- 172.21.15.18:0/3524945608 >> v2:172.21.15.81:3300/0 conn(0x7f9550159590 msgr2=0x7f95500cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 --2- 172.21.15.18:0/3524945608 >> v2:172.21.15.81:3300/0 conn(0x7f9550159590 0x7f95500cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9556b82640 1 -- 172.21.15.18:0/3524945608 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955015d890 con 0x7f95500acdf0 2023-06-09T04:39:25.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.954+0000 7f9555b80640 1 --2- 172.21.15.18:0/3524945608 >> v2:172.21.15.81:3300/0 conn(0x7f9550159590 0x7f95500cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9556b82640 1 --2- 172.21.15.18:0/3524945608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500acdf0 0x7f955006bdd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f955006dd70 tx=0x7f954801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c8fdf41c100b29 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f955537f640 1 -- 172.21.15.18:0/3524945608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95480a5780 con 0x7f95500acdf0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f955537f640 1 -- 172.21.15.18:0/3524945608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95480a58e0 con 0x7f95500acdf0 2023-06-09T04:39:25.960 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f955537f640 1 -- 172.21.15.18:0/3524945608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95480a5c70 con 0x7f95500acdf0 2023-06-09T04:39:25.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- 172.21.15.18:0/3524945608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500acdf0 msgr2=0x7f955006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- 172.21.15.18:0/3524945608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500acdf0 0x7f955006bdd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f955006dd70 tx=0x7f954801c9a0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- 172.21.15.18:0/3524945608 shutdown_connections 2023-06-09T04:39:25.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- 172.21.15.18:0/3524945608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500acdf0 0x7f955006bdd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- 172.21.15.18:0/3524945608 >> v2:172.21.15.81:3300/0 conn(0x7f9550159590 0x7f95500cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- 172.21.15.18:0/3524945608 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95501591c0 0x7f95500cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- 172.21.15.18:0/3524945608 >> 172.21.15.18:0/3524945608 conn(0x7f95500afa90 msgr2=0x7f95500afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:25.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- 172.21.15.18:0/3524945608 shutdown_connections 2023-06-09T04:39:25.962 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- 172.21.15.18:0/3524945608 wait complete. 2023-06-09T04:39:25.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 Processor -- start 2023-06-09T04:39:25.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- start start 2023-06-09T04:39:25.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95500acdf0 0x7f955015c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 0x7f955014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9550159590 0x7f955014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955015af10 con 0x7f95501591c0 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955014edc0 con 0x7f95500acdf0 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f95585e5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955014f0a0 con 0x7f9550159590 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 0x7f955014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 0x7f955014e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52938/0 (socket says 172.21.15.18:52938) 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 -- 172.21.15.18:0/1113958749 learned_addr learned my addr 172.21.15.18:0/1113958749 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 -- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9550159590 msgr2=0x7f955014f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9550159590 0x7f955014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9556381640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95500acdf0 0x7f955015c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 -- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95500acdf0 msgr2=0x7f955015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95500acdf0 0x7f955015c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 -- 172.21.15.18:0/1113958749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548009b30 con 0x7f95501591c0 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.958+0000 7f9555b80640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 0x7f955014e430 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f954000d800 tx=0x7f954000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400096c0 con 0x7f95501591c0 2023-06-09T04:39:25.966 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540009820 con 0x7f95501591c0 2023-06-09T04:39:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955014f380 con 0x7f95501591c0 2023-06-09T04:39:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540009bd0 con 0x7f95501591c0 2023-06-09T04:39:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955015cc00 con 0x7f95501591c0 2023-06-09T04:39:25.967 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9550073380 con 0x7f95501591c0 2023-06-09T04:39:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9540009d30 con 0x7f95501591c0 2023-06-09T04:39:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9546ffd640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9534066280 0x7f9534068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95400846c0 con 0x7f95501591c0 2023-06-09T04:39:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9556381640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9534066280 0x7f9534068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:25.968 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.962+0000 7f9556381640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9534066280 0x7f9534068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:25.969 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:25.966+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95400518e0 con 0x7f95501591c0 2023-06-09T04:39:26.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.114+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f955006a5d0 con 0x7f95501591c0 2023-06-09T04:39:26.117 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.114+0000 7f9546ffd640 1 -- 172.21.15.18:0/1113958749 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9540054f00 con 0x7f95501591c0 2023-06-09T04:39:26.118 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:26.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9534066280 msgr2=0x7f9534068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9534066280 0x7f9534068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).stop 2023-06-09T04:39:26.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 msgr2=0x7f955014e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.120 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 0x7f955014e430 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f954000d800 tx=0x7f954000dcc0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 shutdown_connections 2023-06-09T04:39:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9534066280 0x7f9534068730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9550159590 0x7f955014f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95501591c0 0x7f955014e430 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 --2- 172.21.15.18:0/1113958749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95500acdf0 0x7f955015c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 >> 172.21.15.18:0/1113958749 conn(0x7f95500afa90 msgr2=0x7f95500ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.122 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 shutdown_connections 2023-06-09T04:39:26.122 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.118+0000 7f95585e5640 1 -- 172.21.15.18:0/1113958749 wait complete. 2023-06-09T04:39:26.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:39:26.262 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.258+0000 7fcfdb793640 1 Processor -- start 2023-06-09T04:39:26.263 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.258+0000 7fcfdb793640 1 -- start start 2023-06-09T04:39:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfdb793640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfdb793640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcfd40c3940 0x7fcfd40c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfdb793640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40cc450 con 0x7fcfd41595d0 2023-06-09T04:39:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfdb793640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd415ce40 con 0x7fcfd40c3940 2023-06-09T04:39:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfdb793640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40c42f0 con 0x7fcfd4155d20 2023-06-09T04:39:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd415bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:34778/0 (socket says 172.21.15.18:34778) 2023-06-09T04:39:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 -- 172.21.15.18:0/1362572967 learned_addr learned my addr 172.21.15.18:0/1362572967 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd9d30640 1 --2- 172.21.15.18:0/1362572967 >> v2:172.21.15.81:3300/0 conn(0x7fcfd40c3940 0x7fcfd40c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 -- 172.21.15.18:0/1362572967 >> v2:172.21.15.81:3300/0 conn(0x7fcfd40c3940 msgr2=0x7fcfd40c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 --2- 172.21.15.18:0/1362572967 >> v2:172.21.15.81:3300/0 conn(0x7fcfd40c3940 0x7fcfd40c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 -- 172.21.15.18:0/1362572967 >> v1:172.21.15.81:6789/0 conn(0x7fcfd41595d0 legacy=0x7fcfd406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.266 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 -- 172.21.15.18:0/1362572967 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd415c880 con 0x7fcfd4155d20 2023-06-09T04:39:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.262+0000 7fcfd952f640 1 --2- 172.21.15.18:0/1362572967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd415bf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0006fd0 tx=0x7fcfd001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf9362e2cc379051 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfcbfff640 1 -- 172.21.15.18:0/1362572967 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00ac640 con 0x7fcfd4155d20 2023-06-09T04:39:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfcbfff640 1 -- 172.21.15.18:0/1362572967 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00ac7a0 con 0x7fcfd4155d20 2023-06-09T04:39:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfcbfff640 1 -- 172.21.15.18:0/1362572967 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00acb30 con 0x7fcfd4155d20 2023-06-09T04:39:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- 172.21.15.18:0/1362572967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 msgr2=0x7fcfd415bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 --2- 172.21.15.18:0/1362572967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd415bf10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0006fd0 tx=0x7fcfd001c3b0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- 172.21.15.18:0/1362572967 shutdown_connections 2023-06-09T04:39:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 --2- 172.21.15.18:0/1362572967 >> v2:172.21.15.81:3300/0 conn(0x7fcfd40c3940 0x7fcfd40c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 --2- 172.21.15.18:0/1362572967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd415bf10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- 172.21.15.18:0/1362572967 >> 172.21.15.18:0/1362572967 conn(0x7fcfd40afa90 msgr2=0x7fcfd40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- 172.21.15.18:0/1362572967 shutdown_connections 2023-06-09T04:39:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- 172.21.15.18:0/1362572967 wait complete. 2023-06-09T04:39:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 Processor -- start 2023-06-09T04:39:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- start start 2023-06-09T04:39:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd40c3940 0x7fcfd40b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd41e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 0x7fcfd414a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4152810 con 0x7fcfd41595d0 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40b3030 con 0x7fcfd40c3940 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfdb793640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40b3300 con 0x7fcfd4155d20 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfd9d30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 0x7fcfd414a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfd9d30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 0x7fcfd414a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52950/0 (socket says 172.21.15.18:52950) 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfd9d30640 1 -- 172.21.15.18:0/3028376176 learned_addr learned my addr 172.21.15.18:0/3028376176 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfd952f640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd40c3940 0x7fcfd40b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.266+0000 7fcfd8d2e640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd41e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd9d30640 1 -- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 msgr2=0x7fcfd41e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd9d30640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd41e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd9d30640 1 -- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd40c3940 msgr2=0x7fcfd40b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd9d30640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd40c3940 0x7fcfd40b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd9d30640 1 -- 172.21.15.18:0/3028376176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0009480 con 0x7fcfd41595d0 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd952f640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd40c3940 0x7fcfd40b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd9d30640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 0x7fcfd414a500 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00efc0 tx=0x7fcfcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc014480 con 0x7fcfd41595d0 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc00f040 con 0x7fcfd41595d0 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd40b35e0 con 0x7fcfd41595d0 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc014820 con 0x7fcfd41595d0 2023-06-09T04:39:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd4152d40 con 0x7fcfd41595d0 2023-06-09T04:39:26.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd40b3820 con 0x7fcfd41595d0 2023-06-09T04:39:26.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfcc014980 con 0x7fcfd41595d0 2023-06-09T04:39:26.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfc9ffb640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb8066280 0x7fcfb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfcc084e70 con 0x7fcfd41595d0 2023-06-09T04:39:26.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd952f640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb8066280 0x7fcfb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.276 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.270+0000 7fcfd952f640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb8066280 0x7fcfb8068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ae000 tx=0x7fcfd00a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.274+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfcc052000 con 0x7fcfd41595d0 2023-06-09T04:39:26.430 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.426+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfd4152f60 con 0x7fcfd41595d0 2023-06-09T04:39:26.431 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.426+0000 7fcfc9ffb640 1 -- 172.21.15.18:0/3028376176 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfcc0180a0 con 0x7fcfd41595d0 2023-06-09T04:39:26.431 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2023-06-09T04:39:26.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb8066280 msgr2=0x7fcfb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb8066280 0x7fcfb8068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ae000 tx=0x7fcfd00a6070 comp rx=0 tx=0).stop 2023-06-09T04:39:26.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 msgr2=0x7fcfd414a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 0x7fcfd414a500 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00efc0 tx=0x7fcfcc00c490 comp rx=0 tx=0).stop 2023-06-09T04:39:26.433 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 shutdown_connections 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd41595d0 0x7fcfd414a500 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb8066280 0x7fcfb8068730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd4155d20 0x7fcfd41e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 --2- 172.21.15.18:0/3028376176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd40c3940 0x7fcfd40b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 >> 172.21.15.18:0/3028376176 conn(0x7fcfd40afa90 msgr2=0x7fcfd414b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 shutdown_connections 2023-06-09T04:39:26.434 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.430+0000 7fcfdb793640 1 -- 172.21.15.18:0/3028376176 wait complete. 2023-06-09T04:39:26.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:39:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.566+0000 7f2ef5ea5640 1 Processor -- start 2023-06-09T04:39:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.566+0000 7f2ef5ea5640 1 -- start start 2023-06-09T04:39:26.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2ef5ea5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef00cbd40 0x7f2ef0069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2ef5ea5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef015de50 con 0x7f2ef0159590 2023-06-09T04:39:26.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2ef5ea5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef015d2d0 con 0x7f2ef01591c0 2023-06-09T04:39:26.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2ef5ea5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef015d5b0 con 0x7f2ef00cbd40 2023-06-09T04:39:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2ef0159590 0x7f2ef0069b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43598/0 (socket says 172.21.15.18:43598) 2023-06-09T04:39:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 -- 172.21.15.18:0/1818506660 learned_addr learned my addr 172.21.15.18:0/1818506660 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2ee7fff640 1 --2- 172.21.15.18:0/1818506660 >> v2:172.21.15.81:3300/0 conn(0x7f2ef00cbd40 0x7f2ef0069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852313481 0 0) 0x7f2ef015de50 con 0x7f2ef0159590 2023-06-09T04:39:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2edc003530 con 0x7f2ef0159590 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244744285 0 0) 0x7f2edc003530 con 0x7f2ef0159590 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 >> v2:172.21.15.81:3300/0 conn(0x7f2ef00cbd40 msgr2=0x7f2ef0069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 --2- 172.21.15.18:0/1818506660 >> v2:172.21.15.81:3300/0 conn(0x7f2ef00cbd40 0x7f2ef0069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 >> v1:172.21.15.81:6789/0 conn(0x7f2ef01591c0 legacy=0x7f2ef00cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef015d890 con 0x7f2ef0159590 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f2ee8001a00 con 0x7f2ef0159590 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 >> v1:172.21.15.18:6789/0 conn(0x7f2ef0159590 legacy=0x7f2ef0069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc003980 0x7f2edc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2edc004370 0x7f2edc004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2edc005030 0x7f2edc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef015d5b0 con 0x7f2edc005030 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc00bf80 con 0x7f2edc003980 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc00c140 con 0x7f2edc004370 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2edc005030 0x7f2edc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eef7fe640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc003980 0x7f2edc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2ee7fff640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2edc004370 0x7f2edc004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 -- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2edc004370 msgr2=0x7f2edc004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2edc004370 0x7f2edc004830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 -- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc003980 msgr2=0x7f2edc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc003980 0x7f2edc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.570+0000 7f2eeffff640 1 -- 172.21.15.18:0/1818506660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc003530 con 0x7f2edc005030 2023-06-09T04:39:26.579 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eeffff640 1 -- 172.21.15.18:0/1818506660 reap_dead start 2023-06-09T04:39:26.579 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eeffff640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2edc005030 0x7f2edc00b990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00cd9c0 tx=0x7f2ee801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283fe16e52d32061 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.579 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80af070 con 0x7f2edc005030 2023-06-09T04:39:26.579 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80aa470 con 0x7f2edc005030 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eeeffd640 1 -- 172.21.15.18:0/1818506660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80aa840 con 0x7f2edc005030 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/1818506660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2edc005030 msgr2=0x7f2edc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2edc005030 0x7f2edc00b990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00cd9c0 tx=0x7f2ee801fa40 comp rx=0 tx=0).stop 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/1818506660 shutdown_connections 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/1818506660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2edc005030 0x7f2edc00b990 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/1818506660 >> 172.21.15.18:0/1818506660 conn(0x7f2ef00afa90 msgr2=0x7f2ef00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/1818506660 shutdown_connections 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/1818506660 wait complete. 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 Processor -- start 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- start start 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc005030 0x7f2ef00c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 0x7f2ef00b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ef00b0ed0 0x7f2ef006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0151d40 con 0x7f2ef01454f0 2023-06-09T04:39:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c3f80 con 0x7f2edc005030 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ef5ea5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c4950 con 0x7f2ef00b0ed0 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 0x7f2ef00b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 0x7f2ef00b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52960/0 (socket says 172.21.15.18:52960) 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2ee7fff640 1 -- 172.21.15.18:0/3074026646 learned_addr learned my addr 172.21.15.18:0/3074026646 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eef7fe640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc005030 0x7f2ef00c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.574+0000 7f2eeffff640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ef00b0ed0 0x7f2ef006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ee7fff640 1 -- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ef00b0ed0 msgr2=0x7f2ef006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ee7fff640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ef00b0ed0 0x7f2ef006fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ee7fff640 1 -- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc005030 msgr2=0x7f2ef00c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ee7fff640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc005030 0x7f2ef00c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ee7fff640 1 -- 172.21.15.18:0/3074026646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00c3090 con 0x7f2ef01454f0 2023-06-09T04:39:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ee7fff640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 0x7f2ef00b0990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8010860 tx=0x7f2ed8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8009470 con 0x7f2ef01454f0 2023-06-09T04:39:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800eb60 con 0x7f2ef01454f0 2023-06-09T04:39:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef00c3370 con 0x7f2ef01454f0 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8009e30 con 0x7f2ef01454f0 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef00c3930 con 0x7f2ef01454f0 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef00c4130 con 0x7f2ef01454f0 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ed801c400 con 0x7f2ef01454f0 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eecff9640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2ed0066280 0x7f2ed0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ed8084480 con 0x7f2ef01454f0 2023-06-09T04:39:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.578+0000 7f2eef7fe640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2ed0066280 0x7f2ed0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.582+0000 7f2eef7fe640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2ed0066280 0x7f2ed0068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00054e0 tx=0x7f2ee0007bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.582+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ed80516a0 con 0x7f2ef01454f0 2023-06-09T04:39:26.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.738+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ef0153740 con 0x7f2ef01454f0 2023-06-09T04:39:26.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.738+0000 7f2eecff9640 1 -- 172.21.15.18:0/3074026646 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ed8054cc0 con 0x7f2ef01454f0 2023-06-09T04:39:26.742 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2023-06-09T04:39:26.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2ed0066280 msgr2=0x7f2ed0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2ed0066280 0x7f2ed0068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00054e0 tx=0x7f2ee0007bb0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 msgr2=0x7f2ef00b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 0x7f2ef00b0990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8010860 tx=0x7f2ed8010d20 comp rx=0 tx=0).stop 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 shutdown_connections 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2ed0066280 0x7f2ed0068730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2ef00b0ed0 0x7f2ef006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef01454f0 0x7f2ef00b0990 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 --2- 172.21.15.18:0/3074026646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2edc005030 0x7f2ef00c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 >> 172.21.15.18:0/3074026646 conn(0x7f2ef00afa90 msgr2=0x7f2ef01587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 shutdown_connections 2023-06-09T04:39:26.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.742+0000 7f2ef5ea5640 1 -- 172.21.15.18:0/3074026646 wait complete. 2023-06-09T04:39:26.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.882+0000 7f445be23640 1 Processor -- start 2023-06-09T04:39:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445be23640 1 -- start start 2023-06-09T04:39:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445be23640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 0x7f445406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445be23640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445415cf10 con 0x7f44540700a0 2023-06-09T04:39:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445be23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4454070520 con 0x7f4454159320 2023-06-09T04:39:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445be23640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445415dd90 con 0x7f445415a3e0 2023-06-09T04:39:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445a3c0640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f44540700a0 0x7f445406bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39248/0 (socket says 172.21.15.18:39248) 2023-06-09T04:39:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445a3c0640 1 -- 172.21.15.18:0/3907791270 learned_addr learned my addr 172.21.15.18:0/3907791270 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 0x7f445406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213641782 0 0) 0x7f445415cf10 con 0x7f44540700a0 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4440003530 con 0x7f44540700a0 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865345741 0 0) 0x7f4440003530 con 0x7f44540700a0 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 msgr2=0x7f445406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 0x7f445406fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 >> v1:172.21.15.81:6789/0 conn(0x7f4454159320 legacy=0x7f445415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540c81b0 con 0x7f44540700a0 2023-06-09T04:39:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f444c001a00 con 0x7f44540700a0 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 >> v1:172.21.15.18:6789/0 conn(0x7f44540700a0 legacy=0x7f445406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44400039b0 0x7f4440003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f4440004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 0x7f44400051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445415dd90 con 0x7f44400047d0 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444000ba90 con 0x7f44400039b0 2023-06-09T04:39:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444000bc50 con 0x7f445415a3e0 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f4440004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f4459bbf640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44400039b0 0x7f4440003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f445a3c0640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 0x7f44400051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 -- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 msgr2=0x7f44400051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f445415a3e0 0x7f44400051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 -- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44400039b0 msgr2=0x7f4440003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44400039b0 0x7f4440003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.886+0000 7f44593be640 1 -- 172.21.15.18:0/3907791270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440003530 con 0x7f44400047d0 2023-06-09T04:39:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f44593be640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f4440004c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4448009ae0 tx=0x7f444801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2b787a4139f1b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480a6510 con 0x7f44400047d0 2023-06-09T04:39:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44480a6670 con 0x7f44400047d0 2023-06-09T04:39:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f4458bbd640 1 -- 172.21.15.18:0/3907791270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480a6a20 con 0x7f44400047d0 2023-06-09T04:39:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- 172.21.15.18:0/3907791270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 msgr2=0x7f4440004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 --2- 172.21.15.18:0/3907791270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f4440004c40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4448009ae0 tx=0x7f444801ca20 comp rx=0 tx=0).stop 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445a3c0640 1 -- 172.21.15.18:0/3907791270 reap_dead start 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- 172.21.15.18:0/3907791270 shutdown_connections 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- 172.21.15.18:0/3907791270 >> 172.21.15.18:0/3907791270 conn(0x7f44540b0240 msgr2=0x7f44540cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- 172.21.15.18:0/3907791270 shutdown_connections 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- 172.21.15.18:0/3907791270 wait complete. 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 Processor -- start 2023-06-09T04:39:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- start start 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f44540c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44540c7ad0 0x7f4454154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f445415ded0 0x7f445415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540c4a90 con 0x7f44400047d0 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445415e890 con 0x7f445415ded0 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f445be23640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445415f040 con 0x7f44540c7ad0 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f4459bbf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f44540c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f4459bbf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f44540c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46816/0 (socket says 172.21.15.18:46816) 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.890+0000 7f4459bbf640 1 -- 172.21.15.18:0/751728429 learned_addr learned my addr 172.21.15.18:0/751728429 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44593be640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44540c7ad0 0x7f4454154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f445a3c0640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f445415ded0 0x7f445415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f4459bbf640 1 -- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44540c7ad0 msgr2=0x7f4454154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f4459bbf640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44540c7ad0 0x7f4454154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f4459bbf640 1 -- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f445415ded0 msgr2=0x7f445415e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:26.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f4459bbf640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f445415ded0 0x7f445415e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f4459bbf640 1 -- 172.21.15.18:0/751728429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445415f320 con 0x7f44400047d0 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f4459bbf640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f44540c6d40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f445000e550 tx=0x7f445000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500052e0 con 0x7f44400047d0 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450005440 con 0x7f44400047d0 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445415f600 con 0x7f44400047d0 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450003820 con 0x7f44400047d0 2023-06-09T04:39:26.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540c7280 con 0x7f44400047d0 2023-06-09T04:39:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44540ce690 con 0x7f44400047d0 2023-06-09T04:39:26.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4450003980 con 0x7f44400047d0 2023-06-09T04:39:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44467fc640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4438066280 0x7f4438068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4450083d80 con 0x7f44400047d0 2023-06-09T04:39:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44593be640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4438066280 0x7f4438068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.894+0000 7f44593be640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4438066280 0x7f4438068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44480af000 tx=0x7f44480046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:26.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:26.898+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4450050fa0 con 0x7f44400047d0 2023-06-09T04:39:27.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.078+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4454159b80 con 0x7f44400047d0 2023-06-09T04:39:27.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.078+0000 7f44467fc640 1 -- 172.21.15.18:0/751728429 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f44500545c0 con 0x7f44400047d0 2023-06-09T04:39:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:27.083 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:27.083 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:39:27.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4438066280 msgr2=0x7f4438068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4438066280 0x7f4438068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44480af000 tx=0x7f44480046d0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 msgr2=0x7f44540c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f44540c6d40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f445000e550 tx=0x7f445000ea10 comp rx=0 tx=0).stop 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 shutdown_connections 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f445415ded0 0x7f445415e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4438066280 0x7f4438068730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44540c7ad0 0x7f4454154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 --2- 172.21.15.18:0/751728429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44400047d0 0x7f44540c6d40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 >> 172.21.15.18:0/751728429 conn(0x7f44540b0240 msgr2=0x7f445415b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 shutdown_connections 2023-06-09T04:39:27.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.082+0000 7f445be23640 1 -- 172.21.15.18:0/751728429 wait complete. 2023-06-09T04:39:27.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:27.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.206+0000 7efd4e2b8640 1 Processor -- start 2023-06-09T04:39:27.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.206+0000 7efd4e2b8640 1 -- start start 2023-06-09T04:39:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4e2b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd4806c3c0 0x7efd480ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4e2b8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4806a900 con 0x7efd48158310 2023-06-09T04:39:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4e2b8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4815ceb0 con 0x7efd481586e0 2023-06-09T04:39:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4e2b8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480cd0f0 con 0x7efd4806c3c0 2023-06-09T04:39:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd47fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efd48158310 0x7efd4806bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39254/0 (socket says 172.21.15.18:39254) 2023-06-09T04:39:27.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd47fff640 1 -- 172.21.15.18:0/4155527714 learned_addr learned my addr 172.21.15.18:0/4155527714 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106588480 0 0) 0x7efd4806a900 con 0x7efd48158310 2023-06-09T04:39:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd34003530 con 0x7efd48158310 2023-06-09T04:39:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 --2- 172.21.15.18:0/4155527714 >> v2:172.21.15.81:3300/0 conn(0x7efd4806c3c0 0x7efd480ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042627121 0 0) 0x7efd34003530 con 0x7efd48158310 2023-06-09T04:39:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 >> v2:172.21.15.81:3300/0 conn(0x7efd4806c3c0 msgr2=0x7efd480ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 --2- 172.21.15.18:0/4155527714 >> v2:172.21.15.81:3300/0 conn(0x7efd4806c3c0 0x7efd480ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 >> v1:172.21.15.81:6789/0 conn(0x7efd481586e0 legacy=0x7efd4815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4815cbd0 con 0x7efd48158310 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7efd40001a00 con 0x7efd48158310 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 >> v1:172.21.15.18:6789/0 conn(0x7efd48158310 legacy=0x7efd4806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34003980 0x7efd34003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd340047d0 0x7efd34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd34005180 0x7efd3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480cd0f0 con 0x7efd34005180 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3400c090 con 0x7efd34003980 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3400c250 con 0x7efd340047d0 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd34005180 0x7efd3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd47fff640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34003980 0x7efd34003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd477fe640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd340047d0 0x7efd34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 -- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd340047d0 msgr2=0x7efd34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.216 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd340047d0 0x7efd34004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 -- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34003980 msgr2=0x7efd34003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34003980 0x7efd34003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 -- 172.21.15.18:0/4155527714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd34003530 con 0x7efd34005180 2023-06-09T04:39:27.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd47fff640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34003980 0x7efd34003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 -- 172.21.15.18:0/4155527714 reap_dead start 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.210+0000 7efd4c855640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd34005180 0x7efd3400b990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efd3800ba30 tx=0x7efd3801c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc13b493f31cbce4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38004220 con 0x7efd34005180 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd380043c0 con 0x7efd34005180 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd46ffd640 1 -- 172.21.15.18:0/4155527714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38003860 con 0x7efd34005180 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/4155527714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd34005180 msgr2=0x7efd3400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd34005180 0x7efd3400b990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efd3800ba30 tx=0x7efd3801c6c0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/4155527714 shutdown_connections 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/4155527714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd34005180 0x7efd3400b990 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/4155527714 >> 172.21.15.18:0/4155527714 conn(0x7efd480b0240 msgr2=0x7efd480cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/4155527714 shutdown_connections 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/4155527714 wait complete. 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 Processor -- start 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- start start 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34005180 0x7efd480c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 0x7efd481f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd480c92b0 0x7efd480c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c7450 con 0x7efd480c8e40 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c7db0 con 0x7efd34005180 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f27a0 con 0x7efd480c92b0 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 0x7efd481f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 0x7efd481f1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46830/0 (socket says 172.21.15.18:46830) 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 -- 172.21.15.18:0/2443137888 learned_addr learned my addr 172.21.15.18:0/2443137888 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd47fff640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34005180 0x7efd480c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4c855640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd480c92b0 0x7efd480c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 -- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd480c92b0 msgr2=0x7efd480c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd480c92b0 0x7efd480c35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 -- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34005180 msgr2=0x7efd480c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34005180 0x7efd480c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 -- 172.21.15.18:0/2443137888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd481f2a80 con 0x7efd480c8e40 2023-06-09T04:39:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd477fe640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 0x7efd481f1ce0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efd3000d4f0 tx=0x7efd3000d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30012800 con 0x7efd480c8e40 2023-06-09T04:39:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd30012960 con 0x7efd480c8e40 2023-06-09T04:39:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd480c7070 con 0x7efd480c8e40 2023-06-09T04:39:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30012d10 con 0x7efd480c8e40 2023-06-09T04:39:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.214+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4814b3a0 con 0x7efd480c8e40 2023-06-09T04:39:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.218+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd480c7590 con 0x7efd480c8e40 2023-06-09T04:39:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.218+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd30023350 con 0x7efd480c8e40 2023-06-09T04:39:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.218+0000 7efd44ff9640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efd28066280 0x7efd28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.218+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd30084010 con 0x7efd480c8e40 2023-06-09T04:39:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.218+0000 7efd47fff640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efd28066280 0x7efd28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.218+0000 7efd47fff640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efd28066280 0x7efd28068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd40001b30 tx=0x7efd40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.226 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.222+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd480c7590 con 0x7efd480c8e40 2023-06-09T04:39:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.374+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd480c7590 con 0x7efd480c8e40 2023-06-09T04:39:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.374+0000 7efd44ff9640 1 -- 172.21.15.18:0/2443137888 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7efd480c7590 con 0x7efd480c8e40 2023-06-09T04:39:27.379 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:27.379 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:27.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efd28066280 msgr2=0x7efd28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efd28066280 0x7efd28068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd40001b30 tx=0x7efd40009040 comp rx=0 tx=0).stop 2023-06-09T04:39:27.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 msgr2=0x7efd481f1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 0x7efd481f1ce0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efd3000d4f0 tx=0x7efd3000d9b0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 shutdown_connections 2023-06-09T04:39:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efd28066280 0x7efd28068730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efd480c92b0 0x7efd480c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd480c8e40 0x7efd481f1ce0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 --2- 172.21.15.18:0/2443137888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd34005180 0x7efd480c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 >> 172.21.15.18:0/2443137888 conn(0x7efd480b0240 msgr2=0x7efd480692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 shutdown_connections 2023-06-09T04:39:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.378+0000 7efd4e2b8640 1 -- 172.21.15.18:0/2443137888 wait complete. 2023-06-09T04:39:27.397 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T04:39:27.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:27.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 Processor -- start 2023-06-09T04:39:27.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 -- start start 2023-06-09T04:39:27.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0070270 0x7fb2d00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d00acd10 0x7fb2d00cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00c9010 con 0x7fb2d0157dc0 2023-06-09T04:39:27.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d00cbdc0 con 0x7fb2d00acd10 2023-06-09T04:39:27.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2d4f5c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00ad190 con 0x7fb2d0070270 2023-06-09T04:39:27.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2cdd9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0070270 0x7fb2d00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2ce59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2d0157dc0 0x7fb2d006fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.18:53712/0 (socket says 172.21.15.18:53712) 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2ce59c640 1 -- 172.21.15.18:0/1615242201 learned_addr learned my addr 172.21.15.18:0/1615242201 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2ced9d640 1 --2- 172.21.15.18:0/1615242201 >> v2:172.21.15.81:3300/0 conn(0x7fb2d00acd10 0x7fb2d00cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/1615242201 >> v2:172.21.15.81:3300/0 conn(0x7fb2d00acd10 msgr2=0x7fb2d00cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2cdd9b640 1 --2- 172.21.15.18:0/1615242201 >> v2:172.21.15.81:3300/0 conn(0x7fb2d00acd10 0x7fb2d00cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.514+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/1615242201 >> v1:172.21.15.81:6789/0 conn(0x7fb2d0157dc0 legacy=0x7fb2d006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2cd59a640 1 -- 172.21.15.18:0/1615242201 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575861887 0 0) 0x7fb2d00c9010 con 0x7fb2d0157dc0 2023-06-09T04:39:27.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/1615242201 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00c8460 con 0x7fb2d0070270 2023-06-09T04:39:27.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2cdd9b640 1 --2- 172.21.15.18:0/1615242201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0070270 0x7fb2d00c94a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000a960 tx=0x7fb2c0020040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3577c129bca19ff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2cd59a640 1 -- 172.21.15.18:0/1615242201 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00a9e50 con 0x7fb2d0070270 2023-06-09T04:39:27.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2cd59a640 1 -- 172.21.15.18:0/1615242201 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00b1440 con 0x7fb2d0070270 2023-06-09T04:39:27.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2cd59a640 1 -- 172.21.15.18:0/1615242201 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00b17d0 con 0x7fb2d0070270 2023-06-09T04:39:27.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/1615242201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0070270 msgr2=0x7fb2d00c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/1615242201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0070270 0x7fb2d00c94a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000a960 tx=0x7fb2c0020040 comp rx=0 tx=0).stop 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/1615242201 shutdown_connections 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/1615242201 >> v2:172.21.15.81:3300/0 conn(0x7fb2d00acd10 0x7fb2d00cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/1615242201 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0070270 0x7fb2d00c94a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/1615242201 >> 172.21.15.18:0/1615242201 conn(0x7fb2d00b0240 msgr2=0x7fb2d00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/1615242201 shutdown_connections 2023-06-09T04:39:27.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.518+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/1615242201 wait complete. 2023-06-09T04:39:27.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 Processor -- start 2023-06-09T04:39:27.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- start start 2023-06-09T04:39:27.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d0070270 0x7fb2d014e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 0x7fb2d00c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0157dc0 0x7fb2d00c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00c1fe0 con 0x7fb2d00acd10 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d014ef30 con 0x7fb2d0070270 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00c3460 con 0x7fb2d0157dc0 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 0x7fb2d00c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 0x7fb2d00c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46844/0 (socket says 172.21.15.18:46844) 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/2429115630 learned_addr learned my addr 172.21.15.18:0/2429115630 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:27.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2ced9d640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0157dc0 0x7fb2d00c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2ce59c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d0070270 0x7fb2d014e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0157dc0 msgr2=0x7fb2d00c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0157dc0 0x7fb2d00c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d0070270 msgr2=0x7fb2d014e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d0070270 0x7fb2d014e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 -- 172.21.15.18:0/2429115630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c000a5c0 con 0x7fb2d00acd10 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2ce59c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d0070270 0x7fb2d014e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:27.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2cdd9b640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 0x7fb2d00c2f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000a960 tx=0x7fb2c001e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00b2c90 con 0x7fb2d00acd10 2023-06-09T04:39:27.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00b2df0 con 0x7fb2d00acd10 2023-06-09T04:39:27.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d00c13d0 con 0x7fb2d00acd10 2023-06-09T04:39:27.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0004230 con 0x7fb2d00acd10 2023-06-09T04:39:27.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d00c1990 con 0x7fb2d00acd10 2023-06-09T04:39:27.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d00c2190 con 0x7fb2d00acd10 2023-06-09T04:39:27.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2c0004390 con 0x7fb2d00acd10 2023-06-09T04:39:27.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2c6ffd640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb2b0066280 0x7fb2b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.522+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb2c0121bf0 con 0x7fb2d00acd10 2023-06-09T04:39:27.529 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.526+0000 7fb2ce59c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb2b0066280 0x7fb2b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.526+0000 7fb2ce59c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb2b0066280 0x7fb2b0068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8007fd0 tx=0x7fb2b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.526+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2d00c2190 con 0x7fb2d00acd10 2023-06-09T04:39:27.719 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.714+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d00c2190 con 0x7fb2d00acd10 2023-06-09T04:39:27.720 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2c6ffd640 1 -- 172.21.15.18:0/2429115630 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7fb2d00c2190 con 0x7fb2d00acd10 2023-06-09T04:39:27.720 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:27.720 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:27.721 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:39:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb2b0066280 msgr2=0x7fb2b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb2b0066280 0x7fb2b0068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8007fd0 tx=0x7fb2b8009040 comp rx=0 tx=0).stop 2023-06-09T04:39:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 msgr2=0x7fb2d00c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 0x7fb2d00c2f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000a960 tx=0x7fb2c001e880 comp rx=0 tx=0).stop 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 shutdown_connections 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fb2b0066280 0x7fb2b0068730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb2d0157dc0 0x7fb2d00c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2d00acd10 0x7fb2d00c2f20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 --2- 172.21.15.18:0/2429115630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d0070270 0x7fb2d014e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 >> 172.21.15.18:0/2429115630 conn(0x7fb2d00b0240 msgr2=0x7fb2d00693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 shutdown_connections 2023-06-09T04:39:27.724 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.718+0000 7fb2d4f5c640 1 -- 172.21.15.18:0/2429115630 wait complete. 2023-06-09T04:39:27.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:27.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.850+0000 7f48682b9640 1 Processor -- start 2023-06-09T04:39:27.855 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.850+0000 7f48682b9640 1 -- start start 2023-06-09T04:39:27.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f48682b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4860070270 0x7f48600c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f48682b9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f48600acd10 0x7f48600cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.856 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f48682b9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600c9010 con 0x7f4860157dc0 2023-06-09T04:39:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f48682b9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600cbdc0 con 0x7f48600acd10 2023-06-09T04:39:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f48682b9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600c8460 con 0x7f4860070270 2023-06-09T04:39:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f48600acd10 0x7f48600cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f48600acd10 0x7f48600cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46858/0 (socket says 172.21.15.18:46858) 2023-06-09T04:39:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 -- 172.21.15.18:0/4139192658 learned_addr learned my addr 172.21.15.18:0/4139192658 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4865854640 1 --2- 172.21.15.18:0/4139192658 >> v2:172.21.15.81:3300/0 conn(0x7f4860070270 0x7f48600c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 -- 172.21.15.18:0/4139192658 >> v2:172.21.15.81:3300/0 conn(0x7f4860070270 msgr2=0x7f48600c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 --2- 172.21.15.18:0/4139192658 >> v2:172.21.15.81:3300/0 conn(0x7f4860070270 0x7f48600c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 -- 172.21.15.18:0/4139192658 >> v1:172.21.15.81:6789/0 conn(0x7f4860157dc0 legacy=0x7f486006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 -- 172.21.15.18:0/4139192658 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600ad130 con 0x7f48600acd10 2023-06-09T04:39:27.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4866856640 1 --2- 172.21.15.18:0/4139192658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48600acd10 0x7f48600cb880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f486006b500 tx=0x7f48580213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708bd73817b340 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4865053640 1 -- 172.21.15.18:0/4139192658 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580b3410 con 0x7f48600acd10 2023-06-09T04:39:27.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4865053640 1 -- 172.21.15.18:0/4139192658 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48580ad030 con 0x7f48600acd10 2023-06-09T04:39:27.859 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.854+0000 7f4865053640 1 -- 172.21.15.18:0/4139192658 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580b3790 con 0x7f48600acd10 2023-06-09T04:39:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/4139192658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48600acd10 msgr2=0x7f48600cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 --2- 172.21.15.18:0/4139192658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48600acd10 0x7f48600cb880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f486006b500 tx=0x7f48580213c0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/4139192658 shutdown_connections 2023-06-09T04:39:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 --2- 172.21.15.18:0/4139192658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48600acd10 0x7f48600cb880 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 --2- 172.21.15.18:0/4139192658 >> v2:172.21.15.81:3300/0 conn(0x7f4860070270 0x7f48600c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/4139192658 >> 172.21.15.18:0/4139192658 conn(0x7f48600b0240 msgr2=0x7f48600cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:27.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/4139192658 shutdown_connections 2023-06-09T04:39:27.861 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/4139192658 wait complete. 2023-06-09T04:39:27.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 Processor -- start 2023-06-09T04:39:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- start start 2023-06-09T04:39:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4860070270 0x7f4860156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48600acd10 0x7f486015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 0x7f48601ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601592f0 con 0x7f4860157dc0 2023-06-09T04:39:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486015b330 con 0x7f4860070270 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b2080 con 0x7f48600acd10 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 0x7f48601ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 0x7f48601ec7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46860/0 (socket says 172.21.15.18:46860) 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 -- 172.21.15.18:0/2418467973 learned_addr learned my addr 172.21.15.18:0/2418467973 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4865854640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48600acd10 0x7f486015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866055640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4860070270 0x7f4860156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.864 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 -- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48600acd10 msgr2=0x7f486015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48600acd10 0x7f486015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 -- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4860070270 msgr2=0x7f4860156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4860070270 0x7f4860156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 -- 172.21.15.18:0/2418467973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485800bd40 con 0x7f4860157dc0 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4865854640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48600acd10 0x7f486015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866055640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4860070270 0x7f4860156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4866856640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 0x7f48601ec7e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f485801dfd0 tx=0x7f485801e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.865 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580c4070 con 0x7f4860157dc0 2023-06-09T04:39:27.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800b720 con 0x7f4860157dc0 2023-06-09T04:39:27.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4860159540 con 0x7f4860157dc0 2023-06-09T04:39:27.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580bc400 con 0x7f4860157dc0 2023-06-09T04:39:27.866 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.858+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600b25d0 con 0x7f4860157dc0 2023-06-09T04:39:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.862+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600b27c0 con 0x7f4860157dc0 2023-06-09T04:39:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.862+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48580ba040 con 0x7f4860157dc0 2023-06-09T04:39:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.862+0000 7f4856ffd640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4844066280 0x7f4844068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.862+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4858123b00 con 0x7f4860157dc0 2023-06-09T04:39:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.862+0000 7f4866055640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4844066280 0x7f4844068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:27.867 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.862+0000 7f4866055640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4844066280 0x7f4844068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f48600b3b30 tx=0x7f4850009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:27.868 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:27.866+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48580f47b0 con 0x7f4860157dc0 2023-06-09T04:39:28.046 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.042+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4860073380 con 0x7f4860157dc0 2023-06-09T04:39:28.047 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.042+0000 7f4856ffd640 1 -- 172.21.15.18:0/2418467973 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4667 (secure 0 0 0) 0x7f48580f4340 con 0x7f4860157dc0 2023-06-09T04:39:28.047 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:28.047 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1542666421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1542666421},{"type":"v1","addr":"172.21.15.81:6836","nonce":1542666421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3767750227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3767750227},{"type":"v1","addr":"172.21.15.18:6833","nonce":3767750227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3075141601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":3075141601},{"type":"v1","addr":"172.21.15.18:6835","nonce":3075141601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:11.545685+0000","modified":"2023-06-09T04:38:34.028935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/1214100469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":1214100469},{"type":"v1","addr":"172.21.15.81:6837","nonce":1214100469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:39:28.048 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2023-06-09T04:39:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4844066280 msgr2=0x7f4844068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4844066280 0x7f4844068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f48600b3b30 tx=0x7f4850009040 comp rx=0 tx=0).stop 2023-06-09T04:39:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 msgr2=0x7f48601ec7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 0x7f48601ec7e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f485801dfd0 tx=0x7f485801e160 comp rx=0 tx=0).stop 2023-06-09T04:39:28.049 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 shutdown_connections 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4860157dc0 0x7f48601ec7e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4844066280 0x7f4844068730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f48600acd10 0x7f486015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 --2- 172.21.15.18:0/2418467973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4860070270 0x7f4860156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 >> 172.21.15.18:0/2418467973 conn(0x7f48600b0240 msgr2=0x7f486006c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 shutdown_connections 2023-06-09T04:39:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.046+0000 7f48682b9640 1 -- 172.21.15.18:0/2418467973 wait complete. 2023-06-09T04:39:28.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:28.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 Processor -- start 2023-06-09T04:39:28.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 -- start start 2023-06-09T04:39:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8868158310 0x7f88680ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f886806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f886806c1f0 0x7f886815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680cd0f0 con 0x7f8868158310 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886806a900 con 0x7f886806c1f0 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.186+0000 7f886da26640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886806c630 con 0x7f88681586e0 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8868158310 0x7f88680ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8868158310 0x7f88680ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46864/0 (socket says 172.21.15.18:46864) 2023-06-09T04:39:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 -- 172.21.15.18:0/983471926 learned_addr learned my addr 172.21.15.18:0/983471926 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f885e7fc640 1 --2- 172.21.15.18:0/983471926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f886806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f88677fe640 1 --2- 172.21.15.18:0/983471926 >> v2:172.21.15.81:3300/0 conn(0x7f886806c1f0 0x7f886815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 -- 172.21.15.18:0/983471926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 msgr2=0x7f886806bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 --2- 172.21.15.18:0/983471926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f886806bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 -- 172.21.15.18:0/983471926 >> v2:172.21.15.81:3300/0 conn(0x7f886806c1f0 msgr2=0x7f886815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 --2- 172.21.15.18:0/983471926 >> v2:172.21.15.81:3300/0 conn(0x7f886806c1f0 0x7f886815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 -- 172.21.15.18:0/983471926 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886815ceb0 con 0x7f8868158310 2023-06-09T04:39:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f8866ffd640 1 --2- 172.21.15.18:0/983471926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8868158310 0x7f88680ccbb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f886806f940 tx=0x7f885801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7eb574e97c02bc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f88667fc640 1 -- 172.21.15.18:0/983471926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580ac600 con 0x7f8868158310 2023-06-09T04:39:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f88667fc640 1 -- 172.21.15.18:0/983471926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580a8050 con 0x7f8868158310 2023-06-09T04:39:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f88667fc640 1 -- 172.21.15.18:0/983471926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580ac980 con 0x7f8868158310 2023-06-09T04:39:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 -- 172.21.15.18:0/983471926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8868158310 msgr2=0x7f88680ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 --2- 172.21.15.18:0/983471926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8868158310 0x7f88680ccbb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f886806f940 tx=0x7f885801c4d0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 -- 172.21.15.18:0/983471926 shutdown_connections 2023-06-09T04:39:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 --2- 172.21.15.18:0/983471926 >> v2:172.21.15.81:3300/0 conn(0x7f886806c1f0 0x7f886815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 --2- 172.21.15.18:0/983471926 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f886806bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 --2- 172.21.15.18:0/983471926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8868158310 0x7f88680ccbb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 -- 172.21.15.18:0/983471926 >> 172.21.15.18:0/983471926 conn(0x7f88680b0240 msgr2=0x7f88680cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 -- 172.21.15.18:0/983471926 shutdown_connections 2023-06-09T04:39:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.190+0000 7f886da26640 1 -- 172.21.15.18:0/983471926 wait complete. 2023-06-09T04:39:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 Processor -- start 2023-06-09T04:39:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- start start 2023-06-09T04:39:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 0x7f88680b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868158310 0x7f88680c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f88680c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886814b4f0 con 0x7f886806c1f0 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868148de0 con 0x7f8868158310 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c7250 con 0x7f88681586e0 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 0x7f88680b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 0x7f88680b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46872/0 (socket says 172.21.15.18:46872) 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 -- 172.21.15.18:0/2059322271 learned_addr learned my addr 172.21.15.18:0/2059322271 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 -- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 msgr2=0x7f88680c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f88680c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 -- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868158310 msgr2=0x7f88680c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868158310 0x7f88680c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 -- 172.21.15.18:0/2059322271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580094d0 con 0x7f886806c1f0 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8866ffd640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 0x7f88680b24d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f885801ab80 tx=0x7f885801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580bc070 con 0x7f886806c1f0 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580ace70 con 0x7f886806c1f0 2023-06-09T04:39:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580b7650 con 0x7f886806c1f0 2023-06-09T04:39:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88680c7530 con 0x7f886806c1f0 2023-06-09T04:39:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88680b2a10 con 0x7f886806c1f0 2023-06-09T04:39:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.194+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88680b2c00 con 0x7f886806c1f0 2023-06-09T04:39:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.198+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88580b3070 con 0x7f886806c1f0 2023-06-09T04:39:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.198+0000 7f8864ff9640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8848066280 0x7f8848068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.198+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f885811db90 con 0x7f886806c1f0 2023-06-09T04:39:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.198+0000 7f885e7fc640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8848066280 0x7f8848068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.198+0000 7f885e7fc640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8848066280 0x7f8848068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f88680b3610 tx=0x7f8850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.202+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88680b2c00 con 0x7f886806c1f0 2023-06-09T04:39:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.362+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f886814afe0 con 0x7f886806c1f0 2023-06-09T04:39:28.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.366+0000 7f8864ff9640 1 -- 172.21.15.18:0/2059322271 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20170 (secure 0 0 0) 0x7f886814afe0 con 0x7f886806c1f0 2023-06-09T04:39:28.370 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:28.370 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:38:15.974673+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:09.867274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:10.515918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:38:13.609201+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8848066280 msgr2=0x7f8848068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8848066280 0x7f8848068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f88680b3610 tx=0x7f8850008040 comp rx=0 tx=0).stop 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 msgr2=0x7f88680b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 0x7f88680b24d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f885801ab80 tx=0x7f885801ad10 comp rx=0 tx=0).stop 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 shutdown_connections 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f8848066280 0x7f8848068730 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88681586e0 0x7f88680c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868158310 0x7f88680c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 --2- 172.21.15.18:0/2059322271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886806c1f0 0x7f88680b24d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 >> 172.21.15.18:0/2059322271 conn(0x7f88680b0240 msgr2=0x7f88680c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 shutdown_connections 2023-06-09T04:39:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.370+0000 7f886da26640 1 -- 172.21.15.18:0/2059322271 wait complete. 2023-06-09T04:39:28.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T04:39:28.513 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 Processor -- start 2023-06-09T04:39:28.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 -- start start 2023-06-09T04:39:28.514 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce60159320 0x7fce6015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce6015d680 0x7fce6006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6015cf10 con 0x7fce6015dad0 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6015a920 con 0x7fce6015d680 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce668d2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600c81b0 con 0x7fce60159320 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce57fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce6015d680 0x7fce6006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce64e6f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fce6015dad0 0x7fce600692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39266/0 (socket says 172.21.15.18:39266) 2023-06-09T04:39:28.515 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce64e6f640 1 -- 172.21.15.18:0/61287741 learned_addr learned my addr 172.21.15.18:0/61287741 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce5ffff640 1 --2- 172.21.15.18:0/61287741 >> v2:172.21.15.81:3300/0 conn(0x7fce60159320 0x7fce6015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce57fff640 1 -- 172.21.15.18:0/61287741 >> v2:172.21.15.81:3300/0 conn(0x7fce60159320 msgr2=0x7fce6015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce57fff640 1 --2- 172.21.15.18:0/61287741 >> v2:172.21.15.81:3300/0 conn(0x7fce60159320 0x7fce6015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.510+0000 7fce57fff640 1 -- 172.21.15.18:0/61287741 >> v1:172.21.15.18:6789/0 conn(0x7fce6015dad0 legacy=0x7fce600692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce57fff640 1 -- 172.21.15.18:0/61287741 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600c8490 con 0x7fce6015d680 2023-06-09T04:39:28.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce57fff640 1 --2- 172.21.15.18:0/61287741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce6015d680 0x7fce6006fb60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fce6006f610 tx=0x7fce4801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b0a63e2a226178 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:28.517 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce5f7fe640 1 -- 172.21.15.18:0/61287741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480ac600 con 0x7fce6015d680 2023-06-09T04:39:28.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce5f7fe640 1 -- 172.21.15.18:0/61287741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce480a8050 con 0x7fce6015d680 2023-06-09T04:39:28.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce5f7fe640 1 -- 172.21.15.18:0/61287741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480ac980 con 0x7fce6015d680 2023-06-09T04:39:28.518 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 -- 172.21.15.18:0/61287741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce6015d680 msgr2=0x7fce6006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 --2- 172.21.15.18:0/61287741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce6015d680 0x7fce6006fb60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fce6006f610 tx=0x7fce4801c3a0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 -- 172.21.15.18:0/61287741 shutdown_connections 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 --2- 172.21.15.18:0/61287741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce6015d680 0x7fce6006fb60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 --2- 172.21.15.18:0/61287741 >> v2:172.21.15.81:3300/0 conn(0x7fce60159320 0x7fce6015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 -- 172.21.15.18:0/61287741 >> 172.21.15.18:0/61287741 conn(0x7fce600b0240 msgr2=0x7fce600cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 -- 172.21.15.18:0/61287741 shutdown_connections 2023-06-09T04:39:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.514+0000 7fce668d2640 1 -- 172.21.15.18:0/61287741 wait complete. 2023-06-09T04:39:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 Processor -- start 2023-06-09T04:39:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- start start 2023-06-09T04:39:28.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 0x7fce601631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.521 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce6015d680 0x7fce601583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6015dad0 0x7fce601f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60158930 con 0x7fce60159320 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce601f7b30 con 0x7fce6015dad0 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce601f7e10 con 0x7fce6015d680 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 0x7fce601631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 0x7fce601631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46892/0 (socket says 172.21.15.18:46892) 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 -- 172.21.15.18:0/1040376059 learned_addr learned my addr 172.21.15.18:0/1040376059 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:28.522 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce57fff640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce6015d680 0x7fce601583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce64e6f640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6015dad0 0x7fce601f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 -- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce6015d680 msgr2=0x7fce601583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce6015d680 0x7fce601583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 -- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6015dad0 msgr2=0x7fce601f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6015dad0 0x7fce601f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 -- 172.21.15.18:0/1040376059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce48009420 con 0x7fce60159320 2023-06-09T04:39:28.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5ffff640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 0x7fce601631c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fce5000d800 tx=0x7fce5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:28.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000b6c0 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000b820 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce601f80f0 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000bb90 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600cb910 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.518+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce600ce690 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.522+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce5000bcf0 con 0x7fce60159320 2023-06-09T04:39:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.522+0000 7fce5d7fa640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce40066280 0x7fce40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.522+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce50084630 con 0x7fce60159320 2023-06-09T04:39:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.522+0000 7fce57fff640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce40066280 0x7fce40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.522+0000 7fce57fff640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce40066280 0x7fce40068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fce480ae000 tx=0x7fce48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.526+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce500551b0 con 0x7fce60159320 2023-06-09T04:39:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:28.710+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fce600ca120 con 0x7fce60159320 2023-06-09T04:39:29.355 INFO:tasks.ceph.mon.a.smithi018.stderr:2023-06-09T04:39:29.350+0000 7f0af2cb5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T04:39:29.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.366+0000 7fce5d7fa640 1 -- 172.21.15.18:0/1040376059 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fce50054d40 con 0x7fce60159320 2023-06-09T04:39:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T04:39:29.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce40066280 msgr2=0x7fce40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:29.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce40066280 0x7fce40068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fce480ae000 tx=0x7fce48008040 comp rx=0 tx=0).stop 2023-06-09T04:39:29.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 msgr2=0x7fce601631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:29.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 0x7fce601631c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fce5000d800 tx=0x7fce5000dcc0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 shutdown_connections 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6015dad0 0x7fce601f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fce40066280 0x7fce40068730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce6015d680 0x7fce601583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 --2- 172.21.15.18:0/1040376059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce60159320 0x7fce601631c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 >> 172.21.15.18:0/1040376059 conn(0x7fce600b0240 msgr2=0x7fce6015c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:29.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 shutdown_connections 2023-06-09T04:39:29.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.370+0000 7fce668d2640 1 -- 172.21.15.18:0/1040376059 wait complete. 2023-06-09T04:39:29.379 INFO:tasks.ceph.mds.b.smithi081.stderr: -4553> 2023-06-09T04:38:13.129+0000 7f989636e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:39:29.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T04:39:29.444 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-06-09T04:39:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 Processor -- start 2023-06-09T04:39:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 -- start start 2023-06-09T04:39:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad8406c520 0x7fad840cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad8406c8f0 0x7fad8415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8415fdb0 0x7fad8415b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8415f100 con 0x7fad8406c8f0 2023-06-09T04:39:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8415f3e0 con 0x7fad8406c520 2023-06-09T04:39:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad89e56640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8415c3a0 con 0x7fad8415fdb0 2023-06-09T04:39:29.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad8406c8f0 0x7fad8415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad8406c8f0 0x7fad8415f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46898/0 (socket says 172.21.15.18:46898) 2023-06-09T04:39:29.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 -- 172.21.15.18:0/1618001383 learned_addr learned my addr 172.21.15.18:0/1618001383 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:29.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad837fe640 1 --2- 172.21.15.18:0/1618001383 >> v2:172.21.15.81:3300/0 conn(0x7fad8406c520 0x7fad840cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.531 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad83fff640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8415fdb0 0x7fad8415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 -- 172.21.15.18:0/1618001383 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8415fdb0 msgr2=0x7fad8415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:29.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8415fdb0 0x7fad8415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 -- 172.21.15.18:0/1618001383 >> v2:172.21.15.81:3300/0 conn(0x7fad8406c520 msgr2=0x7fad840cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:29.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 --2- 172.21.15.18:0/1618001383 >> v2:172.21.15.81:3300/0 conn(0x7fad8406c520 0x7fad840cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad82ffd640 1 -- 172.21.15.18:0/1618001383 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8415c680 con 0x7fad8406c8f0 2023-06-09T04:39:29.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.526+0000 7fad83fff640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8415fdb0 0x7fad8415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:29.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad82ffd640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8406c8f0 0x7fad8415f870 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad84070260 tx=0x7fad7801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf00186962886fd1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:29.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad827fc640 1 -- 172.21.15.18:0/1618001383 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780ab600 con 0x7fad8406c8f0 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad827fc640 1 -- 172.21.15.18:0/1618001383 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780a7050 con 0x7fad8406c8f0 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad827fc640 1 -- 172.21.15.18:0/1618001383 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780ab980 con 0x7fad8406c8f0 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 -- 172.21.15.18:0/1618001383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8406c8f0 msgr2=0x7fad8415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8406c8f0 0x7fad8415f870 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad84070260 tx=0x7fad7801c3b0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 -- 172.21.15.18:0/1618001383 shutdown_connections 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8415fdb0 0x7fad8415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 --2- 172.21.15.18:0/1618001383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8406c8f0 0x7fad8415f870 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 --2- 172.21.15.18:0/1618001383 >> v2:172.21.15.81:3300/0 conn(0x7fad8406c520 0x7fad840cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 -- 172.21.15.18:0/1618001383 >> 172.21.15.18:0/1618001383 conn(0x7fad840b0b10 msgr2=0x7fad840ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:29.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 -- 172.21.15.18:0/1618001383 shutdown_connections 2023-06-09T04:39:29.535 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 -- 172.21.15.18:0/1618001383 wait complete. 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 Processor -- start 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.530+0000 7fad89e56640 1 -- start start 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8406c520 0x7fad840ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8406c8f0 0x7fad8414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 0x7fad8414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84157120 con 0x7fad8415fdb0 2023-06-09T04:39:29.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84156510 con 0x7fad8406c520 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad841567f0 con 0x7fad8406c8f0 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 0x7fad8414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 0x7fad8414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46912/0 (socket says 172.21.15.18:46912) 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 -- 172.21.15.18:0/1627086387 learned_addr learned my addr 172.21.15.18:0/1627086387 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad837fe640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8406c520 0x7fad840ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad82ffd640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8406c8f0 0x7fad8414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 -- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8406c8f0 msgr2=0x7fad8414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8406c8f0 0x7fad8414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 -- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8406c520 msgr2=0x7fad840ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8406c520 0x7fad840ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 -- 172.21.15.18:0/1627086387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780094d0 con 0x7fad8415fdb0 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad82ffd640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8406c8f0 0x7fad8414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad83fff640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 0x7fad8414b0d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fad7c007e40 tx=0x7fad7c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003ba0 con 0x7fad8415fdb0 2023-06-09T04:39:29.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00f040 con 0x7fad8415fdb0 2023-06-09T04:39:29.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad84156ad0 con 0x7fad8415fdb0 2023-06-09T04:39:29.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00de80 con 0x7fad8415fdb0 2023-06-09T04:39:29.540 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad840ce600 con 0x7fad8415fdb0 2023-06-09T04:39:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84073380 con 0x7fad8415fdb0 2023-06-09T04:39:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad7c004030 con 0x7fad8415fdb0 2023-06-09T04:39:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad6bfff640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fad70066280 0x7fad70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6899+0+0 (secure 0 0 0) 0x7fad7c084380 con 0x7fad8415fdb0 2023-06-09T04:39:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.534+0000 7fad837fe640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fad70066280 0x7fad70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:29.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.538+0000 7fad837fe640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fad70066280 0x7fad70068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad740045f0 tx=0x7fad74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:29.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.538+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad7c0514d0 con 0x7fad8415fdb0 2023-06-09T04:39:29.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:29.730+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad840cf280 con 0x7fad8415fdb0 2023-06-09T04:39:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.374+0000 7fad6bfff640 1 -- 172.21.15.18:0/1627086387 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fad7c054af0 con 0x7fad8415fdb0 2023-06-09T04:39:30.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fad70066280 msgr2=0x7fad70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fad70066280 0x7fad70068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad740045f0 tx=0x7fad74008040 comp rx=0 tx=0).stop 2023-06-09T04:39:30.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 msgr2=0x7fad8414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 0x7fad8414b0d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fad7c007e40 tx=0x7fad7c00d4a0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 shutdown_connections 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad8415fdb0 0x7fad8414b0d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fad70066280 0x7fad70068730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fad8406c8f0 0x7fad8414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 --2- 172.21.15.18:0/1627086387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8406c520 0x7fad840ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 >> 172.21.15.18:0/1627086387 conn(0x7fad840b0b10 msgr2=0x7fad840692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 shutdown_connections 2023-06-09T04:39:30.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.378+0000 7fad89e56640 1 -- 172.21.15.18:0/1627086387 wait complete. 2023-06-09T04:39:30.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T04:39:30.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b09986640 1 Processor -- start 2023-06-09T04:39:30.532 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b09986640 1 -- start start 2023-06-09T04:39:30.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b09986640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b04142fe0 0x7f5b040cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.533 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b09986640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b04159cc0 con 0x7f5b0406d2c0 2023-06-09T04:39:30.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b09986640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0406c220 con 0x7f5b0406fac0 2023-06-09T04:39:30.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b09986640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0406c500 con 0x7f5b04142fe0 2023-06-09T04:39:30.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b027fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5b0406d2c0 0x7f5b0406b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39280/0 (socket says 172.21.15.18:39280) 2023-06-09T04:39:30.534 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b027fc640 1 -- 172.21.15.18:0/3164742432 learned_addr learned my addr 172.21.15.18:0/3164742432 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b02ffd640 1 --2- 172.21.15.18:0/3164742432 >> v2:172.21.15.81:3300/0 conn(0x7f5b04142fe0 0x7f5b040cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504608123 0 0) 0x7f5b04159cc0 con 0x7f5b0406d2c0 2023-06-09T04:39:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af0003530 con 0x7f5b0406d2c0 2023-06-09T04:39:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681749404 0 0) 0x7f5af0003530 con 0x7f5b0406d2c0 2023-06-09T04:39:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 >> v2:172.21.15.81:3300/0 conn(0x7f5b04142fe0 msgr2=0x7f5b040cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 --2- 172.21.15.18:0/3164742432 >> v2:172.21.15.81:3300/0 conn(0x7f5b04142fe0 0x7f5b040cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 >> v1:172.21.15.81:6789/0 conn(0x7f5b0406fac0 legacy=0x7f5b0406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0406c7e0 con 0x7f5b0406d2c0 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f5aec001680 con 0x7f5b0406d2c0 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 >> v1:172.21.15.18:6789/0 conn(0x7f5b0406d2c0 legacy=0x7f5b0406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0003980 0x7f5af0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00047d0 0x7f5af0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.537 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5af0005180 0x7f5af000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0406c500 con 0x7f5af00047d0 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af000bfe0 con 0x7f5af0003980 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af000c1a0 con 0x7f5af0005180 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b027fc640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00047d0 0x7f5af0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b02ffd640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0003980 0x7f5af0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b037fe640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5af0005180 0x7f5af000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b027fc640 1 -- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5af0005180 msgr2=0x7f5af000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.530+0000 7f5b027fc640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5af0005180 0x7f5af000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b027fc640 1 -- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0003980 msgr2=0x7f5af0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b027fc640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0003980 0x7f5af0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b027fc640 1 -- 172.21.15.18:0/3164742432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0003530 con 0x7f5af00047d0 2023-06-09T04:39:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b037fe640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5af0005180 0x7f5af000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b037fe640 1 -- 172.21.15.18:0/3164742432 reap_dead start 2023-06-09T04:39:30.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b027fc640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00047d0 0x7f5af0004c40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c240 tx=0x7f5aec01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd08b3b498b175b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:30.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0a5b40 con 0x7f5af00047d0 2023-06-09T04:39:30.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec0a5ca0 con 0x7f5af00047d0 2023-06-09T04:39:30.541 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b01ffb640 1 -- 172.21.15.18:0/3164742432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec005b20 con 0x7f5af00047d0 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 -- 172.21.15.18:0/3164742432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00047d0 msgr2=0x7f5af0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00047d0 0x7f5af0004c40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c240 tx=0x7f5aec01cc40 comp rx=0 tx=0).stop 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 -- 172.21.15.18:0/3164742432 shutdown_connections 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 --2- 172.21.15.18:0/3164742432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00047d0 0x7f5af0004c40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 -- 172.21.15.18:0/3164742432 >> 172.21.15.18:0/3164742432 conn(0x7f5b040cda10 msgr2=0x7f5b040cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 -- 172.21.15.18:0/3164742432 shutdown_connections 2023-06-09T04:39:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.534+0000 7f5b09986640 1 -- 172.21.15.18:0/3164742432 wait complete. 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 Processor -- start 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- start start 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af00047d0 0x7f5b040c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 0x7f5b040ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5b040b2290 0x7f5b040b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040b2c40 con 0x7f5b040c9d60 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040c8a70 con 0x7f5af00047d0 2023-06-09T04:39:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040c98d0 con 0x7f5b040b2290 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 0x7f5b040ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 0x7f5b040ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46922/0 (socket says 172.21.15.18:46922) 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 -- 172.21.15.18:0/895884066 learned_addr learned my addr 172.21.15.18:0/895884066 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b037fe640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5b040b2290 0x7f5b040b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 -- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5b040b2290 msgr2=0x7f5b040b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b02ffd640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af00047d0 0x7f5b040c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5b040b2290 0x7f5b040b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 -- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af00047d0 msgr2=0x7f5b040c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af00047d0 0x7f5b040c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 -- 172.21.15.18:0/895884066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040c8cc0 con 0x7f5b040c9d60 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b027fc640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 0x7f5b040ae7a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c240 tx=0x7f5af0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0b3070 con 0x7f5b040c9d60 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec000ee0 con 0x7f5b040c9d60 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec001640 con 0x7f5b040c9d60 2023-06-09T04:39:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b040c8fa0 con 0x7f5b040c9d60 2023-06-09T04:39:30.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b040c9560 con 0x7f5b040c9d60 2023-06-09T04:39:30.546 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b040c9720 con 0x7f5b040c9d60 2023-06-09T04:39:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5aec007140 con 0x7f5b040c9d60 2023-06-09T04:39:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5afbfff640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ae4066280 0x7f5ae4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.538+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6899+0+0 (secure 0 0 0) 0x7f5aec11d8e0 con 0x7f5b040c9d60 2023-06-09T04:39:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.542+0000 7f5b02ffd640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ae4066280 0x7f5ae4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.542+0000 7f5b02ffd640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ae4066280 0x7f5ae4068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5afc007380 tx=0x7f5afc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.546+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5aec0ea980 con 0x7f5b040c9d60 2023-06-09T04:39:30.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:30.698+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b0404dea0 con 0x7f5b040c9d60 2023-06-09T04:39:31.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.482+0000 7f5afbfff640 1 -- 172.21.15.18:0/895884066 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5aec0be0d0 con 0x7f5b040c9d60 2023-06-09T04:39:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2023-06-09T04:39:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.486+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ae4066280 msgr2=0x7f5ae4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.486+0000 7f5b09986640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ae4066280 0x7f5ae4068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5afc007380 tx=0x7f5afc00b040 comp rx=0 tx=0).stop 2023-06-09T04:39:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.486+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 msgr2=0x7f5b040ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.486+0000 7f5b09986640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 0x7f5b040ae7a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c240 tx=0x7f5af0005800 comp rx=0 tx=0).stop 2023-06-09T04:39:31.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 shutdown_connections 2023-06-09T04:39:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ae4066280 0x7f5ae4068730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5b040b2290 0x7f5b040b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b040c9d60 0x7f5b040ae7a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 --2- 172.21.15.18:0/895884066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af00047d0 0x7f5b040c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 >> 172.21.15.18:0/895884066 conn(0x7f5b040cda10 msgr2=0x7f5b0415a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 shutdown_connections 2023-06-09T04:39:31.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.490+0000 7f5b09986640 1 -- 172.21.15.18:0/895884066 wait complete. 2023-06-09T04:39:31.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T04:39:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df8423640 1 Processor -- start 2023-06-09T04:39:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df8423640 1 -- start start 2023-06-09T04:39:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df8423640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4df00b3890 0x7f4df00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df8423640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00b4210 con 0x7f4df015b650 2023-06-09T04:39:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df8423640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00d0590 con 0x7f4df006a3e0 2023-06-09T04:39:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df8423640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df015ba20 con 0x7f4df00b3890 2023-06-09T04:39:31.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df61bf640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4df015b650 0x7f4df00ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39292/0 (socket says 172.21.15.18:39292) 2023-06-09T04:39:31.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df61bf640 1 -- 172.21.15.18:0/1784504728 learned_addr learned my addr 172.21.15.18:0/1784504728 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df69c0640 1 --2- 172.21.15.18:0/1784504728 >> v2:172.21.15.81:3300/0 conn(0x7f4df00b3890 0x7f4df00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738029889 0 0) 0x7f4df00b4210 con 0x7f4df015b650 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ddc003530 con 0x7f4df015b650 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 218348878 0 0) 0x7f4ddc003530 con 0x7f4df015b650 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 >> v2:172.21.15.81:3300/0 conn(0x7f4df00b3890 msgr2=0x7f4df00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 --2- 172.21.15.18:0/1784504728 >> v2:172.21.15.81:3300/0 conn(0x7f4df00b3890 0x7f4df00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 >> v1:172.21.15.81:6789/0 conn(0x7f4df006a3e0 legacy=0x7f4df00b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00ccbc0 con 0x7f4df015b650 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4dec001680 con 0x7f4df015b650 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 >> v1:172.21.15.18:6789/0 conn(0x7f4df015b650 legacy=0x7f4df00ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc003980 0x7f4ddc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ddc0047d0 0x7f4ddc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ddc005180 0x7f4ddc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df015ba20 con 0x7f4ddc0047d0 2023-06-09T04:39:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc00c000 con 0x7f4ddc003980 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc00c1c0 con 0x7f4ddc005180 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df59be640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ddc0047d0 0x7f4ddc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df61bf640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc003980 0x7f4ddc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df69c0640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ddc005180 0x7f4ddc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df59be640 1 -- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ddc005180 msgr2=0x7f4ddc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df59be640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4ddc005180 0x7f4ddc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df59be640 1 -- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc003980 msgr2=0x7f4ddc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:31.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df59be640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc003980 0x7f4ddc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df59be640 1 -- 172.21.15.18:0/1784504728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc003530 con 0x7f4ddc0047d0 2023-06-09T04:39:31.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.654+0000 7f4df69c0640 1 -- 172.21.15.18:0/1784504728 reap_dead start 2023-06-09T04:39:31.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df59be640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ddc0047d0 0x7f4ddc004c40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4de0001750 tx=0x7f4de001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f283012423778b4c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00052d0 con 0x7f4ddc0047d0 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de00a7050 con 0x7f4ddc0047d0 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df51bd640 1 -- 172.21.15.18:0/1784504728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0003600 con 0x7f4ddc0047d0 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 -- 172.21.15.18:0/1784504728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ddc0047d0 msgr2=0x7f4ddc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ddc0047d0 0x7f4ddc004c40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4de0001750 tx=0x7f4de001c3a0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 -- 172.21.15.18:0/1784504728 shutdown_connections 2023-06-09T04:39:31.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 --2- 172.21.15.18:0/1784504728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ddc0047d0 0x7f4ddc004c40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 -- 172.21.15.18:0/1784504728 >> 172.21.15.18:0/1784504728 conn(0x7f4df006bf30 msgr2=0x7f4df00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 -- 172.21.15.18:0/1784504728 shutdown_connections 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 -- 172.21.15.18:0/1784504728 wait complete. 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 Processor -- start 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.658+0000 7f4df8423640 1 -- start start 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df015bff0 0x7f4df015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df00b6e10 0x7f4df00b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 0x7f4df01f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00b77c0 con 0x7f4df01f1120 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01f1e50 con 0x7f4df015bff0 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0141b40 con 0x7f4df00b6e10 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 0x7f4df01f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 0x7f4df01f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46934/0 (socket says 172.21.15.18:46934) 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 -- 172.21.15.18:0/3537639136 learned_addr learned my addr 172.21.15.18:0/3537639136 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:31.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df59be640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df00b6e10 0x7f4df00b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df61bf640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df015bff0 0x7f4df015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 -- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df00b6e10 msgr2=0x7f4df00b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df00b6e10 0x7f4df00b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 -- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df015bff0 msgr2=0x7f4df015c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df015bff0 0x7f4df015c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 -- 172.21.15.18:0/3537639136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0140d80 con 0x7f4df01f1120 2023-06-09T04:39:31.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df61bf640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df015bff0 0x7f4df015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:31.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df69c0640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 0x7f4df01f15c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4df00b49e0 tx=0x7f4de800f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800f910 con 0x7f4df01f1120 2023-06-09T04:39:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de800fa90 con 0x7f4df01f1120 2023-06-09T04:39:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0141060 con 0x7f4df01f1120 2023-06-09T04:39:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800fe40 con 0x7f4df01f1120 2023-06-09T04:39:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df0141620 con 0x7f4df01f1120 2023-06-09T04:39:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df004dea0 con 0x7f4df01f1120 2023-06-09T04:39:31.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4de8016420 con 0x7f4df01f1120 2023-06-09T04:39:31.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4de6ffd640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dd4066280 0x7f4dd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:31.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f4de8084340 con 0x7f4df01f1120 2023-06-09T04:39:31.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.662+0000 7f4df61bf640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dd4066280 0x7f4dd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:31.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.666+0000 7f4df61bf640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dd4066280 0x7f4dd4068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4dec001210 tx=0x7f4dec001120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:31.670 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.666+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4de8051620 con 0x7f4df01f1120 2023-06-09T04:39:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:31.822+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4df0158fd0 con 0x7f4df01f1120 2023-06-09T04:39:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.494+0000 7f4de6ffd640 1 -- 172.21.15.18:0/3537639136 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4de8054c40 con 0x7f4df01f1120 2023-06-09T04:39:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2023-06-09T04:39:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dd4066280 msgr2=0x7f4dd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dd4066280 0x7f4dd4068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4dec001210 tx=0x7f4dec001120 comp rx=0 tx=0).stop 2023-06-09T04:39:32.500 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 msgr2=0x7f4df01f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 0x7f4df01f15c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4df00b49e0 tx=0x7f4de800f150 comp rx=0 tx=0).stop 2023-06-09T04:39:32.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 shutdown_connections 2023-06-09T04:39:32.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4df01f1120 0x7f4df01f15c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4dd4066280 0x7f4dd4068730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4df00b6e10 0x7f4df00b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 --2- 172.21.15.18:0/3537639136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4df015bff0 0x7f4df015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 >> 172.21.15.18:0/3537639136 conn(0x7f4ddc0047d0 msgr2=0x7f4df01594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 shutdown_connections 2023-06-09T04:39:32.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.498+0000 7f4df8423640 1 -- 172.21.15.18:0/3537639136 wait complete. 2023-06-09T04:39:32.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-09T04:39:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9cb99640 1 Processor -- start 2023-06-09T04:39:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9cb99640 1 -- start start 2023-06-09T04:39:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9cb99640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a980b3890 0x7f9a980b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9cb99640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980b4210 con 0x7f9a9806a3e0 2023-06-09T04:39:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9cb99640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980d0590 con 0x7f9a9815b650 2023-06-09T04:39:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9cb99640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9815ba20 con 0x7f9a980b3890 2023-06-09T04:39:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a95d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9a9806a3e0 0x7f9a980b4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39294/0 (socket says 172.21.15.18:39294) 2023-06-09T04:39:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a95d9b640 1 -- 172.21.15.18:0/3253222078 learned_addr learned my addr 172.21.15.18:0/3253222078 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a96d9d640 1 --2- 172.21.15.18:0/3253222078 >> v2:172.21.15.81:3300/0 conn(0x7f9a980b3890 0x7f9a980b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112565203 0 0) 0x7f9a980b4210 con 0x7f9a9806a3e0 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.650+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a80003530 con 0x7f9a9806a3e0 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3968020461 0 0) 0x7f9a80003530 con 0x7f9a9806a3e0 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 >> v2:172.21.15.81:3300/0 conn(0x7f9a980b3890 msgr2=0x7f9a980b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 --2- 172.21.15.18:0/3253222078 >> v2:172.21.15.81:3300/0 conn(0x7f9a980b3890 0x7f9a980b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 >> v1:172.21.15.81:6789/0 conn(0x7f9a9815b650 legacy=0x7f9a980ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980ccbc0 con 0x7f9a9806a3e0 2023-06-09T04:39:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f9a8c001680 con 0x7f9a9806a3e0 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 >> v1:172.21.15.18:6789/0 conn(0x7f9a9806a3e0 legacy=0x7f9a980b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a80003980 0x7f9a80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a800047d0 0x7f9a80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a80005180 0x7f9a8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9815ba20 con 0x7f9a800047d0 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8000c000 con 0x7f9a80003980 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8000c1c0 con 0x7f9a80005180 2023-06-09T04:39:32.658 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a800047d0 0x7f9a80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9659c640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a80003980 0x7f9a80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 -- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a80005180 msgr2=0x7f9a8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a80005180 0x7f9a8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 -- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a80003980 msgr2=0x7f9a80003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a80003980 0x7f9a80003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 -- 172.21.15.18:0/3253222078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80003530 con 0x7f9a800047d0 2023-06-09T04:39:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a96d9d640 1 -- 172.21.15.18:0/3253222078 reap_dead start 2023-06-09T04:39:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a95d9b640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a800047d0 0x7f9a80004c40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c190 tx=0x7f9a8c01f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72aa35743eccd76 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0a8e30 con 0x7f9a800047d0 2023-06-09T04:39:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c0058e0 con 0x7f9a800047d0 2023-06-09T04:39:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9559a640 1 -- 172.21.15.18:0/3253222078 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c005d10 con 0x7f9a800047d0 2023-06-09T04:39:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 -- 172.21.15.18:0/3253222078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a800047d0 msgr2=0x7f9a80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a800047d0 0x7f9a80004c40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c190 tx=0x7f9a8c01f310 comp rx=0 tx=0).stop 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 -- 172.21.15.18:0/3253222078 shutdown_connections 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/3253222078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a800047d0 0x7f9a80004c40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 -- 172.21.15.18:0/3253222078 >> 172.21.15.18:0/3253222078 conn(0x7f9a9806bf30 msgr2=0x7f9a980ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 -- 172.21.15.18:0/3253222078 shutdown_connections 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.654+0000 7f9a9cb99640 1 -- 172.21.15.18:0/3253222078 wait complete. 2023-06-09T04:39:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 Processor -- start 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- start start 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a98155360 0x7f9a98069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a98155730 0x7f9a9815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a980c5940 0x7f9a980b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c8b60 con 0x7f9a980c5940 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9815bb60 con 0x7f9a98155730 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9815be00 con 0x7f9a98155360 2023-06-09T04:39:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9659c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a98155360 0x7f9a98069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a980c5940 0x7f9a980b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9659c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a98155360 0x7f9a98069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:56126/0 (socket says 172.21.15.18:56126) 2023-06-09T04:39:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9659c640 1 -- 172.21.15.18:0/2855080300 learned_addr learned my addr 172.21.15.18:0/2855080300 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:32.664 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a95d9b640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a98155730 0x7f9a9815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 -- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a98155360 msgr2=0x7f9a98069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.665 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a98155360 0x7f9a98069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 -- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a98155730 msgr2=0x7f9a9815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a98155730 0x7f9a9815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 -- 172.21.15.18:0/2855080300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9815c0e0 con 0x7f9a980c5940 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a96d9d640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a980c5940 0x7f9a980b6f70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9a9808ac60 tx=0x7f9a9000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90010040 con 0x7f9a980c5940 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a90014810 con 0x7f9a980c5940 2023-06-09T04:39:32.666 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980b2fe0 con 0x7f9a980c5940 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90009b10 con 0x7f9a980c5940 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980b74b0 con 0x7f9a980c5940 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.658+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9804dea0 con 0x7f9a980c5940 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.662+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a90014bc0 con 0x7f9a980c5940 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.662+0000 7f9a86ffd640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a78066280 0x7f9a78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.662+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9a90083a50 con 0x7f9a980c5940 2023-06-09T04:39:32.667 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.662+0000 7f9a9659c640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a78066280 0x7f9a78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:32.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.662+0000 7f9a9659c640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a78066280 0x7f9a78068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a880016e0 tx=0x7f9a88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:32.668 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.666+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a90050ef0 con 0x7f9a980c5940 2023-06-09T04:39:32.823 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:32.822+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a9815bf40 con 0x7f9a980c5940 2023-06-09T04:39:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.498+0000 7f9a86ffd640 1 -- 172.21.15.18:0/2855080300 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9a9815bf40 con 0x7f9a980c5940 2023-06-09T04:39:33.502 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2023-06-09T04:39:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a78066280 msgr2=0x7f9a78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a78066280 0x7f9a78068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a880016e0 tx=0x7f9a88009040 comp rx=0 tx=0).stop 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a980c5940 msgr2=0x7f9a980b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a980c5940 0x7f9a980b6f70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9a9808ac60 tx=0x7f9a9000ef10 comp rx=0 tx=0).stop 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 shutdown_connections 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a980c5940 0x7f9a980b6f70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a98155730 0x7f9a9815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9a78066280 0x7f9a78068730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 --2- 172.21.15.18:0/2855080300 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a98155360 0x7f9a98069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 >> 172.21.15.18:0/2855080300 conn(0x7f9a800047d0 msgr2=0x7f9a980b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 shutdown_connections 2023-06-09T04:39:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.502+0000 7f9a9cb99640 1 -- 172.21.15.18:0/2855080300 wait complete. 2023-06-09T04:39:33.528 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:39:33.528 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-09T04:39:33.528 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T04:39:33.529 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:33.529 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:39:33.529 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-09T04:39:33.529 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T04:39:33.529 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:33.530 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:39:33.530 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-09T04:39:33.530 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T04:39:33.530 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:33.531 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:39:33.531 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-09T04:39:33.531 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T04:39:33.531 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:39:33.539 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T04:39:33.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:39:33.540 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T04:39:33.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:39:33.551 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T04:39:33.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:39:33.552 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T04:39:33.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:39:33.583 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:39:33.584 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:33.585 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:39:33.585 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:33.595 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:39:33.596 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:33.597 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:39:33.597 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:33.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-09T04:39:33.648 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2023-06-09T04:39:33.648 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2023-06-09T04:39:33.665 INFO:tasks.ceph.mds.d.smithi081.stdout:starting mds.d at 2023-06-09T04:39:33.666 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-06-09T04:39:33.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442e67b640 1 Processor -- start 2023-06-09T04:39:33.727 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442e67b640 1 -- start start 2023-06-09T04:39:33.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442e67b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f44280c9840 0x7f44280c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:33.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442e67b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44280cb460 con 0x7f442815ba50 2023-06-09T04:39:33.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442e67b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44280cd0c0 con 0x7f44280b4220 2023-06-09T04:39:33.728 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442e67b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44280cf800 con 0x7f44280c9840 2023-06-09T04:39:33.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442cc18640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f44280c9840 0x7f44280c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:33.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f4427fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f442815ba50 0x7f44280b3b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39310/0 (socket says 172.21.15.18:39310) 2023-06-09T04:39:33.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f4427fff640 1 -- 172.21.15.18:0/1847913253 learned_addr learned my addr 172.21.15.18:0/1847913253 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:33.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442cc18640 1 -- 172.21.15.18:0/1847913253 >> v1:172.21.15.81:6789/0 conn(0x7f44280b4220 legacy=0x7f44280c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442cc18640 1 -- 172.21.15.18:0/1847913253 >> v1:172.21.15.18:6789/0 conn(0x7f442815ba50 legacy=0x7f44280b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442cc18640 1 -- 172.21.15.18:0/1847913253 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442806e290 con 0x7f44280c9840 2023-06-09T04:39:33.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f44277fe640 1 -- 172.21.15.18:0/1847913253 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179779296 0 0) 0x7f44280cb460 con 0x7f442815ba50 2023-06-09T04:39:33.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.726+0000 7f442cc18640 1 --2- 172.21.15.18:0/1847913253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280c9840 0x7f44280c9c60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4420009d90 tx=0x7f442001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f297ca504c6b77bf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:33.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f44277fe640 1 -- 172.21.15.18:0/1847913253 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200a5970 con 0x7f44280c9840 2023-06-09T04:39:33.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f44277fe640 1 -- 172.21.15.18:0/1847913253 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44200a5ad0 con 0x7f44280c9840 2023-06-09T04:39:33.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f44277fe640 1 -- 172.21.15.18:0/1847913253 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200a5e60 con 0x7f44280c9840 2023-06-09T04:39:33.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 -- 172.21.15.18:0/1847913253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280c9840 msgr2=0x7f44280c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 --2- 172.21.15.18:0/1847913253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280c9840 0x7f44280c9c60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4420009d90 tx=0x7f442001c890 comp rx=0 tx=0).stop 2023-06-09T04:39:33.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 -- 172.21.15.18:0/1847913253 shutdown_connections 2023-06-09T04:39:33.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 --2- 172.21.15.18:0/1847913253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280c9840 0x7f44280c9c60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 -- 172.21.15.18:0/1847913253 >> 172.21.15.18:0/1847913253 conn(0x7f44280b2720 msgr2=0x7f44280ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:33.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 -- 172.21.15.18:0/1847913253 shutdown_connections 2023-06-09T04:39:33.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 -- 172.21.15.18:0/1847913253 wait complete. 2023-06-09T04:39:33.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 Processor -- start 2023-06-09T04:39:33.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.730+0000 7f442e67b640 1 -- start start 2023-06-09T04:39:33.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280b4220 0x7f442806ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44280c9840 0x7f442815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44280c5e30 0x7f44280c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442806b3a0 con 0x7f44280b4220 2023-06-09T04:39:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c68f0 con 0x7f44280c5e30 2023-06-09T04:39:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c6bd0 con 0x7f44280c9840 2023-06-09T04:39:33.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f4427fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280b4220 0x7f442806ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f4427fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280b4220 0x7f442806ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46992/0 (socket says 172.21.15.18:46992) 2023-06-09T04:39:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f4427fff640 1 -- 172.21.15.18:0/104741941 learned_addr learned my addr 172.21.15.18:0/104741941 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44280c5e30 0x7f44280c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:33.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f441ffff640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44280c9840 0x7f442815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 -- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44280c9840 msgr2=0x7f442815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44280c9840 0x7f442815a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 -- 172.21.15.18:0/104741941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280b4220 msgr2=0x7f442806ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280b4220 0x7f442806ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 -- 172.21.15.18:0/104741941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420009a70 con 0x7f44280c5e30 2023-06-09T04:39:33.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442cc18640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44280c5e30 0x7f44280c62d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f44200ac000 tx=0x7f4420019630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:33.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200ade80 con 0x7f44280c5e30 2023-06-09T04:39:33.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44200b9450 con 0x7f44280c5e30 2023-06-09T04:39:33.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200b97c0 con 0x7f44280c5e30 2023-06-09T04:39:33.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44280c6eb0 con 0x7f44280c5e30 2023-06-09T04:39:33.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44280c7470 con 0x7f44280c5e30 2023-06-09T04:39:33.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.738+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44280c7660 con 0x7f44280c5e30 2023-06-09T04:39:33.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.738+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44200b9920 con 0x7f44280c5e30 2023-06-09T04:39:33.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.738+0000 7f44257fa640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f44080662b0 0x7f4408068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:33.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.738+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f442011f840 con 0x7f44280c5e30 2023-06-09T04:39:33.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.738+0000 7f4427fff640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f44080662b0 0x7f4408068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:33.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.742+0000 7f4427fff640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f44080662b0 0x7f4408068760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4418000f70 tx=0x7f4418007c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:33.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.746+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44200ed040 con 0x7f44280c5e30 2023-06-09T04:39:33.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:33.922+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f442806dd30 con 0x7f44280c5e30 2023-06-09T04:39:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.726+0000 7f44257fa640 1 -- 172.21.15.18:0/104741941 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f44200f0660 con 0x7f44280c5e30 2023-06-09T04:39:34.731 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2023-06-09T04:39:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f44080662b0 msgr2=0x7f4408068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f44080662b0 0x7f4408068760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4418000f70 tx=0x7f4418007c50 comp rx=0 tx=0).stop 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44280c5e30 msgr2=0x7f44280c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44280c5e30 0x7f44280c62d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f44200ac000 tx=0x7f4420019630 comp rx=0 tx=0).stop 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 shutdown_connections 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44280c5e30 0x7f44280c62d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f44080662b0 0x7f4408068760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f44280c9840 0x7f442815a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 --2- 172.21.15.18:0/104741941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44280b4220 0x7f442806ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 >> 172.21.15.18:0/104741941 conn(0x7f44280b2720 msgr2=0x7f44280b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 shutdown_connections 2023-06-09T04:39:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.734+0000 7f442e67b640 1 -- 172.21.15.18:0/104741941 wait complete. 2023-06-09T04:39:34.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-09T04:39:34.890 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.886+0000 7f476a2d9640 1 Processor -- start 2023-06-09T04:39:34.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.886+0000 7f476a2d9640 1 -- start start 2023-06-09T04:39:34.891 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f476a2d9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 0x7f476406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f476a2d9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476415cf10 con 0x7f47640700a0 2023-06-09T04:39:34.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f476a2d9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764070520 con 0x7f4764159320 2023-06-09T04:39:34.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f476a2d9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476415dd90 con 0x7f476415a3e0 2023-06-09T04:39:34.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4768876640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f47640700a0 0x7f476406bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39318/0 (socket says 172.21.15.18:39318) 2023-06-09T04:39:34.892 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4768876640 1 -- 172.21.15.18:0/1000518703 learned_addr learned my addr 172.21.15.18:0/1000518703 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:34.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 0x7f476406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730904707 0 0) 0x7f476415cf10 con 0x7f47640700a0 2023-06-09T04:39:34.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f474c003530 con 0x7f47640700a0 2023-06-09T04:39:34.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501581365 0 0) 0x7f474c003530 con 0x7f47640700a0 2023-06-09T04:39:34.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 msgr2=0x7f476406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:34.894 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 0x7f476406fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 >> v1:172.21.15.81:6789/0 conn(0x7f4764159320 legacy=0x7f476415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640c81b0 con 0x7f47640700a0 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f475c001a00 con 0x7f47640700a0 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 >> v1:172.21.15.18:6789/0 conn(0x7f47640700a0 legacy=0x7f476406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f474c0039b0 0x7f474c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474c0047d0 0x7f474c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 0x7f474c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476415dd90 con 0x7f474c0047d0 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c00ba90 con 0x7f474c0039b0 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c00bc50 con 0x7f476415a3e0 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474c0047d0 0x7f474c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4763fff640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f474c0039b0 0x7f474c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f4768876640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 0x7f474c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 -- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 msgr2=0x7f474c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:34.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f476415a3e0 0x7f474c0051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 -- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f474c0039b0 msgr2=0x7f474c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:34.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f474c0039b0 0x7f474c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.897 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.890+0000 7f47637fe640 1 -- 172.21.15.18:0/1000518703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c003530 con 0x7f474c0047d0 2023-06-09T04:39:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474c0047d0 0x7f474c004c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4754009ae0 tx=0x7f475401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474f24da1cbd84c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540a6510 con 0x7f474c0047d0 2023-06-09T04:39:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47540a6670 con 0x7f474c0047d0 2023-06-09T04:39:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4762ffd640 1 -- 172.21.15.18:0/1000518703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540a6a20 con 0x7f474c0047d0 2023-06-09T04:39:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- 172.21.15.18:0/1000518703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474c0047d0 msgr2=0x7f474c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 --2- 172.21.15.18:0/1000518703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474c0047d0 0x7f474c004c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4754009ae0 tx=0x7f475401ca20 comp rx=0 tx=0).stop 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4768876640 1 -- 172.21.15.18:0/1000518703 reap_dead start 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- 172.21.15.18:0/1000518703 shutdown_connections 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- 172.21.15.18:0/1000518703 >> 172.21.15.18:0/1000518703 conn(0x7f47640b0240 msgr2=0x7f47640cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- 172.21.15.18:0/1000518703 shutdown_connections 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- 172.21.15.18:0/1000518703 wait complete. 2023-06-09T04:39:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 Processor -- start 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- start start 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476414c250 0x7f4764152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 0x7f476414de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47640ca120 0x7f47640ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764151e70 con 0x7f476414d9e0 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640caad0 con 0x7f476414c250 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f476a2d9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764151840 con 0x7f47640ca120 2023-06-09T04:39:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 0x7f476414de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 0x7f476414de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47024/0 (socket says 172.21.15.18:47024) 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 -- 172.21.15.18:0/2404328214 learned_addr learned my addr 172.21.15.18:0/2404328214 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4763fff640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476414c250 0x7f4764152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4768876640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47640ca120 0x7f47640ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 -- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47640ca120 msgr2=0x7f47640ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47640ca120 0x7f47640ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 -- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476414c250 msgr2=0x7f4764152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476414c250 0x7f4764152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 -- 172.21.15.18:0/2404328214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476414e430 con 0x7f476414d9e0 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f4768876640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47640ca120 0x7f47640ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.894+0000 7f47637fe640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 0x7f476414de50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f475401c850 tx=0x7f474c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540a69e0 con 0x7f476414d9e0 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47540a6b40 con 0x7f476414d9e0 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476414e710 con 0x7f476414d9e0 2023-06-09T04:39:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400f0c0 con 0x7f476414d9e0 2023-06-09T04:39:34.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47641527d0 con 0x7f476414d9e0 2023-06-09T04:39:34.904 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4764151fb0 con 0x7f476414d9e0 2023-06-09T04:39:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4754006040 con 0x7f476414d9e0 2023-06-09T04:39:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4760ff9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f47500662b0 0x7f4750068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f47540aa070 con 0x7f476414d9e0 2023-06-09T04:39:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4763fff640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f47500662b0 0x7f4750068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.898+0000 7f4763fff640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f47500662b0 0x7f4750068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4758001620 tx=0x7f4758009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:34.902+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4764151fb0 con 0x7f476414d9e0 2023-06-09T04:39:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4764151fb0 con 0x7f476414d9e0 2023-06-09T04:39:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f4760ff9640 1 -- 172.21.15.18:0/2404328214 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4764151fb0 con 0x7f476414d9e0 2023-06-09T04:39:35.113 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:35.113 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:39:35.113 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2023-06-09T04:39:35.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJkY27vGhAA0nxXnaRtr10QAXQjtNMbPg==", 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2023-06-09T04:39:35.114 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJk8J5HKRAAGUSPBb3ugYx1WAGw/2UgAg==", 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.115 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2023-06-09T04:39:35.116 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJkOv9VIxAAKkMVVTLufhySpH5T0NTbqw==", 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJk4j/oMRAAzprOovcXEwRH7uKCPfVloA==", 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2023-06-09T04:39:35.118 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB8rIJknHdbDBAAvM8QVbLDKr9g2fZ2+E/5ow==", 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.119 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB/rIJk2ejYERAAw5lKwKEqs50wYfcQ5+LEAg==", 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.120 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCCrIJkFKqDGhAAf5EaQXXRSuzDzqTZZawrtg==", 2023-06-09T04:39:35.121 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.122 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCFrIJkO2zQIhAAeOVev4wa7Una2jmeWJQYaw==", 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCLrIJkdKMwJBAASjDcKa+9iBj4D2POnaJWuQ==", 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCOrIJkrOr1KxAAh5CnBhdbBNs1agWVJo+LJA==", 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCRrIJkqCJzNBAAm2zyQsxxam2Vtx6tNIUq+w==", 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.126 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCVrIJkyDEMAhAAbIkTMG09bNz0Kd2pl80pUQ==", 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.127 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJkXeKQNxAAUUixr/B2ThUEYZZrYvhzkw==", 2023-06-09T04:39:35.128 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.129 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2023-06-09T04:39:35.130 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB7rIJkD8JvAxAAiWQkEnTuOchQ/KVu81Ip5A==", 2023-06-09T04:39:35.130 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB7rIJkk0HeABAA0JDyRxeb6DbMh/duoq4e1Q==", 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2023-06-09T04:39:35.132 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB7rIJkyLK0CBAAq4DcDQONemGIdmqe5CaLeg==", 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.133 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2023-06-09T04:39:35.134 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJkHz1wAxAAuYD1NseB+bkY0hl2seVayg==", 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mds", 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCbrIJkfClYDRAA7hVvzGaFUcDQTdzFt+Fjsw==", 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mds" 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mgr", 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCbrIJkwkJYDRAAM20wOgGC0X7XrsDvDmrG2A==", 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.137 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-osd", 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCbrIJk5FtYDRAA8F8QMdd6/sdq3/Hn1820EQ==", 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-osd" 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd", 2023-06-09T04:39:35.138 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCbrIJkKnFYDRAATx9y/1CO86Hniw3d9IHH0Q==", 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCbrIJkUIdYDRAABT+Mcot0hCKv9qAKW5EzZw==", 2023-06-09T04:39:35.139 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rgw", 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQCbrIJkZp1YDRAAY9wOKYP05w+xUywXprDGaQ==", 2023-06-09T04:39:35.140 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJkZAdiFxAAVgfRKBoV8Se1VMZqQlV1SA==", 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.141 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQB6rIJkaUG/FBAA2ZRcJcIjZ9JQsjvUbEbIHA==", 2023-06-09T04:39:35.142 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2023-06-09T04:39:35.143 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:39:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f47500662b0 msgr2=0x7f4750068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f47500662b0 0x7f4750068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4758001620 tx=0x7f4758009040 comp rx=0 tx=0).stop 2023-06-09T04:39:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 msgr2=0x7f476414de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 0x7f476414de50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f475401c850 tx=0x7f474c005800 comp rx=0 tx=0).stop 2023-06-09T04:39:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 shutdown_connections 2023-06-09T04:39:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.110+0000 7f476a2d9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f47500662b0 0x7f4750068760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.114+0000 7f476a2d9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f47640ca120 0x7f47640ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.114+0000 7f476a2d9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f476414d9e0 0x7f476414de50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.114+0000 7f476a2d9640 1 --2- 172.21.15.18:0/2404328214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476414c250 0x7f4764152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.114+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 >> 172.21.15.18:0/2404328214 conn(0x7f47640b0240 msgr2=0x7f476415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.114+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 shutdown_connections 2023-06-09T04:39:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.114+0000 7f476a2d9640 1 -- 172.21.15.18:0/2404328214 wait complete. 2023-06-09T04:39:35.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-09T04:39:35.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 Processor -- start 2023-06-09T04:39:35.268 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 -- start start 2023-06-09T04:39:35.269 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 0x7fac1406a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac1406a9d0 0x7fac1406ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac14159930 con 0x7fac140703f0 2023-06-09T04:39:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1406a010 con 0x7fac1406a9d0 2023-06-09T04:39:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1b2d0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14156310 con 0x7fac140cd9a0 2023-06-09T04:39:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1906c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fac140703f0 0x7fac140707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39328/0 (socket says 172.21.15.18:39328) 2023-06-09T04:39:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1906c640 1 -- 172.21.15.18:0/1859529781 learned_addr learned my addr 172.21.15.18:0/1859529781 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1886b640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 0x7fac1406a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1986d640 1 --2- 172.21.15.18:0/1859529781 >> v2:172.21.15.81:3300/0 conn(0x7fac1406a9d0 0x7fac1406ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590458308 0 0) 0x7fac0c0014a0 con 0x7fac140703f0 2023-06-09T04:39:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabfc003530 con 0x7fac140703f0 2023-06-09T04:39:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953558006 0 0) 0x7fabfc003530 con 0x7fac140703f0 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 msgr2=0x7fac1406a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 0x7fac1406a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 >> v2:172.21.15.81:3300/0 conn(0x7fac1406a9d0 msgr2=0x7fac1406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 --2- 172.21.15.18:0/1859529781 >> v2:172.21.15.81:3300/0 conn(0x7fac1406a9d0 0x7fac1406ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14158db0 con 0x7fac140703f0 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7fac0c001b90 con 0x7fac140703f0 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 >> v1:172.21.15.18:6789/0 conn(0x7fac140703f0 legacy=0x7fac140707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabfc003980 0x7fabfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 0x7fabfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fabfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1406a010 con 0x7fabfc004d10 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14156310 con 0x7fabfc003980 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc00b990 con 0x7fac140cd9a0 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.266+0000 7fac1986d640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fabfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.274 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1886b640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 0x7fabfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1906c640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabfc003980 0x7fabfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 -- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 msgr2=0x7fabfc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140cd9a0 0x7fabfc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 -- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabfc003980 msgr2=0x7fabfc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabfc003980 0x7fabfc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 -- 172.21.15.18:0/1859529781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc003530 con 0x7fabfc004d10 2023-06-09T04:39:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1906c640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabfc003980 0x7fabfc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fabfc005180 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fac04009ae0 tx=0x7fac0401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896d686ab61106cb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040a5680 con 0x7fabfc004d10 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040a57e0 con 0x7fabfc004d10 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac13fff640 1 -- 172.21.15.18:0/1859529781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040a5b90 con 0x7fabfc004d10 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1b2d0640 1 -- 172.21.15.18:0/1859529781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 msgr2=0x7fabfc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/1859529781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fabfc005180 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fac04009ae0 tx=0x7fac0401ca90 comp rx=0 tx=0).stop 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1986d640 1 -- 172.21.15.18:0/1859529781 reap_dead start 2023-06-09T04:39:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1b2d0640 1 -- 172.21.15.18:0/1859529781 shutdown_connections 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1b2d0640 1 -- 172.21.15.18:0/1859529781 >> 172.21.15.18:0/1859529781 conn(0x7fac140cb960 msgr2=0x7fac140ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1b2d0640 1 -- 172.21.15.18:0/1859529781 shutdown_connections 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.270+0000 7fac1b2d0640 1 -- 172.21.15.18:0/1859529781 wait complete. 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 Processor -- start 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- start start 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fac140c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140c2f00 0x7fac14142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac141434c0 0x7fac1414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c49c0 con 0x7fabfc004d10 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c33e0 con 0x7fac141434c0 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c36c0 con 0x7fac140c2f00 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fac140c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fac140c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47038/0 (socket says 172.21.15.18:47038) 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 -- 172.21.15.18:0/3801330908 learned_addr learned my addr 172.21.15.18:0/3801330908 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1886b640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140c2f00 0x7fac14142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1986d640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac141434c0 0x7fac1414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 -- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140c2f00 msgr2=0x7fac14142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140c2f00 0x7fac14142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 -- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac141434c0 msgr2=0x7fac1414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac141434c0 0x7fac1414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 -- 172.21.15.18:0/3801330908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140c39a0 con 0x7fabfc004d10 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1906c640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fac140c4480 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00dfc0 tx=0x7fac0c00b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c004d70 con 0x7fabfc004d10 2023-06-09T04:39:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0070d0 con 0x7fabfc004d10 2023-06-09T04:39:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac140c3c80 con 0x7fabfc004d10 2023-06-09T04:39:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c007440 con 0x7fabfc004d10 2023-06-09T04:39:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac14143930 con 0x7fabfc004d10 2023-06-09T04:39:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac140c4130 con 0x7fabfc004d10 2023-06-09T04:39:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.274+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac0c0075a0 con 0x7fabfc004d10 2023-06-09T04:39:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.278+0000 7fac11ffb640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fac000662b0 0x7fac00068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.278+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fac0c0842f0 con 0x7fabfc004d10 2023-06-09T04:39:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.278+0000 7fac1886b640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fac000662b0 0x7fac00068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.278+0000 7fac1886b640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fac000662b0 0x7fac00068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fac14071010 tx=0x7fac08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:35.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.278+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac0c051960 con 0x7fabfc004d10 2023-06-09T04:39:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.490+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fac14159930 con 0x7fabfc004d10 2023-06-09T04:39:35.498 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.494+0000 7fac11ffb640 1 -- 172.21.15.18:0/3801330908 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fac14159930 con 0x7fabfc004d10 2023-06-09T04:39:35.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fac000662b0 msgr2=0x7fac00068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fac000662b0 0x7fac00068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fac14071010 tx=0x7fac08008040 comp rx=0 tx=0).stop 2023-06-09T04:39:35.501 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 msgr2=0x7fac140c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fac140c4480 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00dfc0 tx=0x7fac0c00b560 comp rx=0 tx=0).stop 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 shutdown_connections 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac141434c0 0x7fac1414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fac000662b0 0x7fac00068760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac140c2f00 0x7fac14142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 --2- 172.21.15.18:0/3801330908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc004d10 0x7fac140c4480 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 >> 172.21.15.18:0/3801330908 conn(0x7fac140cb960 msgr2=0x7fac14156450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:35.502 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 shutdown_connections 2023-06-09T04:39:35.503 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.498+0000 7fac1b2d0640 1 -- 172.21.15.18:0/3801330908 wait complete. 2023-06-09T04:39:35.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-09T04:39:35.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bf949640 1 Processor -- start 2023-06-09T04:39:35.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bf949640 1 -- start start 2023-06-09T04:39:35.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bf949640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88b80ccd70 0x7f88b815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bf949640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80cd820 con 0x7f88b8159300 2023-06-09T04:39:35.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bf949640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80cc2a0 con 0x7f88b80cbe00 2023-06-09T04:39:35.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bf949640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80ca2a0 con 0x7f88b80ccd70 2023-06-09T04:39:35.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bd6e5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f88b8159300 0x7f88b80cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39342/0 (socket says 172.21.15.18:39342) 2023-06-09T04:39:35.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.634+0000 7f88bd6e5640 1 -- 172.21.15.18:0/2124326734 learned_addr learned my addr 172.21.15.18:0/2124326734 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bdee6640 1 --2- 172.21.15.18:0/2124326734 >> v2:172.21.15.81:3300/0 conn(0x7f88b80ccd70 0x7f88b815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753155394 0 0) 0x7f88b80cd820 con 0x7f88b8159300 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a4003530 con 0x7f88b8159300 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349594172 0 0) 0x7f88a4003530 con 0x7f88b8159300 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 >> v2:172.21.15.81:3300/0 conn(0x7f88b80ccd70 msgr2=0x7f88b815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 --2- 172.21.15.18:0/2124326734 >> v2:172.21.15.81:3300/0 conn(0x7f88b80ccd70 0x7f88b815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.641 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 >> v1:172.21.15.81:6789/0 conn(0x7f88b80cbe00 legacy=0x7f88b80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80ca4b0 con 0x7f88b8159300 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f88b4001680 con 0x7f88b8159300 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 >> v1:172.21.15.18:6789/0 conn(0x7f88b8159300 legacy=0x7f88b80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a4003980 0x7f88a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a40047d0 0x7f88a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4005180 0x7f88a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.642 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80ca2a0 con 0x7f88a40047d0 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a400c090 con 0x7f88a4005180 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a400c250 con 0x7f88a4003980 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a40047d0 0x7f88a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bd6e5640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a4003980 0x7f88a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 -- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a4003980 msgr2=0x7f88a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a4003980 0x7f88a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 -- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4005180 msgr2=0x7f88a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:35.643 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4005180 0x7f88a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 -- 172.21.15.18:0/2124326734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a4003530 con 0x7f88a40047d0 2023-06-09T04:39:35.644 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bdee6640 1 -- 172.21.15.18:0/2124326734 reap_dead start 2023-06-09T04:39:35.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bcee4640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a40047d0 0x7f88a4004c40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f88a8001750 tx=0x7f88a801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb097e566c9be5e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:35.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80052d0 con 0x7f88a40047d0 2023-06-09T04:39:35.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a80a7050 con 0x7f88a40047d0 2023-06-09T04:39:35.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88affff640 1 -- 172.21.15.18:0/2124326734 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8003600 con 0x7f88a40047d0 2023-06-09T04:39:35.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bf949640 1 -- 172.21.15.18:0/2124326734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a40047d0 msgr2=0x7f88a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.646 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bf949640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a40047d0 0x7f88a4004c40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f88a8001750 tx=0x7f88a801c3a0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bf949640 1 -- 172.21.15.18:0/2124326734 shutdown_connections 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bf949640 1 --2- 172.21.15.18:0/2124326734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a40047d0 0x7f88a4004c40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bf949640 1 -- 172.21.15.18:0/2124326734 >> 172.21.15.18:0/2124326734 conn(0x7f88b806f850 msgr2=0x7f88b806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.638+0000 7f88bf949640 1 -- 172.21.15.18:0/2124326734 shutdown_connections 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- 172.21.15.18:0/2124326734 wait complete. 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 Processor -- start 2023-06-09T04:39:35.647 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- start start 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a40047d0 0x7f88b814c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88b81f49e0 0x7f88b8149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 0x7f88b80c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8149f40 con 0x7f88b80c9220 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b806adf0 con 0x7f88b81f49e0 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b814d1c0 con 0x7f88a40047d0 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 0x7f88b80c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 0x7f88b80c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47048/0 (socket says 172.21.15.18:47048) 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 -- 172.21.15.18:0/3942123592 learned_addr learned my addr 172.21.15.18:0/3942123592 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bd6e5640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a40047d0 0x7f88b814c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bcee4640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88b81f49e0 0x7f88b8149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 -- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a40047d0 msgr2=0x7f88b814c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a40047d0 0x7f88b814c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 -- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88b81f49e0 msgr2=0x7f88b8149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88b81f49e0 0x7f88b8149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 -- 172.21.15.18:0/3942123592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80c9c00 con 0x7f88b80c9220 2023-06-09T04:39:35.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bdee6640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 0x7f88b80c96c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f88b80b2810 tx=0x7f88b000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:35.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0010040 con 0x7f88b80c9220 2023-06-09T04:39:35.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b0014830 con 0x7f88b80c9220 2023-06-09T04:39:35.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b8150220 con 0x7f88b80c9220 2023-06-09T04:39:35.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0014be0 con 0x7f88b80c9220 2023-06-09T04:39:35.650 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.642+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b814cc00 con 0x7f88b80c9220 2023-06-09T04:39:35.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.646+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b806e520 con 0x7f88b80c9220 2023-06-09T04:39:35.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.646+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88b0014d40 con 0x7f88b80c9220 2023-06-09T04:39:35.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.646+0000 7f88adffb640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f889c0662b0 0x7f889c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:35.651 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.646+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f88b0083790 con 0x7f88b80c9220 2023-06-09T04:39:35.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.646+0000 7f88bd6e5640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f889c0662b0 0x7f889c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:35.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.646+0000 7f88bd6e5640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f889c0662b0 0x7f889c068760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001ec0 tx=0x7f88b4001d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:35.652 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.650+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88b0054810 con 0x7f88b80c9220 2023-06-09T04:39:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.858+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f88b806abd0 con 0x7f88b80c9220 2023-06-09T04:39:35.869 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.866+0000 7f88adffb640 1 -- 172.21.15.18:0/3942123592 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f88b00543a0 con 0x7f88b80c9220 2023-06-09T04:39:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f889c0662b0 msgr2=0x7f889c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f889c0662b0 0x7f889c068760 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001ec0 tx=0x7f88b4001d70 comp rx=0 tx=0).stop 2023-06-09T04:39:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 msgr2=0x7f88b80c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 0x7f88b80c96c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f88b80b2810 tx=0x7f88b000eb80 comp rx=0 tx=0).stop 2023-06-09T04:39:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 shutdown_connections 2023-06-09T04:39:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88b80c9220 0x7f88b80c96c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88b81f49e0 0x7f88b8149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f889c0662b0 0x7f889c068760 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 --2- 172.21.15.18:0/3942123592 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f88a40047d0 0x7f88b814c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 >> 172.21.15.18:0/3942123592 conn(0x7f88b806f850 msgr2=0x7f88b80b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 shutdown_connections 2023-06-09T04:39:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:35.870+0000 7f88bf949640 1 -- 172.21.15.18:0/3942123592 wait complete. 2023-06-09T04:39:35.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-09T04:39:36.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 Processor -- start 2023-06-09T04:39:36.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 -- start start 2023-06-09T04:39:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92a815d680 0x7f92a806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a815cf10 con 0x7f92a815dad0 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a815a920 con 0x7f92a815d680 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92af5f9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80c81b0 con 0x7f92a8159320 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92a815d680 0x7f92a806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92a815d680 0x7f92a806fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47050/0 (socket says 172.21.15.18:47050) 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92adb96640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f92a815dad0 0x7f92a80692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39346/0 (socket says 172.21.15.18:39346) 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 -- 172.21.15.18:0/1906386384 learned_addr learned my addr 172.21.15.18:0/1906386384 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:36.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92ad395640 1 --2- 172.21.15.18:0/1906386384 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 -- 172.21.15.18:0/1906386384 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 msgr2=0x7f92a815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 --2- 172.21.15.18:0/1906386384 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 -- 172.21.15.18:0/1906386384 >> v1:172.21.15.18:6789/0 conn(0x7f92a815dad0 legacy=0x7f92a80692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.010+0000 7f92acb94640 1 -- 172.21.15.18:0/1906386384 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80c8490 con 0x7f92a815d680 2023-06-09T04:39:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92acb94640 1 --2- 172.21.15.18:0/1906386384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a806fb60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9298009870 tx=0x7f929801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3727ea1f5f9f7e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f929ffff640 1 -- 172.21.15.18:0/1906386384 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980ab680 con 0x7f92a815d680 2023-06-09T04:39:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f929ffff640 1 -- 172.21.15.18:0/1906386384 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92980ab7e0 con 0x7f92a815d680 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f929ffff640 1 -- 172.21.15.18:0/1906386384 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980abb70 con 0x7f92a815d680 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 -- 172.21.15.18:0/1906386384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 msgr2=0x7f92a806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1906386384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a806fb60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9298009870 tx=0x7f929801c480 comp rx=0 tx=0).stop 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 -- 172.21.15.18:0/1906386384 shutdown_connections 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1906386384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a806fb60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1906386384 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 -- 172.21.15.18:0/1906386384 >> 172.21.15.18:0/1906386384 conn(0x7f92a80b0240 msgr2=0x7f92a80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 -- 172.21.15.18:0/1906386384 shutdown_connections 2023-06-09T04:39:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 -- 172.21.15.18:0/1906386384 wait complete. 2023-06-09T04:39:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 Processor -- start 2023-06-09T04:39:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.014+0000 7f92af5f9640 1 -- start start 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a815dad0 0x7f92a815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a80b37d0 con 0x7f92a815d680 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a8152fe0 con 0x7f92a815dad0 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a81f7a20 con 0x7f92a8159320 2023-06-09T04:39:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a80ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47066/0 (socket says 172.21.15.18:47066) 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 -- 172.21.15.18:0/1382396149 learned_addr learned my addr 172.21.15.18:0/1382396149 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92adb96640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a815dad0 0x7f92a815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92ad395640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 -- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 msgr2=0x7f92a80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a80cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 -- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a815dad0 msgr2=0x7f92a815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a815dad0 0x7f92a815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 -- 172.21.15.18:0/1382396149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980094d0 con 0x7f92a815d680 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92adb96640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a815dad0 0x7f92a815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92acb94640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a80ccee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f929801a0b0 tx=0x7f929801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980b4800 con 0x7f92a815d680 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92980b4960 con 0x7f92a815d680 2023-06-09T04:39:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980b4d10 con 0x7f92a815d680 2023-06-09T04:39:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a81f7d00 con 0x7f92a815d680 2023-06-09T04:39:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a81f82c0 con 0x7f92a815d680 2023-06-09T04:39:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a80ce690 con 0x7f92a815d680 2023-06-09T04:39:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92980c7440 con 0x7f92a815d680 2023-06-09T04:39:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f929dffb640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f928c066280 0x7f928c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f929811e990 con 0x7f92a815d680 2023-06-09T04:39:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.018+0000 7f92ad395640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f928c066280 0x7f928c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.022+0000 7f92ad395640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f928c066280 0x7f928c068730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92a4003fd0 tx=0x7f92a40039a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.022+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92980ec0b0 con 0x7f92a815d680 2023-06-09T04:39:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.230+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f92a8151630 con 0x7f92a815d680 2023-06-09T04:39:36.240 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f929dffb640 1 -- 172.21.15.18:0/1382396149 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f92980ef6d0 con 0x7f92a815d680 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f928c066280 msgr2=0x7f928c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f928c066280 0x7f928c068730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f92a4003fd0 tx=0x7f92a40039a0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 msgr2=0x7f92a80ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a80ccee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f929801a0b0 tx=0x7f929801acc0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 shutdown_connections 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92a815dad0 0x7f92a815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92a815d680 0x7f92a80ccee0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f928c066280 0x7f928c068730 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 --2- 172.21.15.18:0/1382396149 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f92a8159320 0x7f92a80cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 >> 172.21.15.18:0/1382396149 conn(0x7f92a80b0240 msgr2=0x7f92a8163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 shutdown_connections 2023-06-09T04:39:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.238+0000 7f92af5f9640 1 -- 172.21.15.18:0/1382396149 wait complete. 2023-06-09T04:39:36.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-09T04:39:36.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 Processor -- start 2023-06-09T04:39:36.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 -- start start 2023-06-09T04:39:36.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94700b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f94700cc9b0 0x7f94700b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947015c950 con 0x7f947006a3e0 2023-06-09T04:39:36.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700ce320 con 0x7f94700cc9b0 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f9474989640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700cc4b0 con 0x7f94700b7480 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f94700cc9b0 0x7f94700b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f94700cc9b0 0x7f94700b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47070/0 (socket says 172.21.15.18:47070) 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 -- 172.21.15.18:0/2854803875 learned_addr learned my addr 172.21.15.18:0/2854803875 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946e59c640 1 --2- 172.21.15.18:0/2854803875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94700b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 -- 172.21.15.18:0/2854803875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 msgr2=0x7f94700b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:36.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 --2- 172.21.15.18:0/2854803875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94700b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 -- 172.21.15.18:0/2854803875 >> v1:172.21.15.81:6789/0 conn(0x7f947006a3e0 legacy=0x7f94700692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.374+0000 7f946dd9b640 1 -- 172.21.15.18:0/2854803875 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94700ce010 con 0x7f94700cc9b0 2023-06-09T04:39:36.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946dd9b640 1 --2- 172.21.15.18:0/2854803875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94700cc9b0 0x7f94700b3e10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9464009870 tx=0x7f946401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efcbe22ca5c4726 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946d59a640 1 -- 172.21.15.18:0/2854803875 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94640a9620 con 0x7f94700cc9b0 2023-06-09T04:39:36.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946d59a640 1 -- 172.21.15.18:0/2854803875 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94640a9780 con 0x7f94700cc9b0 2023-06-09T04:39:36.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946d59a640 1 -- 172.21.15.18:0/2854803875 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94640a9b10 con 0x7f94700cc9b0 2023-06-09T04:39:36.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2854803875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94700cc9b0 msgr2=0x7f94700b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 --2- 172.21.15.18:0/2854803875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94700cc9b0 0x7f94700b3e10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9464009870 tx=0x7f946401c540 comp rx=0 tx=0).stop 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2854803875 shutdown_connections 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 --2- 172.21.15.18:0/2854803875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94700cc9b0 0x7f94700b3e10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 --2- 172.21.15.18:0/2854803875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94700b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2854803875 >> 172.21.15.18:0/2854803875 conn(0x7f94700d2ae0 msgr2=0x7f94700ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2854803875 shutdown_connections 2023-06-09T04:39:36.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2854803875 wait complete. 2023-06-09T04:39:36.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 Processor -- start 2023-06-09T04:39:36.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- start start 2023-06-09T04:39:36.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f947006a3e0 0x7f94700c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94701f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 0x7f947015ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9470155f90 con 0x7f94701f4900 2023-06-09T04:39:36.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700b5e10 con 0x7f947006a3e0 2023-06-09T04:39:36.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700b5200 con 0x7f94700b7480 2023-06-09T04:39:36.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 0x7f947015ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 0x7f947015ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47076/0 (socket says 172.21.15.18:47076) 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 -- 172.21.15.18:0/2097803885 learned_addr learned my addr 172.21.15.18:0/2097803885 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 -- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 msgr2=0x7f94701f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946dd9b640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94701f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946e59c640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f947006a3e0 0x7f94700c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94701f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 -- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f947006a3e0 msgr2=0x7f94700c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f947006a3e0 0x7f94700c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 -- 172.21.15.18:0/2097803885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640094d0 con 0x7f94701f4900 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946e59c640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f947006a3e0 0x7f94700c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f946ed9d640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 0x7f947015ef50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f946800c430 tx=0x7f946800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468005220 con 0x7f94701f4900 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468005380 con 0x7f94701f4900 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94700b54e0 con 0x7f94701f4900 2023-06-09T04:39:36.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468007270 con 0x7f94701f4900 2023-06-09T04:39:36.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.378+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94700b5aa0 con 0x7f94701f4900 2023-06-09T04:39:36.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.382+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470073380 con 0x7f94701f4900 2023-06-09T04:39:36.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.382+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94680073d0 con 0x7f94701f4900 2023-06-09T04:39:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.382+0000 7f945effd640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9450066280 0x7f9450068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.382+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9468083190 con 0x7f94701f4900 2023-06-09T04:39:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.382+0000 7f946e59c640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9450066280 0x7f9450068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.382+0000 7f946e59c640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9450066280 0x7f9450068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f947015cd40 tx=0x7f946000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.386+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9468050780 con 0x7f94701f4900 2023-06-09T04:39:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.590+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f947015ff40 con 0x7f94701f4900 2023-06-09T04:39:36.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f945effd640 1 -- 172.21.15.18:0/2097803885 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9468053da0 con 0x7f94701f4900 2023-06-09T04:39:36.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9450066280 msgr2=0x7f9450068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9450066280 0x7f9450068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f947015cd40 tx=0x7f946000b040 comp rx=0 tx=0).stop 2023-06-09T04:39:36.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 msgr2=0x7f947015ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 0x7f947015ef50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f946800c430 tx=0x7f946800c8f0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.603 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 shutdown_connections 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94701f4900 0x7f947015ef50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f9450066280 0x7f9450068730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94700b7480 0x7f94701f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 --2- 172.21.15.18:0/2097803885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f947006a3e0 0x7f94700c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 >> 172.21.15.18:0/2097803885 conn(0x7f94700d2ae0 msgr2=0x7f947015d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.598+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 shutdown_connections 2023-06-09T04:39:36.604 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.602+0000 7f9474989640 1 -- 172.21.15.18:0/2097803885 wait complete. 2023-06-09T04:39:36.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-09T04:39:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe476f8d640 1 Processor -- start 2023-06-09T04:39:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe476f8d640 1 -- start start 2023-06-09T04:39:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe476f8d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe4700ccd70 0x7fe47015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe476f8d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4700cd820 con 0x7fe4700cbe00 2023-06-09T04:39:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe476f8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4700cc2a0 con 0x7fe470159300 2023-06-09T04:39:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe476f8d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700ca2a0 con 0x7fe4700ccd70 2023-06-09T04:39:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe4700cbe00 0x7fe4700cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39352/0 (socket says 172.21.15.18:39352) 2023-06-09T04:39:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46ffff640 1 -- 172.21.15.18:0/2715853903 learned_addr learned my addr 172.21.15.18:0/2715853903 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe47552a640 1 --2- 172.21.15.18:0/2715853903 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe4700ccd70 0x7fe47015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757908284 0 0) 0x7fe4700cd820 con 0x7fe4700cbe00 2023-06-09T04:39:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c003530 con 0x7fe4700cbe00 2023-06-09T04:39:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065014239 0 0) 0x7fe4700cc2a0 con 0x7fe470159300 2023-06-09T04:39:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4700cd820 con 0x7fe470159300 2023-06-09T04:39:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe47552a640 1 -- 172.21.15.18:0/2715853903 >> v1:172.21.15.81:6789/0 conn(0x7fe470159300 legacy=0x7fe4700cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092211629 0 0) 0x7fe45c003530 con 0x7fe4700cbe00 2023-06-09T04:39:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe47552a640 1 -- 172.21.15.18:0/2715853903 >> v1:172.21.15.18:6789/0 conn(0x7fe4700cbe00 legacy=0x7fe4700cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.734+0000 7fe47552a640 1 -- 172.21.15.18:0/2715853903 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700ca4b0 con 0x7fe4700ccd70 2023-06-09T04:39:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe47552a640 1 --2- 172.21.15.18:0/2715853903 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe4700ccd70 0x7fe47015d9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4600097f0 tx=0x7fe46001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc946cfaf6aec02e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458001680 con 0x7fe4700ccd70 2023-06-09T04:39:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4600a7050 con 0x7fe4700ccd70 2023-06-09T04:39:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe46f7fe640 1 -- 172.21.15.18:0/2715853903 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600ab600 con 0x7fe4700ccd70 2023-06-09T04:39:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 -- 172.21.15.18:0/2715853903 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe4700ccd70 msgr2=0x7fe47015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2715853903 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe4700ccd70 0x7fe47015d9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4600097f0 tx=0x7fe46001c3e0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 -- 172.21.15.18:0/2715853903 shutdown_connections 2023-06-09T04:39:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2715853903 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe4700ccd70 0x7fe47015d9a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 -- 172.21.15.18:0/2715853903 >> 172.21.15.18:0/2715853903 conn(0x7fe47006f850 msgr2=0x7fe47006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 -- 172.21.15.18:0/2715853903 shutdown_connections 2023-06-09T04:39:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 -- 172.21.15.18:0/2715853903 wait complete. 2023-06-09T04:39:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 Processor -- start 2023-06-09T04:39:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.738+0000 7fe476f8d640 1 -- start start 2023-06-09T04:39:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4700cbe00 0x7fe4700c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 0x7fe470157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe470159300 0x7fe470161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c7c20 con 0x7fe4700ccd70 2023-06-09T04:39:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c7f00 con 0x7fe4700cbe00 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c81e0 con 0x7fe470159300 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 0x7fe470157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 0x7fe470157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47080/0 (socket says 172.21.15.18:47080) 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 -- 172.21.15.18:0/2408867340 learned_addr learned my addr 172.21.15.18:0/2408867340 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe47552a640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe470159300 0x7fe470161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe474d29640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4700cbe00 0x7fe4700c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 -- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe470159300 msgr2=0x7fe470161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe470159300 0x7fe470161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 -- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4700cbe00 msgr2=0x7fe4700c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4700cbe00 0x7fe4700c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 -- 172.21.15.18:0/2408867340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009420 con 0x7fe4700ccd70 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46ffff640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 0x7fe470157a50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe458000fe0 tx=0x7fe45800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458005ae0 con 0x7fe4700ccd70 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458005c40 con 0x7fe4700ccd70 2023-06-09T04:39:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700c84c0 con 0x7fe4700ccd70 2023-06-09T04:39:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458007070 con 0x7fe4700ccd70 2023-06-09T04:39:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700c9fb0 con 0x7fe4700ccd70 2023-06-09T04:39:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4700c6720 con 0x7fe4700ccd70 2023-06-09T04:39:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4580071d0 con 0x7fe4700ccd70 2023-06-09T04:39:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46d7fa640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe4500662b0 0x7fe450068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe458083110 con 0x7fe4700ccd70 2023-06-09T04:39:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.742+0000 7fe474d29640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe4500662b0 0x7fe450068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.746+0000 7fe474d29640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe4500662b0 0x7fe450068760 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe468007fd0 tx=0x7fe468009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.746+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4580508e0 con 0x7fe4700ccd70 2023-06-09T04:39:36.952 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.950+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe4700c3520 con 0x7fe4700ccd70 2023-06-09T04:39:36.961 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.958+0000 7fe46d7fa640 1 -- 172.21.15.18:0/2408867340 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe458053f00 con 0x7fe4700ccd70 2023-06-09T04:39:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.958+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe4500662b0 msgr2=0x7fe450068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.958+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe4500662b0 0x7fe450068760 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe468007fd0 tx=0x7fe468009040 comp rx=0 tx=0).stop 2023-06-09T04:39:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.958+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 msgr2=0x7fe470157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 0x7fe470157a50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe458000fe0 tx=0x7fe45800cbc0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 shutdown_connections 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe4500662b0 0x7fe450068760 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe470159300 0x7fe470161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4700ccd70 0x7fe470157a50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 --2- 172.21.15.18:0/2408867340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4700cbe00 0x7fe4700c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 >> 172.21.15.18:0/2408867340 conn(0x7fe47006f850 msgr2=0x7fe4700aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 shutdown_connections 2023-06-09T04:39:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:36.962+0000 7fe476f8d640 1 -- 172.21.15.18:0/2408867340 wait complete. 2023-06-09T04:39:36.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-09T04:39:37.092 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 Processor -- start 2023-06-09T04:39:37.093 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 -- start start 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 0x7f035c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f035c06a3e0 0x7f035c0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c15c950 con 0x7f035c0cc9b0 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035c0ce320 con 0x7f035c06a3e0 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0362914640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0cc4b0 con 0x7f035c0b7480 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f035c0cc9b0 0x7f035c0692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33330/0 (socket says 172.21.15.18:33330) 2023-06-09T04:39:37.094 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035b7fe640 1 -- 172.21.15.18:0/693478617 learned_addr learned my addr 172.21.15.18:0/693478617 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f0360eb1640 1 --2- 172.21.15.18:0/693478617 >> v2:172.21.15.81:3300/0 conn(0x7f035c06a3e0 0x7f035c0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035bfff640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 0x7f035c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.096 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045988699 0 0) 0x7f035c15c950 con 0x7f035c0cc9b0 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0344003530 con 0x7f035c0cc9b0 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698991222 0 0) 0x7f0344003530 con 0x7f035c0cc9b0 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 msgr2=0x7f035c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 0x7f035c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 >> v2:172.21.15.81:3300/0 conn(0x7f035c06a3e0 msgr2=0x7f035c0b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 --2- 172.21.15.18:0/693478617 >> v2:172.21.15.81:3300/0 conn(0x7f035c06a3e0 0x7f035c0b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0ce010 con 0x7f035c0cc9b0 2023-06-09T04:39:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f0350001680 con 0x7f035c0cc9b0 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 >> v1:172.21.15.18:6789/0 conn(0x7f035c0cc9b0 legacy=0x7f035c0692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0344003980 0x7f0344003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 0x7f03440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344004d10 0x7f0344005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0ce320 con 0x7f0344004d10 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0cc4b0 con 0x7f0344003980 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.090+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034400b990 con 0x7f035c0b7480 2023-06-09T04:39:37.098 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344004d10 0x7f0344005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f035bfff640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0344003980 0x7f0344003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f035b7fe640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 0x7f03440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 -- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 msgr2=0x7f03440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0b7480 0x7f03440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 -- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0344003980 msgr2=0x7f0344003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0344003980 0x7f0344003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.099 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 -- 172.21.15.18:0/693478617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344003530 con 0x7f0344004d10 2023-06-09T04:39:37.100 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f035bfff640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0344003980 0x7f0344003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344004d10 0x7f0344005180 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0354009fc0 tx=0x7f035401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361cb4b454c5547b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540a5cb0 con 0x7f0344004d10 2023-06-09T04:39:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035400f040 con 0x7f0344004d10 2023-06-09T04:39:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f035affd640 1 -- 172.21.15.18:0/693478617 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540ad680 con 0x7f0344004d10 2023-06-09T04:39:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0362914640 1 -- 172.21.15.18:0/693478617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344004d10 msgr2=0x7f0344005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0362914640 1 --2- 172.21.15.18:0/693478617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344004d10 0x7f0344005180 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0354009fc0 tx=0x7f035401cc40 comp rx=0 tx=0).stop 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0360eb1640 1 -- 172.21.15.18:0/693478617 reap_dead start 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0362914640 1 -- 172.21.15.18:0/693478617 shutdown_connections 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0362914640 1 -- 172.21.15.18:0/693478617 >> 172.21.15.18:0/693478617 conn(0x7f035c0d2ae0 msgr2=0x7f035c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0362914640 1 -- 172.21.15.18:0/693478617 shutdown_connections 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.094+0000 7f0362914640 1 -- 172.21.15.18:0/693478617 wait complete. 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 Processor -- start 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- start start 2023-06-09T04:39:37.103 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 0x7f035c0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0a9160 0x7f035c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0cff40 0x7f035c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0cbd80 con 0x7f035c1f36c0 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0d03b0 con 0x7f035c0a9160 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0cb100 con 0x7f035c0cff40 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 0x7f035c0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.104 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 0x7f035c0ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37262/0 (socket says 172.21.15.18:37262) 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 -- 172.21.15.18:0/3268454025 learned_addr learned my addr 172.21.15.18:0/3268454025 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0360eb1640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0cff40 0x7f035c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0a9160 0x7f035c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 -- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0cff40 msgr2=0x7f035c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0cff40 0x7f035c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 -- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0a9160 msgr2=0x7f035c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0a9160 0x7f035c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.105 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 -- 172.21.15.18:0/3268454025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0cb3e0 con 0x7f035c1f36c0 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0a9160 0x7f035c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f035bfff640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 0x7f035c0ca860 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f034c009fd0 tx=0x7f034c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c004220 con 0x7f035c1f36c0 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c004380 con 0x7f035c1f36c0 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c015890 con 0x7f035c1f36c0 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c0cb6c0 con 0x7f035c1f36c0 2023-06-09T04:39:37.106 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c0cada0 con 0x7f035c1f36c0 2023-06-09T04:39:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.098+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c0b5520 con 0x7f035c1f36c0 2023-06-09T04:39:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.102+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f034c0159f0 con 0x7f035c1f36c0 2023-06-09T04:39:37.107 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.102+0000 7f0358ff9640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03480662b0 0x7f0348068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.102+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f034c083f90 con 0x7f035c1f36c0 2023-06-09T04:39:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.102+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03480662b0 0x7f0348068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.108 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.102+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03480662b0 0x7f0348068760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0350000c10 tx=0x7f03500014f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.109 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.106+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f034c0b4700 con 0x7f035c1f36c0 2023-06-09T04:39:37.312 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.310+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f035c0b5240 con 0x7f035c1f36c0 2023-06-09T04:39:37.318 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.314+0000 7f0358ff9640 1 -- 172.21.15.18:0/3268454025 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f034c051620 con 0x7f035c1f36c0 2023-06-09T04:39:37.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03480662b0 msgr2=0x7f0348068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03480662b0 0x7f0348068760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0350000c10 tx=0x7f03500014f0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 msgr2=0x7f035c0ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 0x7f035c0ca860 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f034c009fd0 tx=0x7f034c011a60 comp rx=0 tx=0).stop 2023-06-09T04:39:37.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 shutdown_connections 2023-06-09T04:39:37.321 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f03480662b0 0x7f0348068760 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f035c0cff40 0x7f035c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035c0a9160 0x7f035c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 --2- 172.21.15.18:0/3268454025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c1f36c0 0x7f035c0ca860 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 >> 172.21.15.18:0/3268454025 conn(0x7f035c0d2ae0 msgr2=0x7f035c15e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:37.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 shutdown_connections 2023-06-09T04:39:37.322 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.318+0000 7f0362914640 1 -- 172.21.15.18:0/3268454025 wait complete. 2023-06-09T04:39:37.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:37.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 Processor -- start 2023-06-09T04:39:37.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 -- start start 2023-06-09T04:39:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe71015eaf0 0x7fe710070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe710070270 0x7fe7100c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71015eec0 con 0x7fe71006bcb0 2023-06-09T04:39:37.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71006cac0 con 0x7fe710070270 2023-06-09T04:39:37.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe71542b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006c220 con 0x7fe71015eaf0 2023-06-09T04:39:37.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe710070270 0x7fe7100c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe71015eaf0 0x7fe710070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70effd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe71015eaf0 0x7fe710070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:42728/0 (socket says 172.21.15.18:42728) 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70effd640 1 -- 172.21.15.18:0/867383003 learned_addr learned my addr 172.21.15.18:0/867383003 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70f7fe640 1 -- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe71015eaf0 msgr2=0x7fe710070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70f7fe640 1 --2- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe71015eaf0 0x7fe710070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70f7fe640 1 -- 172.21.15.18:0/867383003 >> v1:172.21.15.81:6789/0 conn(0x7fe71006bcb0 legacy=0x7fe71006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.458+0000 7fe70f7fe640 1 -- 172.21.15.18:0/867383003 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71006c500 con 0x7fe710070270 2023-06-09T04:39:37.464 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe70f7fe640 1 --2- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710070270 0x7fe7100c8660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe7080097c0 tx=0x7fe70801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d38b9f8d9bb4f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe70dffb640 1 -- 172.21.15.18:0/867383003 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080ac620 con 0x7fe710070270 2023-06-09T04:39:37.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe70dffb640 1 -- 172.21.15.18:0/867383003 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7080ac780 con 0x7fe710070270 2023-06-09T04:39:37.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe70dffb640 1 -- 172.21.15.18:0/867383003 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080acb10 con 0x7fe710070270 2023-06-09T04:39:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 -- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710070270 msgr2=0x7fe7100c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 --2- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710070270 0x7fe7100c8660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe7080097c0 tx=0x7fe70801c3c0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 -- 172.21.15.18:0/867383003 shutdown_connections 2023-06-09T04:39:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 --2- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710070270 0x7fe7100c8660 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 --2- 172.21.15.18:0/867383003 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe71015eaf0 0x7fe710070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 -- 172.21.15.18:0/867383003 >> 172.21.15.18:0/867383003 conn(0x7fe7100b0240 msgr2=0x7fe7100cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:37.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 -- 172.21.15.18:0/867383003 shutdown_connections 2023-06-09T04:39:37.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 -- 172.21.15.18:0/867383003 wait complete. 2023-06-09T04:39:37.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.462+0000 7fe71542b640 1 Processor -- start 2023-06-09T04:39:37.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- start start 2023-06-09T04:39:37.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe71006bcb0 0x7fe7100c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe710070270 0x7fe7100c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.468 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 0x7fe7100c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101fb8a0 con 0x7fe71015eaf0 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100c2280 con 0x7fe71006bcb0 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100c42d0 con 0x7fe710070270 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 0x7fe7100c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 0x7fe7100c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37264/0 (socket says 172.21.15.18:37264) 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 -- 172.21.15.18:0/1964257211 learned_addr learned my addr 172.21.15.18:0/1964257211 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:37.469 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70effd640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe71006bcb0 0x7fe7100c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70e7fc640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe710070270 0x7fe7100c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 -- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe710070270 msgr2=0x7fe7100c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe710070270 0x7fe7100c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 -- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe71006bcb0 msgr2=0x7fe7100c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe71006bcb0 0x7fe7100c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.470 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 -- 172.21.15.18:0/1964257211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708009420 con 0x7fe71015eaf0 2023-06-09T04:39:37.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70f7fe640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 0x7fe7100c3c70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe708019ff0 tx=0x7fe708019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.471 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080ac620 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7080b5400 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7101faf70 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7080b57b0 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101fb530 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe710073380 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7080b3040 con 0x7fe71015eaf0 2023-06-09T04:39:37.472 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe7077fe640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6f0066280 0x7fe6f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe70811dab0 con 0x7fe71015eaf0 2023-06-09T04:39:37.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.466+0000 7fe70effd640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6f0066280 0x7fe6f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.473 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.470+0000 7fe70effd640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6f0066280 0x7fe6f0068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe700009c40 tx=0x7fe70000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.474 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.470+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7080eb1b0 con 0x7fe71015eaf0 2023-06-09T04:39:37.624 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.622+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7101fb9e0 con 0x7fe71015eaf0 2023-06-09T04:39:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.622+0000 7fe7077fe640 1 -- 172.21.15.18:0/1964257211 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14822 (secure 0 0 0) 0x7fe7080ee7d0 con 0x7fe71015eaf0 2023-06-09T04:39:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:39:34.710357+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:37.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6f0066280 msgr2=0x7fe6f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6f0066280 0x7fe6f0068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe700009c40 tx=0x7fe70000b040 comp rx=0 tx=0).stop 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 msgr2=0x7fe7100c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 0x7fe7100c3c70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe708019ff0 tx=0x7fe708019160 comp rx=0 tx=0).stop 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 shutdown_connections 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe71015eaf0 0x7fe7100c3c70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe6f0066280 0x7fe6f0068730 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe710070270 0x7fe7100c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 --2- 172.21.15.18:0/1964257211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe71006bcb0 0x7fe7100c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 >> 172.21.15.18:0/1964257211 conn(0x7fe7100b0240 msgr2=0x7fe7100ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 shutdown_connections 2023-06-09T04:39:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.626+0000 7fe71542b640 1 -- 172.21.15.18:0/1964257211 wait complete. 2023-06-09T04:39:37.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:37:57.762846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:38:05.383505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:39:37.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:39:37.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fe473640 1 Processor -- start 2023-06-09T04:39:37.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fe473640 1 -- start start 2023-06-09T04:39:37.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fe473640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f62f8159590 0x7f62f8069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fe473640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f815de50 con 0x7f62f81591c0 2023-06-09T04:39:37.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fe473640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f815d2d0 con 0x7f62f80cbd40 2023-06-09T04:39:37.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fe473640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f815d5b0 con 0x7f62f8159590 2023-06-09T04:39:37.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fca10640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f62f8159590 0x7f62f8069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62f7fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f62f81591c0 0x7f62f80cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33332/0 (socket says 172.21.15.18:33332) 2023-06-09T04:39:37.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fca10640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f62f8159590 0x7f62f8069d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37274/0 (socket says 172.21.15.18:37274) 2023-06-09T04:39:37.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62f7fff640 1 -- 172.21.15.18:0/2045870819 learned_addr learned my addr 172.21.15.18:0/2045870819 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fca10640 1 -- 172.21.15.18:0/2045870819 >> v1:172.21.15.81:6789/0 conn(0x7f62f80cbd40 legacy=0x7f62f8069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fca10640 1 -- 172.21.15.18:0/2045870819 >> v1:172.21.15.18:6789/0 conn(0x7f62f81591c0 legacy=0x7f62f80cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fca10640 1 -- 172.21.15.18:0/2045870819 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f815d890 con 0x7f62f8159590 2023-06-09T04:39:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.762+0000 7f62fca10640 1 --2- 172.21.15.18:0/2045870819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f8159590 0x7f62f8069d10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009d90 tx=0x7f62f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d2852c6102a57c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f77fe640 1 -- 172.21.15.18:0/2045870819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5900 con 0x7f62f8159590 2023-06-09T04:39:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f77fe640 1 -- 172.21.15.18:0/2045870819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00a5a60 con 0x7f62f8159590 2023-06-09T04:39:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f77fe640 1 -- 172.21.15.18:0/2045870819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5df0 con 0x7f62f8159590 2023-06-09T04:39:37.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/2045870819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f8159590 msgr2=0x7f62f8069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 --2- 172.21.15.18:0/2045870819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f8159590 0x7f62f8069d10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009d90 tx=0x7f62f001c8e0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/2045870819 shutdown_connections 2023-06-09T04:39:37.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 --2- 172.21.15.18:0/2045870819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f8159590 0x7f62f8069d10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/2045870819 >> 172.21.15.18:0/2045870819 conn(0x7f62f80afa90 msgr2=0x7f62f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/2045870819 shutdown_connections 2023-06-09T04:39:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/2045870819 wait complete. 2023-06-09T04:39:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 Processor -- start 2023-06-09T04:39:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- start start 2023-06-09T04:39:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f80cbd40 0x7f62f80b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 0x7f62f814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62f8159590 0x7f62f814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80b2c70 con 0x7f62f81591c0 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f814f680 con 0x7f62f80cbd40 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8164f30 con 0x7f62f8159590 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 0x7f62f814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 0x7f62f814f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37280/0 (socket says 172.21.15.18:37280) 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 -- 172.21.15.18:0/199921162 learned_addr learned my addr 172.21.15.18:0/199921162 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:37.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f7fff640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f80cbd40 0x7f62f80b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fca10640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62f8159590 0x7f62f814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 -- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62f8159590 msgr2=0x7f62f814f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62f8159590 0x7f62f814f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 -- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f80cbd40 msgr2=0x7f62f80b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f80cbd40 0x7f62f80b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 -- 172.21.15.18:0/199921162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009a70 con 0x7f62f81591c0 2023-06-09T04:39:37.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fca10640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62f8159590 0x7f62f814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:37.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62effff640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 0x7f62f814f140 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c410 tx=0x7f62e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011790 con 0x7f62f81591c0 2023-06-09T04:39:37.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e00118f0 con 0x7f62f81591c0 2023-06-09T04:39:37.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f814fe70 con 0x7f62f81591c0 2023-06-09T04:39:37.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011ce0 con 0x7f62f81591c0 2023-06-09T04:39:37.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.766+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f80b22d0 con 0x7f62f81591c0 2023-06-09T04:39:37.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.770+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f80ccbd0 con 0x7f62f81591c0 2023-06-09T04:39:37.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.770+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62e001c460 con 0x7f62f81591c0 2023-06-09T04:39:37.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.770+0000 7f62f57fa640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d8066280 0x7f62d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:37.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.770+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f62e00837f0 con 0x7f62f81591c0 2023-06-09T04:39:37.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.770+0000 7f62f7fff640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d8066280 0x7f62d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:37.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.770+0000 7f62f7fff640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d8066280 0x7f62d8068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f62e80010f0 tx=0x7f62e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:37.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.774+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62e0050e80 con 0x7f62f81591c0 2023-06-09T04:39:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62f8073380 con 0x7f62f81591c0 2023-06-09T04:39:37.928 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62f57fa640 1 -- 172.21.15.18:0/199921162 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62e00544a0 con 0x7f62f81591c0 2023-06-09T04:39:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2023-06-09T04:39:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d8066280 msgr2=0x7f62d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d8066280 0x7f62d8068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f62e80010f0 tx=0x7f62e8009040 comp rx=0 tx=0).stop 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 msgr2=0x7f62f814f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 0x7f62f814f140 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c410 tx=0x7f62e000c8d0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 shutdown_connections 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d8066280 0x7f62d8068730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62f8159590 0x7f62f814f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f81591c0 0x7f62f814f140 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 --2- 172.21.15.18:0/199921162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f80cbd40 0x7f62f80b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 >> 172.21.15.18:0/199921162 conn(0x7f62f80afa90 msgr2=0x7f62f80ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 shutdown_connections 2023-06-09T04:39:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:37.926+0000 7f62fe473640 1 -- 172.21.15.18:0/199921162 wait complete. 2023-06-09T04:39:37.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:39:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.066+0000 7f4a84103640 1 Processor -- start 2023-06-09T04:39:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.066+0000 7f4a84103640 1 -- start start 2023-06-09T04:39:38.071 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a84103640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a7c0b2bc0 0x7f4a7c1643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a84103640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c159980 con 0x7f4a7c1595b0 2023-06-09T04:39:38.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a84103640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c0cabb0 con 0x7f4a7c0cf890 2023-06-09T04:39:38.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a84103640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7c0cbfc0 con 0x7f4a7c0b2bc0 2023-06-09T04:39:38.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a81e9f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4a7c1595b0 0x7f4a7c0cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33334/0 (socket says 172.21.15.18:33334) 2023-06-09T04:39:38.072 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a81e9f640 1 -- 172.21.15.18:0/3820665390 learned_addr learned my addr 172.21.15.18:0/3820665390 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a826a0640 1 --2- 172.21.15.18:0/3820665390 >> v2:172.21.15.81:3300/0 conn(0x7f4a7c0b2bc0 0x7f4a7c1643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081543432 0 0) 0x7f4a7c159980 con 0x7f4a7c1595b0 2023-06-09T04:39:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a68003530 con 0x7f4a7c1595b0 2023-06-09T04:39:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 613554235 0 0) 0x7f4a68003530 con 0x7f4a7c1595b0 2023-06-09T04:39:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 >> v2:172.21.15.81:3300/0 conn(0x7f4a7c0b2bc0 msgr2=0x7f4a7c1643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 --2- 172.21.15.18:0/3820665390 >> v2:172.21.15.81:3300/0 conn(0x7f4a7c0b2bc0 0x7f4a7c1643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 >> v1:172.21.15.81:6789/0 conn(0x7f4a7c0cf890 legacy=0x7f4a7c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c0ce9f0 con 0x7f4a7c1595b0 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f4a78001680 con 0x7f4a7c1595b0 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 >> v1:172.21.15.18:6789/0 conn(0x7f4a7c1595b0 legacy=0x7f4a7c0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a68003980 0x7f4a68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.075 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a68005180 0x7f4a6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0cbfc0 con 0x7f4a680047d0 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6800c000 con 0x7f4a68005180 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6800c1c0 con 0x7f4a68003980 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a81e9f640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a68003980 0x7f4a68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a826a0640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a68005180 0x7f4a6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a8169e640 1 -- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a68003980 msgr2=0x7f4a68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a68003980 0x7f4a68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a8169e640 1 -- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a68005180 msgr2=0x7f4a6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:38.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a68005180 0x7f4a6800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a8169e640 1 -- 172.21.15.18:0/3820665390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68003530 con 0x7f4a680047d0 2023-06-09T04:39:38.077 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.070+0000 7f4a826a0640 1 -- 172.21.15.18:0/3820665390 reap_dead start 2023-06-09T04:39:38.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a68004c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001780 tx=0x7f4a6c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a59ce3cb2a6bfa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0052d0 con 0x7f4a680047d0 2023-06-09T04:39:38.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0a7050 con 0x7f4a680047d0 2023-06-09T04:39:38.078 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a80e9d640 1 -- 172.21.15.18:0/3820665390 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c003600 con 0x7f4a680047d0 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- 172.21.15.18:0/3820665390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 msgr2=0x7f4a68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a68004c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001780 tx=0x7f4a6c01c3e0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- 172.21.15.18:0/3820665390 shutdown_connections 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 --2- 172.21.15.18:0/3820665390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a68004c40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- 172.21.15.18:0/3820665390 >> 172.21.15.18:0/3820665390 conn(0x7f4a7c06ce60 msgr2=0x7f4a7c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- 172.21.15.18:0/3820665390 shutdown_connections 2023-06-09T04:39:38.079 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- 172.21.15.18:0/3820665390 wait complete. 2023-06-09T04:39:38.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 Processor -- start 2023-06-09T04:39:38.080 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- start start 2023-06-09T04:39:38.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a7c151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.081 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a7c14fef0 0x7f4a7c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c150360 0x7f4a7c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0c84d0 con 0x7f4a680047d0 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1520c0 con 0x7f4a7c150360 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a84103640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c159ab0 con 0x7f4a7c14fef0 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a81e9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a7c151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a81e9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a7c151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37298/0 (socket says 172.21.15.18:37298) 2023-06-09T04:39:38.082 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.074+0000 7f4a81e9f640 1 -- 172.21.15.18:0/3898511994 learned_addr learned my addr 172.21.15.18:0/3898511994 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a826a0640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c150360 0x7f4a7c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a7c14fef0 0x7f4a7c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a81e9f640 1 -- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a7c14fef0 msgr2=0x7f4a7c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a81e9f640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a7c14fef0 0x7f4a7c0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a81e9f640 1 -- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c150360 msgr2=0x7f4a7c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a81e9f640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c150360 0x7f4a7c0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a81e9f640 1 -- 172.21.15.18:0/3898511994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c159d90 con 0x7f4a680047d0 2023-06-09T04:39:38.083 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a826a0640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c150360 0x7f4a7c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a7c14fef0 0x7f4a7c0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a81e9f640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a7c151b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4a78011760 tx=0x7f4a78011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a780137a0 con 0x7f4a680047d0 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78013920 con 0x7f4a680047d0 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c15a070 con 0x7f4a680047d0 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78013cd0 con 0x7f4a680047d0 2023-06-09T04:39:38.084 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c0c7850 con 0x7f4a680047d0 2023-06-09T04:39:38.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7c06d4e0 con 0x7f4a680047d0 2023-06-09T04:39:38.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a780153d0 con 0x7f4a680047d0 2023-06-09T04:39:38.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a727fc640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4a60066280 0x7f4a60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4a78086570 con 0x7f4a680047d0 2023-06-09T04:39:38.085 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4a60066280 0x7f4a60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.078+0000 7f4a8169e640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4a60066280 0x7f4a60068730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001750 tx=0x7f4a6c0011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.086 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.082+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a78053c90 con 0x7f4a680047d0 2023-06-09T04:39:38.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a7c06ecb0 con 0x7f4a680047d0 2023-06-09T04:39:38.239 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a727fc640 1 -- 172.21.15.18:0/3898511994 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a780572b0 con 0x7f4a680047d0 2023-06-09T04:39:38.240 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 8 2023-06-09T04:39:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4a60066280 msgr2=0x7f4a60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4a60066280 0x7f4a60068730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001750 tx=0x7f4a6c0011a0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 msgr2=0x7f4a7c151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a7c151b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4a78011760 tx=0x7f4a78011850 comp rx=0 tx=0).stop 2023-06-09T04:39:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 shutdown_connections 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a7c150360 0x7f4a7c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f4a60066280 0x7f4a60068730 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4a7c14fef0 0x7f4a7c0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 --2- 172.21.15.18:0/3898511994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a680047d0 0x7f4a7c151b80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 >> 172.21.15.18:0/3898511994 conn(0x7f4a7c06ce60 msgr2=0x7f4a7c0b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 shutdown_connections 2023-06-09T04:39:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.238+0000 7f4a84103640 1 -- 172.21.15.18:0/3898511994 wait complete. 2023-06-09T04:39:38.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:39:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f78465ed640 1 Processor -- start 2023-06-09T04:39:38.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f78465ed640 1 -- start start 2023-06-09T04:39:38.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f78465ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f784015a3e0 0x7f784006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f78465ed640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784015cf10 con 0x7f78400700a0 2023-06-09T04:39:38.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f78465ed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7840070520 con 0x7f7840159320 2023-06-09T04:39:38.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f78465ed640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784015dd90 con 0x7f784015a3e0 2023-06-09T04:39:38.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f7844b8a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f78400700a0 0x7f784006bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33342/0 (socket says 172.21.15.18:33342) 2023-06-09T04:39:38.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f7844b8a640 1 -- 172.21.15.18:0/62053622 learned_addr learned my addr 172.21.15.18:0/62053622 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:38.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f783f7fe640 1 --2- 172.21.15.18:0/62053622 >> v2:172.21.15.18:3300/0 conn(0x7f784015a3e0 0x7f784006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f783effd640 1 -- 172.21.15.18:0/62053622 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133467637 0 0) 0x7f784015cf10 con 0x7f78400700a0 2023-06-09T04:39:38.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f783effd640 1 -- 172.21.15.18:0/62053622 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7828003530 con 0x7f78400700a0 2023-06-09T04:39:38.382 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f783f7fe640 1 -- 172.21.15.18:0/62053622 >> v1:172.21.15.81:6789/0 conn(0x7f7840159320 legacy=0x7f784015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f783f7fe640 1 -- 172.21.15.18:0/62053622 >> v1:172.21.15.18:6789/0 conn(0x7f78400700a0 legacy=0x7f784006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.378+0000 7f783f7fe640 1 -- 172.21.15.18:0/62053622 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400c81b0 con 0x7f784015a3e0 2023-06-09T04:39:38.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f783f7fe640 1 --2- 172.21.15.18:0/62053622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784006fb60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78300097c0 tx=0x7f783001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf32526884ba5eaa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.383 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f783effd640 1 -- 172.21.15.18:0/62053622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300ab600 con 0x7f784015a3e0 2023-06-09T04:39:38.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f783effd640 1 -- 172.21.15.18:0/62053622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78300a7050 con 0x7f784015a3e0 2023-06-09T04:39:38.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f783effd640 1 -- 172.21.15.18:0/62053622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300ab980 con 0x7f784015a3e0 2023-06-09T04:39:38.384 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- 172.21.15.18:0/62053622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 msgr2=0x7f784006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 --2- 172.21.15.18:0/62053622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784006fb60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78300097c0 tx=0x7f783001c3c0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- 172.21.15.18:0/62053622 shutdown_connections 2023-06-09T04:39:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 --2- 172.21.15.18:0/62053622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784006fb60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- 172.21.15.18:0/62053622 >> 172.21.15.18:0/62053622 conn(0x7f78400b0240 msgr2=0x7f78400cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- 172.21.15.18:0/62053622 shutdown_connections 2023-06-09T04:39:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- 172.21.15.18:0/62053622 wait complete. 2023-06-09T04:39:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 Processor -- start 2023-06-09T04:39:38.386 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- start start 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f78400700a0 0x7f7840146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7840159320 0x7f784014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400b36c0 con 0x7f784015a3e0 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400b26b0 con 0x7f7840159320 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f78465ed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400b2900 con 0x7f78400700a0 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784014ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37306/0 (socket says 172.21.15.18:37306) 2023-06-09T04:39:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 -- 172.21.15.18:0/2768264225 learned_addr learned my addr 172.21.15.18:0/2768264225 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f783f7fe640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7840159320 0x7f784014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f783ffff640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f78400700a0 0x7f7840146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 -- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f78400700a0 msgr2=0x7f7840146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f78400700a0 0x7f7840146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.389 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 -- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7840159320 msgr2=0x7f784014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7840159320 0x7f784014e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.382+0000 7f7844b8a640 1 -- 172.21.15.18:0/2768264225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7830009420 con 0x7f784015a3e0 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f7844b8a640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784014ecb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f783800caa0 tx=0x7f783800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783800ac00 con 0x7f784015a3e0 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783800ad60 con 0x7f784015a3e0 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78400b2be0 con 0x7f784015a3e0 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838012620 con 0x7f784015a3e0 2023-06-09T04:39:38.390 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78400b31a0 con 0x7f784015a3e0 2023-06-09T04:39:38.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78400b3390 con 0x7f784015a3e0 2023-06-09T04:39:38.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7838007070 con 0x7f784015a3e0 2023-06-09T04:39:38.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783cff9640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f782c066280 0x7f782c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7838083b10 con 0x7f784015a3e0 2023-06-09T04:39:38.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783ffff640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f782c066280 0x7f782c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.391 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.386+0000 7f783ffff640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f782c066280 0x7f782c068730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7834000f70 tx=0x7f7834009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.393 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.390+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78380511a0 con 0x7f784015a3e0 2023-06-09T04:39:38.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.550+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f78400ce690 con 0x7f784015a3e0 2023-06-09T04:39:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.550+0000 7f783cff9640 1 -- 172.21.15.18:0/2768264225 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7838017090 con 0x7f784015a3e0 2023-06-09T04:39:38.553 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:38.553 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2023-06-09T04:39:38.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:38.553 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2023-06-09T04:39:38.553 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2023-06-09T04:39:38.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:38.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2023-06-09T04:39:38.554 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 2, 2023-06-09T04:39:38.554 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": "rbd" 2023-06-09T04:39:38.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:38.554 INFO:teuthology.orchestra.run.smithi018.stdout:] 2023-06-09T04:39:38.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f782c066280 msgr2=0x7f782c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f782c066280 0x7f782c068730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7834000f70 tx=0x7f7834009040 comp rx=0 tx=0).stop 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 msgr2=0x7f784014ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784014ecb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f783800caa0 tx=0x7f783800cf60 comp rx=0 tx=0).stop 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 shutdown_connections 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784015a3e0 0x7f784014ecb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7840159320 0x7f784014e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f782c066280 0x7f782c068730 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 --2- 172.21.15.18:0/2768264225 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f78400700a0 0x7f7840146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 >> 172.21.15.18:0/2768264225 conn(0x7f78400b0240 msgr2=0x7f784006bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:38.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 shutdown_connections 2023-06-09T04:39:38.557 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.554+0000 7f78465ed640 1 -- 172.21.15.18:0/2768264225 wait complete. 2023-06-09T04:39:38.572 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:39:38.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:39:38.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62edaa9640 1 Processor -- start 2023-06-09T04:39:38.696 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62edaa9640 1 -- start start 2023-06-09T04:39:38.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62edaa9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 0x7f62e80b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62edaa9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80b41e0 con 0x7f62e806a3e0 2023-06-09T04:39:38.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62edaa9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80d0590 con 0x7f62e815b650 2023-06-09T04:39:38.697 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62edaa9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e815ba20 con 0x7f62e80b3890 2023-06-09T04:39:38.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f62e806a3e0 0x7f62e80b4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33354/0 (socket says 172.21.15.18:33354) 2023-06-09T04:39:38.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e6ffd640 1 -- 172.21.15.18:0/2441259001 learned_addr learned my addr 172.21.15.18:0/2441259001 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:38.699 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e7fff640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 0x7f62e80b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031671282 0 0) 0x7f62e80b41e0 con 0x7f62e806a3e0 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d0003530 con 0x7f62e806a3e0 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232710035 0 0) 0x7f62e80d0590 con 0x7f62e815b650 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e80b41e0 con 0x7f62e815b650 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480415469 0 0) 0x7f62d0003530 con 0x7f62e806a3e0 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 msgr2=0x7f62e80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:38.700 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 0x7f62e80b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 >> v1:172.21.15.81:6789/0 conn(0x7f62e815b650 legacy=0x7f62e80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80ccbc0 con 0x7f62e806a3e0 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f62dc001680 con 0x7f62e806a3e0 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 >> v1:172.21.15.18:6789/0 conn(0x7f62e806a3e0 legacy=0x7f62e80b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d0003b40 0x7f62d0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 0x7f62d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d0004d10 0x7f62d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.701 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e815ba20 con 0x7f62d0003b40 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d000ba40 con 0x7f62d0004d10 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d000bbb0 con 0x7f62e80b3890 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e77fe640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d0003b40 0x7f62d0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.694+0000 7f62e6ffd640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 0x7f62d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e7fff640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d0004d10 0x7f62d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e77fe640 1 -- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 msgr2=0x7f62d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:38.702 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e77fe640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e80b3890 0x7f62d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e77fe640 1 -- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d0004d10 msgr2=0x7f62d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:38.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e77fe640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d0004d10 0x7f62d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e77fe640 1 -- 172.21.15.18:0/2441259001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0003530 con 0x7f62d0003b40 2023-06-09T04:39:38.703 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e7fff640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d0004d10 0x7f62d0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:38.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e77fe640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d0003b40 0x7f62d0003f30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f62d80018d0 tx=0x7f62d801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a20c138505a2d79 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.705 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80052d0 con 0x7f62d0003b40 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8005450 con 0x7f62d0003b40 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e67fc640 1 -- 172.21.15.18:0/2441259001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8003840 con 0x7f62d0003b40 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62edaa9640 1 -- 172.21.15.18:0/2441259001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d0003b40 msgr2=0x7f62d0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62edaa9640 1 --2- 172.21.15.18:0/2441259001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d0003b40 0x7f62d0003f30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f62d80018d0 tx=0x7f62d801c500 comp rx=0 tx=0).stop 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62e7fff640 1 -- 172.21.15.18:0/2441259001 reap_dead start 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62edaa9640 1 -- 172.21.15.18:0/2441259001 shutdown_connections 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62edaa9640 1 -- 172.21.15.18:0/2441259001 >> 172.21.15.18:0/2441259001 conn(0x7f62e806bf30 msgr2=0x7f62e80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62edaa9640 1 -- 172.21.15.18:0/2441259001 shutdown_connections 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.698+0000 7f62edaa9640 1 -- 172.21.15.18:0/2441259001 wait complete. 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 Processor -- start 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- start start 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8148620 0x7f62e8159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e81489f0 0x7f62e8157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 0x7f62e80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8158640 con 0x7f62e80caca0 2023-06-09T04:39:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80ca880 con 0x7f62e8148620 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8149690 con 0x7f62e81489f0 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 0x7f62e80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 0x7f62e80d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37336/0 (socket says 172.21.15.18:37336) 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 -- 172.21.15.18:0/1600549578 learned_addr learned my addr 172.21.15.18:0/1600549578 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e77fe640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8148620 0x7f62e8159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e6ffd640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e81489f0 0x7f62e8157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.708 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 -- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e81489f0 msgr2=0x7f62e8157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e81489f0 0x7f62e8157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 -- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8148620 msgr2=0x7f62e8159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8148620 0x7f62e8159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 -- 172.21.15.18:0/1600549578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80c9c40 con 0x7f62e80caca0 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62e7fff640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 0x7f62e80d1da0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f62e80b49e0 tx=0x7f62e0007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0014760 con 0x7f62e80caca0 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0011040 con 0x7f62e80caca0 2023-06-09T04:39:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80c9ee0 con 0x7f62e80caca0 2023-06-09T04:39:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0014b20 con 0x7f62e80caca0 2023-06-09T04:39:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e80ca4a0 con 0x7f62e80caca0 2023-06-09T04:39:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e804dea0 con 0x7f62e80caca0 2023-06-09T04:39:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.702+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62e0014c80 con 0x7f62e80caca0 2023-06-09T04:39:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.706+0000 7f62cffff640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d4066280 0x7f62d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.706+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f62e00835c0 con 0x7f62e80caca0 2023-06-09T04:39:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.706+0000 7f62e77fe640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d4066280 0x7f62d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.706+0000 7f62e77fe640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d4066280 0x7f62d4068730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62d80018d0 tx=0x7f62d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.710+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62e0050bb0 con 0x7f62e80caca0 2023-06-09T04:39:38.858 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:38.854+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f62e8159a20 con 0x7f62e80caca0 2023-06-09T04:39:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.562+0000 7f62cffff640 1 -- 172.21.15.18:0/1600549578 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f62e00541d0 con 0x7f62e80caca0 2023-06-09T04:39:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2023-06-09T04:39:39.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d4066280 msgr2=0x7f62d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:39.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d4066280 0x7f62d4068730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62d80018d0 tx=0x7f62d8009040 comp rx=0 tx=0).stop 2023-06-09T04:39:39.570 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 msgr2=0x7f62e80d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 0x7f62e80d1da0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f62e80b49e0 tx=0x7f62e0007f00 comp rx=0 tx=0).stop 2023-06-09T04:39:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 shutdown_connections 2023-06-09T04:39:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e80caca0 0x7f62e80d1da0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f62d4066280 0x7f62d4068730 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f62e81489f0 0x7f62e8157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 --2- 172.21.15.18:0/1600549578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8148620 0x7f62e8159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.566+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 >> 172.21.15.18:0/1600549578 conn(0x7f62d0003b40 msgr2=0x7f62e80cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.570+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 shutdown_connections 2023-06-09T04:39:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.570+0000 7f62edaa9640 1 -- 172.21.15.18:0/1600549578 wait complete. 2023-06-09T04:39:39.595 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:39:39.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 Processor -- start 2023-06-09T04:39:39.729 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 -- start start 2023-06-09T04:39:39.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd0d41594e0 0x7fd0d40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:39.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0d406fbd0 0x7fd0d4070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:39.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d4070560 con 0x7fd0d40c8130 2023-06-09T04:39:39.730 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d40ccff0 con 0x7fd0d41594e0 2023-06-09T04:39:39.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d90dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d40cc620 con 0x7fd0d406fbd0 2023-06-09T04:39:39.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd0d41594e0 0x7fd0d40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:39.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d359e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd0d40c8130 0x7fd0d40c8570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33358/0 (socket says 172.21.15.18:33358) 2023-06-09T04:39:39.731 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d359e640 1 -- 172.21.15.18:0/2492427960 learned_addr learned my addr 172.21.15.18:0/2492427960 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:39.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d259c640 1 --2- 172.21.15.18:0/2492427960 >> v2:172.21.15.81:3300/0 conn(0x7fd0d406fbd0 0x7fd0d4070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:39.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/2492427960 >> v2:172.21.15.81:3300/0 conn(0x7fd0d406fbd0 msgr2=0x7fd0d4070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:39.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/2492427960 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921492294 0 0) 0x7fd0cc001120 con 0x7fd0d40c8130 2023-06-09T04:39:39.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/2492427960 >> v2:172.21.15.81:3300/0 conn(0x7fd0d406fbd0 0x7fd0d4070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/2492427960 >> v1:172.21.15.18:6789/0 conn(0x7fd0d40c8130 legacy=0x7fd0d40c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:39.732 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/2492427960 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d40cba80 con 0x7fd0d41594e0 2023-06-09T04:39:39.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.726+0000 7fd0d259c640 1 --2- 172.21.15.18:0/2492427960 >> v2:172.21.15.81:3300/0 conn(0x7fd0d406fbd0 0x7fd0d4070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:39.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/2492427960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41594e0 0x7fd0d40ccab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ce910 tx=0x7fd0bc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41582aba015ad164 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:39.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/2492427960 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc004230 con 0x7fd0d41594e0 2023-06-09T04:39:39.733 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/2492427960 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc0a7050 con 0x7fd0d41594e0 2023-06-09T04:39:39.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/2492427960 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc003620 con 0x7fd0d41594e0 2023-06-09T04:39:39.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 -- 172.21.15.18:0/2492427960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41594e0 msgr2=0x7fd0d40ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:39.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/2492427960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41594e0 0x7fd0d40ccab0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ce910 tx=0x7fd0bc01c460 comp rx=0 tx=0).stop 2023-06-09T04:39:39.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 -- 172.21.15.18:0/2492427960 shutdown_connections 2023-06-09T04:39:39.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/2492427960 >> v2:172.21.15.81:3300/0 conn(0x7fd0d406fbd0 0x7fd0d4070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/2492427960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41594e0 0x7fd0d40ccab0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 -- 172.21.15.18:0/2492427960 >> 172.21.15.18:0/2492427960 conn(0x7fd0d40b0320 msgr2=0x7fd0d40cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:39.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 -- 172.21.15.18:0/2492427960 shutdown_connections 2023-06-09T04:39:39.735 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.730+0000 7fd0d90dd640 1 -- 172.21.15.18:0/2492427960 wait complete. 2023-06-09T04:39:39.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 Processor -- start 2023-06-09T04:39:39.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- start start 2023-06-09T04:39:39.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 0x7fd0d4156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:39.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d40c8130 0x7fd0d414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:39.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd0d41594e0 0x7fd0d40ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:39.737 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d414d5a0 con 0x7fd0d406fbd0 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d41518a0 con 0x7fd0d40c8130 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40aa960 con 0x7fd0d41594e0 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 0x7fd0d4156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 0x7fd0d4156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37358/0 (socket says 172.21.15.18:37358) 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/3214554148 learned_addr learned my addr 172.21.15.18:0/3214554148 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d359e640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd0d41594e0 0x7fd0d40ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:39.738 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d259c640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d40c8130 0x7fd0d414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd0d41594e0 msgr2=0x7fd0d40ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd0d41594e0 0x7fd0d40ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d40c8130 msgr2=0x7fd0d414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d40c8130 0x7fd0d414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/3214554148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc009420 con 0x7fd0d406fbd0 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 0x7fd0d4156320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0ae040 tx=0x7fd0bc019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc003bb0 con 0x7fd0d406fbd0 2023-06-09T04:39:39.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc003d10 con 0x7fd0d406fbd0 2023-06-09T04:39:39.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d40aac40 con 0x7fd0d406fbd0 2023-06-09T04:39:39.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0ab680 con 0x7fd0d406fbd0 2023-06-09T04:39:39.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d4151b20 con 0x7fd0d406fbd0 2023-06-09T04:39:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d40ab160 con 0x7fd0d406fbd0 2023-06-09T04:39:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.734+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0bc0b2040 con 0x7fd0d406fbd0 2023-06-09T04:39:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.738+0000 7fd0cb7fe640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd0b40662b0 0x7fd0b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.738+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fd0bc11dc70 con 0x7fd0d406fbd0 2023-06-09T04:39:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.738+0000 7fd0d259c640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd0b40662b0 0x7fd0b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:39.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.738+0000 7fd0d259c640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd0b40662b0 0x7fd0b4068760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4156860 tx=0x7fd0c4003a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:39.743 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.742+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0bc0eb190 con 0x7fd0d406fbd0 2023-06-09T04:39:39.898 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:39.894+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd0d4073380 con 0x7fd0d406fbd0 2023-06-09T04:39:40.582 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.578+0000 7fd0cb7fe640 1 -- 172.21.15.18:0/3214554148 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd0bc0b0020 con 0x7fd0d406fbd0 2023-06-09T04:39:40.583 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2023-06-09T04:39:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd0b40662b0 msgr2=0x7fd0b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd0b40662b0 0x7fd0b4068760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4156860 tx=0x7fd0c4003a00 comp rx=0 tx=0).stop 2023-06-09T04:39:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 msgr2=0x7fd0d4156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 0x7fd0d4156320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0ae040 tx=0x7fd0bc019200 comp rx=0 tx=0).stop 2023-06-09T04:39:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 shutdown_connections 2023-06-09T04:39:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd0b40662b0 0x7fd0b4068760 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4156860 tx=0x7fd0c4003a00 comp rx=0 tx=0).stop 2023-06-09T04:39:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd0d41594e0 0x7fd0d40ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d40c8130 0x7fd0d414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 --2- 172.21.15.18:0/3214554148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d406fbd0 0x7fd0d4156320 secure :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0ae040 tx=0x7fd0bc019200 comp rx=0 tx=0).stop 2023-06-09T04:39:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 >> 172.21.15.18:0/3214554148 conn(0x7fd0d40b0320 msgr2=0x7fd0d40692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 shutdown_connections 2023-06-09T04:39:40.591 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.586+0000 7fd0d90dd640 1 -- 172.21.15.18:0/3214554148 wait complete. 2023-06-09T04:39:40.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:39:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.750+0000 7f5ec7e9e640 1 Processor -- start 2023-06-09T04:39:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.750+0000 7f5ec7e9e640 1 -- start start 2023-06-09T04:39:40.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec7e9e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5ec015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.755 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec7e9e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec015bbb0 con 0x7f5ec015f800 2023-06-09T04:39:40.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec7e9e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec015fd80 con 0x7f5ec00cce90 2023-06-09T04:39:40.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec7e9e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00ca3c0 con 0x7f5ec015b7e0 2023-06-09T04:39:40.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5439640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5ec015f800 0x7f5ec00cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33364/0 (socket says 172.21.15.18:33364) 2023-06-09T04:39:40.756 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5439640 1 -- 172.21.15.18:0/3935650741 learned_addr learned my addr 172.21.15.18:0/3935650741 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5ec015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366819521 0 0) 0x7f5ec015bbb0 con 0x7f5ec015f800 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eac003530 con 0x7f5ec015f800 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3174316079 0 0) 0x7f5eac003530 con 0x7f5ec015f800 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 msgr2=0x7f5ec015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5ec015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 >> v1:172.21.15.81:6789/0 conn(0x7f5ec00cce90 legacy=0x7f5ec00cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0160060 con 0x7f5ec015f800 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f5eb0001680 con 0x7f5ec015f800 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 >> v1:172.21.15.18:6789/0 conn(0x7f5ec015f800 legacy=0x7f5ec00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac0039b0 0x7f5eac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5eac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eac004d10 0x7f5eac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00ca3c0 con 0x7f5eac0039b0 2023-06-09T04:39:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac00baa0 con 0x7f5eac004d10 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac00bc60 con 0x7f5ec015b7e0 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac0039b0 0x7f5eac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec643b640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eac004d10 0x7f5eac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5439640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5eac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 -- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 msgr2=0x7f5eac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5eac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 -- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eac004d10 msgr2=0x7f5eac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eac004d10 0x7f5eac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5c3a640 1 -- 172.21.15.18:0/3935650741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac003530 con 0x7f5eac0039b0 2023-06-09T04:39:40.761 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.754+0000 7f5ec5439640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5ec015b7e0 0x7f5eac0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:40.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac0039b0 0x7f5eac003dc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009ae0 tx=0x7f5ebc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4f6071a34ca508 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:40.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0a6510 con 0x7f5eac0039b0 2023-06-09T04:39:40.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0a6670 con 0x7f5eac0039b0 2023-06-09T04:39:40.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec4c38640 1 -- 172.21.15.18:0/3935650741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0a6a20 con 0x7f5eac0039b0 2023-06-09T04:39:40.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/3935650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac0039b0 msgr2=0x7f5eac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.763 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/3935650741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5eac0039b0 0x7f5eac003dc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009ae0 tx=0x7f5ebc01ca20 comp rx=0 tx=0).stop 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 -- 172.21.15.18:0/3935650741 reap_dead start 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/3935650741 shutdown_connections 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/3935650741 >> 172.21.15.18:0/3935650741 conn(0x7f5ec006ce60 msgr2=0x7f5ec006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/3935650741 shutdown_connections 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/3935650741 wait complete. 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 Processor -- start 2023-06-09T04:39:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- start start 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5eac0039b0 0x7f5ec014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ec00af650 0x7f5ec015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 0x7f5ec00c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec015cff0 con 0x7f5ec015cba0 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec014d2c0 con 0x7f5ec00af650 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec7e9e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec01f3fc0 con 0x7f5eac0039b0 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 0x7f5ec00c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 0x7f5ec00c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37370/0 (socket says 172.21.15.18:37370) 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 -- 172.21.15.18:0/1860464807 learned_addr learned my addr 172.21.15.18:0/1860464807 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5eac0039b0 0x7f5ec014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec5439640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ec00af650 0x7f5ec015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 -- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5eac0039b0 msgr2=0x7f5ec014cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5eac0039b0 0x7f5ec014cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 -- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ec00af650 msgr2=0x7f5ec015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ec00af650 0x7f5ec015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 -- 172.21.15.18:0/1860464807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec015d4c0 con 0x7f5ec015cba0 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5eac0039b0 0x7f5ec014cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5ec643b640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 0x7f5ec00c4eb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5ec006ddd0 tx=0x7f5eb800e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.758+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800ec20 con 0x7f5ec015cba0 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800ed80 con 0x7f5ec015cba0 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8003bc0 con 0x7f5ec015cba0 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec015c330 con 0x7f5ec015cba0 2023-06-09T04:39:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec015c050 con 0x7f5ec015cba0 2023-06-09T04:39:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec006ecb0 con 0x7f5ec015cba0 2023-06-09T04:39:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5eb8003d20 con 0x7f5ec015cba0 2023-06-09T04:39:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5eb67fc640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ea4066280 0x7f5ea4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f5eb8082e60 con 0x7f5ec015cba0 2023-06-09T04:39:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ea4066280 0x7f5ea4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.762+0000 7f5ec5c3a640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ea4066280 0x7f5ea4068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0af000 tx=0x7f5ebc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.766+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5eb8050290 con 0x7f5ec015cba0 2023-06-09T04:39:40.956 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.954+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5ec00cdc00 con 0x7f5ec015cba0 2023-06-09T04:39:40.969 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 6 and data pool 7 2023-06-09T04:39:40.972 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.966+0000 7f5eb67fc640 1 -- 172.21.15.18:0/1860464807 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5eb8019020 con 0x7f5ec015cba0 2023-06-09T04:39:40.975 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.970+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ea4066280 msgr2=0x7f5ea4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.975 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.970+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ea4066280 0x7f5ea4068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0af000 tx=0x7f5ebc0046d0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.975 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.970+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 msgr2=0x7f5ec00c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:40.975 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.970+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 0x7f5ec00c4eb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5ec006ddd0 tx=0x7f5eb800e610 comp rx=0 tx=0).stop 2023-06-09T04:39:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.986+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 shutdown_connections 2023-06-09T04:39:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.986+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ec015cba0 0x7f5ec00c4eb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.986+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ec00af650 0x7f5ec015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.986+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f5ea4066280 0x7f5ea4068730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.986+0000 7f5ec7e9e640 1 --2- 172.21.15.18:0/1860464807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5eac0039b0 0x7f5ec014cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:40.989 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.986+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 >> 172.21.15.18:0/1860464807 conn(0x7f5ec006ce60 msgr2=0x7f5ec00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:40.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.994+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 shutdown_connections 2023-06-09T04:39:40.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:40.994+0000 7f5ec7e9e640 1 -- 172.21.15.18:0/1860464807 wait complete. 2023-06-09T04:39:41.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:41.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b6ac9b640 1 Processor -- start 2023-06-09T04:39:41.140 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b6ac9b640 1 -- start start 2023-06-09T04:39:41.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b6ac9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b640cc970 0x7f0b640cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b6ac9b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6415fb70 con 0x7f0b640ca2a0 2023-06-09T04:39:41.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b6ac9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640cdf60 con 0x7f0b6415b770 2023-06-09T04:39:41.141 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b6ac9b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640ca6e0 con 0x7f0b640cc970 2023-06-09T04:39:41.142 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b63fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b640cc970 0x7f0b640cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.142 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b69238640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0b640ca2a0 0x7f0b6415be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33380/0 (socket says 172.21.15.18:33380) 2023-06-09T04:39:41.142 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b69238640 1 -- 172.21.15.18:0/3383629566 learned_addr learned my addr 172.21.15.18:0/3383629566 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:41.142 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b63fff640 1 -- 172.21.15.18:0/3383629566 >> v1:172.21.15.81:6789/0 conn(0x7f0b6415b770 legacy=0x7f0b640cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b63fff640 1 -- 172.21.15.18:0/3383629566 >> v1:172.21.15.18:6789/0 conn(0x7f0b640ca2a0 legacy=0x7f0b6415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b63fff640 1 -- 172.21.15.18:0/3383629566 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b641600a0 con 0x7f0b640cc970 2023-06-09T04:39:41.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.138+0000 7f0b637fe640 1 -- 172.21.15.18:0/3383629566 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590032534 0 0) 0x7f0b6415fb70 con 0x7f0b640ca2a0 2023-06-09T04:39:41.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b63fff640 1 --2- 172.21.15.18:0/3383629566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640cc970 0x7f0b640cf4e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b580097c0 tx=0x7f0b5801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8010da5c249e8180 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b637fe640 1 -- 172.21.15.18:0/3383629566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ab600 con 0x7f0b640cc970 2023-06-09T04:39:41.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b637fe640 1 -- 172.21.15.18:0/3383629566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580a7050 con 0x7f0b640cc970 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b637fe640 1 -- 172.21.15.18:0/3383629566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ab980 con 0x7f0b640cc970 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/3383629566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640cc970 msgr2=0x7f0b640cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/3383629566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640cc970 0x7f0b640cf4e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b580097c0 tx=0x7f0b5801c3f0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/3383629566 shutdown_connections 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/3383629566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640cc970 0x7f0b640cf4e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/3383629566 >> 172.21.15.18:0/3383629566 conn(0x7f0b6406f850 msgr2=0x7f0b6406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:41.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/3383629566 shutdown_connections 2023-06-09T04:39:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/3383629566 wait complete. 2023-06-09T04:39:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 Processor -- start 2023-06-09T04:39:41.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- start start 2023-06-09T04:39:41.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 0x7f0b6413ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b640cc970 0x7f0b6414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0b6415b770 0x7f0b640b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b64151490 con 0x7f0b640ca2a0 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641503f0 con 0x7f0b640cc970 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b6ac9b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641506d0 con 0x7f0b6415b770 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b68a37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 0x7f0b6413ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b68a37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 0x7f0b6413ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37396/0 (socket says 172.21.15.18:37396) 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.142+0000 7f0b68a37640 1 -- 172.21.15.18:0/154598670 learned_addr learned my addr 172.21.15.18:0/154598670 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b63fff640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b640cc970 0x7f0b6414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b69238640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0b6415b770 0x7f0b640b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b68a37640 1 -- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0b6415b770 msgr2=0x7f0b640b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b68a37640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0b6415b770 0x7f0b640b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b68a37640 1 -- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b640cc970 msgr2=0x7f0b6414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b68a37640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b640cc970 0x7f0b6414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b68a37640 1 -- 172.21.15.18:0/154598670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58009420 con 0x7f0b640ca2a0 2023-06-09T04:39:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b68a37640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 0x7f0b6413ed30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c7f0 tx=0x7f0b5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54003b80 con 0x7f0b640ca2a0 2023-06-09T04:39:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54003ce0 con 0x7f0b640ca2a0 2023-06-09T04:39:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b641509b0 con 0x7f0b640ca2a0 2023-06-09T04:39:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400aa90 con 0x7f0b640ca2a0 2023-06-09T04:39:41.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b64150f70 con 0x7f0b640ca2a0 2023-06-09T04:39:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6406eb20 con 0x7f0b640ca2a0 2023-06-09T04:39:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b5400abf0 con 0x7f0b640ca2a0 2023-06-09T04:39:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b617fa640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0b50066280 0x7f0b50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0b540848e0 con 0x7f0b640ca2a0 2023-06-09T04:39:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.146+0000 7f0b63fff640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0b50066280 0x7f0b50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.150+0000 7f0b63fff640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0b50066280 0x7f0b50068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b580ad000 tx=0x7f0b58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.150+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b54051c00 con 0x7f0b640ca2a0 2023-06-09T04:39:41.308 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.306+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b640b5bd0 con 0x7f0b640ca2a0 2023-06-09T04:39:41.310 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.306+0000 7f0b617fa640 1 -- 172.21.15.18:0/154598670 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18487 (secure 0 0 0) 0x7f0b54055220 con 0x7f0b640ca2a0 2023-06-09T04:39:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:41.311 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":40,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:39:40.956964+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:39:38.898942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:39:39.939335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:41.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0b50066280 msgr2=0x7f0b50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.313 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0b50066280 0x7f0b50068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b580ad000 tx=0x7f0b58008040 comp rx=0 tx=0).stop 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 msgr2=0x7f0b6413ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 0x7f0b6413ed30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c7f0 tx=0x7f0b5400ccb0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 shutdown_connections 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0b50066280 0x7f0b50068730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0b6415b770 0x7f0b640b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b640cc970 0x7f0b6414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 --2- 172.21.15.18:0/154598670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b640ca2a0 0x7f0b6413ed30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.314 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 >> 172.21.15.18:0/154598670 conn(0x7f0b6406f850 msgr2=0x7f0b640ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:41.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 shutdown_connections 2023-06-09T04:39:41.315 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.310+0000 7f0b6ac9b640 1 -- 172.21.15.18:0/154598670 wait complete. 2023-06-09T04:39:41.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.446+0000 7efeb6ffd640 1 Processor -- start 2023-06-09T04:39:41.450 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.446+0000 7efeb6ffd640 1 -- start start 2023-06-09T04:39:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efeb015a3e0 0x7efeb006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb6ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb00700a0 0x7efeb006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb6ffd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb015cf10 con 0x7efeb0159320 2023-06-09T04:39:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb6ffd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0070520 con 0x7efeb015a3e0 2023-06-09T04:39:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb6ffd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb015dd90 con 0x7efeb00700a0 2023-06-09T04:39:41.452 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efeb015a3e0 0x7efeb006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efeb015a3e0 0x7efeb006fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37410/0 (socket says 172.21.15.18:37410) 2023-06-09T04:39:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 -- 172.21.15.18:0/3063203377 learned_addr learned my addr 172.21.15.18:0/3063203377 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb559a640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb00700a0 0x7efeb006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.453 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 -- 172.21.15.18:0/3063203377 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb00700a0 msgr2=0x7efeb006bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb00700a0 0x7efeb006bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 -- 172.21.15.18:0/3063203377 >> v1:172.21.15.81:6789/0 conn(0x7efeb0159320 legacy=0x7efeb015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeaffff640 1 -- 172.21.15.18:0/3063203377 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00c81b0 con 0x7efeb015a3e0 2023-06-09T04:39:41.454 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.450+0000 7efeb559a640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb00700a0 0x7efeb006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:41.455 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeaffff640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb006fb60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efea4009870 tx=0x7efea401c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446e14649c429f57 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.455 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeaf7fe640 1 -- 172.21.15.18:0/3063203377 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40ab600 con 0x7efeb015a3e0 2023-06-09T04:39:41.455 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeaf7fe640 1 -- 172.21.15.18:0/3063203377 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40a7050 con 0x7efeb015a3e0 2023-06-09T04:39:41.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeaf7fe640 1 -- 172.21.15.18:0/3063203377 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40ab980 con 0x7efeb015a3e0 2023-06-09T04:39:41.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- 172.21.15.18:0/3063203377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 msgr2=0x7efeb006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.456 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb006fb60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efea4009870 tx=0x7efea401c1c0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- 172.21.15.18:0/3063203377 shutdown_connections 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb00700a0 0x7efeb006bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/3063203377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb006fb60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- 172.21.15.18:0/3063203377 >> 172.21.15.18:0/3063203377 conn(0x7efeb00b0240 msgr2=0x7efeb00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- 172.21.15.18:0/3063203377 shutdown_connections 2023-06-09T04:39:41.457 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- 172.21.15.18:0/3063203377 wait complete. 2023-06-09T04:39:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 Processor -- start 2023-06-09T04:39:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- start start 2023-06-09T04:39:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00700a0 0x7efeb014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb0159320 0x7efeb014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb00692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.459 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c6490 con 0x7efeb015a3e0 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00b3190 con 0x7efeb00700a0 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb6ffd640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c5810 con 0x7efeb0159320 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb00692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb00692b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37418/0 (socket says 172.21.15.18:37418) 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 -- 172.21.15.18:0/725337470 learned_addr learned my addr 172.21.15.18:0/725337470 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb4d99640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00700a0 0x7efeb014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeaffff640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb0159320 0x7efeb014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 -- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb0159320 msgr2=0x7efeb014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb0159320 0x7efeb014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 -- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00700a0 msgr2=0x7efeb014e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00700a0 0x7efeb014e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 -- 172.21.15.18:0/725337470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40094d0 con 0x7efeb015a3e0 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efeb559a640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb00692b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efea800e840 tx=0x7efea800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.454+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800c8d0 con 0x7efeb015a3e0 2023-06-09T04:39:41.461 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800ca30 con 0x7efeb015a3e0 2023-06-09T04:39:41.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb00c5af0 con 0x7efeb015a3e0 2023-06-09T04:39:41.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800cde0 con 0x7efeb015a3e0 2023-06-09T04:39:41.462 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb00c60b0 con 0x7efeb015a3e0 2023-06-09T04:39:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb00c65d0 con 0x7efeb015a3e0 2023-06-09T04:39:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efea8013410 con 0x7efeb015a3e0 2023-06-09T04:39:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efead7fa640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efe9c066280 0x7efe9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7efea8083cd0 con 0x7efeb015a3e0 2023-06-09T04:39:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efeb4d99640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efe9c066280 0x7efe9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.463 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.458+0000 7efeb4d99640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efe9c066280 0x7efe9c068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efea00012f0 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.462+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efeb00c65d0 con 0x7efeb015a3e0 2023-06-09T04:39:41.620 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.618+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb00c65d0 con 0x7efeb015a3e0 2023-06-09T04:39:41.622 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.618+0000 7efead7fa640 1 -- 172.21.15.18:0/725337470 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18487 (secure 0 0 0) 0x7efeb00c65d0 con 0x7efeb015a3e0 2023-06-09T04:39:41.623 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:41.623 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":40,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:39:40.956964+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:39:38.898942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:39:39.939335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efe9c066280 msgr2=0x7efe9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efe9c066280 0x7efe9c068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efea00012f0 tx=0x7efea0009040 comp rx=0 tx=0).stop 2023-06-09T04:39:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 msgr2=0x7efeb00692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb00692b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efea800e840 tx=0x7efea800ed00 comp rx=0 tx=0).stop 2023-06-09T04:39:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 shutdown_connections 2023-06-09T04:39:41.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb015a3e0 0x7efeb00692b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7efe9c066280 0x7efe9c068730 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efeb0159320 0x7efeb014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 --2- 172.21.15.18:0/725337470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00700a0 0x7efeb014e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 >> 172.21.15.18:0/725337470 conn(0x7efeb00b0240 msgr2=0x7efeb014e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 shutdown_connections 2023-06-09T04:39:41.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.622+0000 7efeb6ffd640 1 -- 172.21.15.18:0/725337470 wait complete. 2023-06-09T04:39:41.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:39:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b32f30640 1 Processor -- start 2023-06-09T04:39:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b32f30640 1 -- start start 2023-06-09T04:39:41.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b32f30640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b2c15f280 0x7f3b2c15f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b32f30640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c15fd40 con 0x7f3b2c15b600 2023-06-09T04:39:41.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b32f30640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c160020 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b32f30640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c0cfce0 con 0x7f3b2c15f280 2023-06-09T04:39:41.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b30ccc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3b2c15b600 0x7f3b2c0b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33394/0 (socket says 172.21.15.18:33394) 2023-06-09T04:39:41.773 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b30ccc640 1 -- 172.21.15.18:0/2850444362 learned_addr learned my addr 172.21.15.18:0/2850444362 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:41.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b2bfff640 1 --2- 172.21.15.18:0/2850444362 >> v2:172.21.15.18:3300/0 conn(0x7f3b2c15f280 0x7f3b2c15f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b2b7fe640 1 -- 172.21.15.18:0/2850444362 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164090934 0 0) 0x7f3b2c15fd40 con 0x7f3b2c15b600 2023-06-09T04:39:41.774 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b2b7fe640 1 -- 172.21.15.18:0/2850444362 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b14003530 con 0x7f3b2c15b600 2023-06-09T04:39:41.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b2bfff640 1 -- 172.21.15.18:0/2850444362 >> v1:172.21.15.81:6789/0 conn(0x7f3b2c0b39d0 legacy=0x7f3b2c0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b2bfff640 1 -- 172.21.15.18:0/2850444362 >> v1:172.21.15.18:6789/0 conn(0x7f3b2c15b600 legacy=0x7f3b2c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.775 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.770+0000 7f3b2bfff640 1 -- 172.21.15.18:0/2850444362 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0cfef0 con 0x7f3b2c15f280 2023-06-09T04:39:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b2bfff640 1 --2- 172.21.15.18:0/2850444362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c15f280 0x7f3b2c15f700 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3b200097c0 tx=0x7f3b2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9a46356c871086 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b2b7fe640 1 -- 172.21.15.18:0/2850444362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200a8050 con 0x7f3b2c15f280 2023-06-09T04:39:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b2b7fe640 1 -- 172.21.15.18:0/2850444362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200ac5f0 con 0x7f3b2c15f280 2023-06-09T04:39:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b2b7fe640 1 -- 172.21.15.18:0/2850444362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200ac960 con 0x7f3b2c15f280 2023-06-09T04:39:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- 172.21.15.18:0/2850444362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c15f280 msgr2=0x7f3b2c15f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2850444362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c15f280 0x7f3b2c15f700 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3b200097c0 tx=0x7f3b2001c480 comp rx=0 tx=0).stop 2023-06-09T04:39:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- 172.21.15.18:0/2850444362 shutdown_connections 2023-06-09T04:39:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2850444362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c15f280 0x7f3b2c15f700 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- 172.21.15.18:0/2850444362 >> 172.21.15.18:0/2850444362 conn(0x7f3b2c0d2120 msgr2=0x7f3b2c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- 172.21.15.18:0/2850444362 shutdown_connections 2023-06-09T04:39:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- 172.21.15.18:0/2850444362 wait complete. 2023-06-09T04:39:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 Processor -- start 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- start start 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 0x7f3b2c153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2c15b600 0x7f3b2c154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b2c15f280 0x7f3b2c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c139e00 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c90c0 con 0x7f3b2c15b600 2023-06-09T04:39:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b32f30640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c93a0 con 0x7f3b2c15f280 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b30ccc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 0x7f3b2c153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b30ccc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 0x7f3b2c153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37440/0 (socket says 172.21.15.18:37440) 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b30ccc640 1 -- 172.21.15.18:0/2703228094 learned_addr learned my addr 172.21.15.18:0/2703228094 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b2bfff640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2c15b600 0x7f3b2c154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b314cd640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b2c15f280 0x7f3b2c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.774+0000 7f3b30ccc640 1 -- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b2c15f280 msgr2=0x7f3b2c0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.781 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b30ccc640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b2c15f280 0x7f3b2c0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b30ccc640 1 -- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2c15b600 msgr2=0x7f3b2c154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b30ccc640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2c15b600 0x7f3b2c154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b30ccc640 1 -- 172.21.15.18:0/2703228094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009420 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b2bfff640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2c15b600 0x7f3b2c154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b30ccc640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 0x7f3b2c153d20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c4d0 tx=0x7f3b1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c005cf0 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c005e50 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.782 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c139a20 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c007270 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c14c910 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.783 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c139f40 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b1c0073d0 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b297fa640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3b18066280 0x7f3b18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3b1c083370 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b2bfff640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3b18066280 0x7f3b18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.778+0000 7f3b2bfff640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3b18066280 0x7f3b18068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b200ae000 tx=0x7f3b200a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:41.785 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.782+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b1c0507f0 con 0x7f3b2c0b39d0 2023-06-09T04:39:41.973 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:41.970+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3b2c06a7d0 con 0x7f3b2c0b39d0 2023-06-09T04:39:42.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:42.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b297fa640 1 -- 172.21.15.18:0/2703228094 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3b1c053e10 con 0x7f3b2c0b39d0 2023-06-09T04:39:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3b18066280 msgr2=0x7f3b18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3b18066280 0x7f3b18068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b200ae000 tx=0x7f3b200a7000 comp rx=0 tx=0).stop 2023-06-09T04:39:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 msgr2=0x7f3b2c153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 0x7f3b2c153d20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c4d0 tx=0x7f3b1c00c990 comp rx=0 tx=0).stop 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 shutdown_connections 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f3b18066280 0x7f3b18068730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b2c15f280 0x7f3b2c0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2c15b600 0x7f3b2c154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 --2- 172.21.15.18:0/2703228094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b2c0b39d0 0x7f3b2c153d20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 >> 172.21.15.18:0/2703228094 conn(0x7f3b2c0d2120 msgr2=0x7f3b2c069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 shutdown_connections 2023-06-09T04:39:42.988 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:42.982+0000 7f3b32f30640 1 -- 172.21.15.18:0/2703228094 wait complete. 2023-06-09T04:39:43.009 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:39:43.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:39:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f72704bb640 1 Processor -- start 2023-06-09T04:39:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f72704bb640 1 -- start start 2023-06-09T04:39:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f72704bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 0x7f7268069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f72704bb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726815de50 con 0x7f72680cbd40 2023-06-09T04:39:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f72704bb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726815d2d0 con 0x7f72681591c0 2023-06-09T04:39:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f72704bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726815d5b0 con 0x7f7268159590 2023-06-09T04:39:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f72680cbd40 0x7f7268069600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33404/0 (socket says 172.21.15.18:33404) 2023-06-09T04:39:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 -- 172.21.15.18:0/2289246287 learned_addr learned my addr 172.21.15.18:0/2289246287 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726ea58640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 0x7f7268069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455199967 0 0) 0x7f726815de50 con 0x7f72680cbd40 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7254003530 con 0x7f72680cbd40 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011181510 0 0) 0x7f7254003530 con 0x7f72680cbd40 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 msgr2=0x7f7268069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 0x7f7268069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 >> v1:172.21.15.81:6789/0 conn(0x7f72681591c0 legacy=0x7f72680cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726815d890 con 0x7f72680cbd40 2023-06-09T04:39:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f7258001680 con 0x7f72680cbd40 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 >> v1:172.21.15.18:6789/0 conn(0x7f72680cbd40 legacy=0x7f7268069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 0x7f72540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7254003f30 0x7f72540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254004d10 0x7f7254005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726815d5b0 con 0x7f7254003f30 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725400ba70 con 0x7f7254004d10 2023-06-09T04:39:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725400bc30 con 0x7f7268159590 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7254003f30 0x7f72540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726e257640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 0x7f72540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726ea58640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254004d10 0x7f7254005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 -- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 msgr2=0x7f72540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268159590 0x7f72540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 -- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254004d10 msgr2=0x7f7254005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254004d10 0x7f7254005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.142+0000 7f726da56640 1 -- 172.21.15.18:0/2289246287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254003530 con 0x7f7254003f30 2023-06-09T04:39:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f726da56640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7254003f30 0x7f72540047d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f72680ad4a0 tx=0x7f725801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b914f112b76d3388 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258005ae0 con 0x7f7254003f30 2023-06-09T04:39:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72580ab070 con 0x7f7254003f30 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f726d255640 1 -- 172.21.15.18:0/2289246287 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258007070 con 0x7f7254003f30 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- 172.21.15.18:0/2289246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7254003f30 msgr2=0x7f72540047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 --2- 172.21.15.18:0/2289246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7254003f30 0x7f72540047d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f72680ad4a0 tx=0x7f725801f350 comp rx=0 tx=0).stop 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f726ea58640 1 -- 172.21.15.18:0/2289246287 reap_dead start 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- 172.21.15.18:0/2289246287 shutdown_connections 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- 172.21.15.18:0/2289246287 >> 172.21.15.18:0/2289246287 conn(0x7f72680afa90 msgr2=0x7f72680afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- 172.21.15.18:0/2289246287 shutdown_connections 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- 172.21.15.18:0/2289246287 wait complete. 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 Processor -- start 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- start start 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254003f30 0x7f7268150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 0x7f72681571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268157700 0x7f72680c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680b0a30 con 0x7f7268154730 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7268150e70 con 0x7f7254003f30 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.146+0000 7f72704bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72680b0ca0 con 0x7f7268157700 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 0x7f72681571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 0x7f72681571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37456/0 (socket says 172.21.15.18:37456) 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 -- 172.21.15.18:0/1899347192 learned_addr learned my addr 172.21.15.18:0/1899347192 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726ea58640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268157700 0x7f72680c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726e257640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254003f30 0x7f7268150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 -- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268157700 msgr2=0x7f72680c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268157700 0x7f72680c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 -- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254003f30 msgr2=0x7f7268150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254003f30 0x7f7268150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 -- 172.21.15.18:0/1899347192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680b0f80 con 0x7f7268154730 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726ea58640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268157700 0x7f72680c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726e257640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254003f30 0x7f7268150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726da56640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 0x7f72681571c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7258025fc0 tx=0x7f7254005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:43.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258001640 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258007070 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72680b1260 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258007420 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72680c2e40 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72680695a0 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7258007580 con 0x7f7268154730 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f725effd640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f724c066280 0x7f724c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7258121400 con 0x7f7268154730 2023-06-09T04:39:43.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.150+0000 7f726e257640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f724c066280 0x7f724c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:43.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.154+0000 7f726e257640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f724c066280 0x7f724c068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7264007fd0 tx=0x7f7264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:43.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.154+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72580ee6b0 con 0x7f7268154730 2023-06-09T04:39:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.342+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f726806a6d0 con 0x7f7268154730 2023-06-09T04:39:43.995 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.994+0000 7f725effd640 1 -- 172.21.15.18:0/1899347192 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72580f1cd0 con 0x7f7268154730 2023-06-09T04:39:44.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f724c066280 msgr2=0x7f724c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f724c066280 0x7f724c068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7264007fd0 tx=0x7f7264009040 comp rx=0 tx=0).stop 2023-06-09T04:39:44.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 msgr2=0x7f72681571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 0x7f72681571c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7258025fc0 tx=0x7f7254005800 comp rx=0 tx=0).stop 2023-06-09T04:39:44.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 shutdown_connections 2023-06-09T04:39:44.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f724c066280 0x7f724c068730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7268157700 0x7f72680c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7268154730 0x7f72681571c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 --2- 172.21.15.18:0/1899347192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7254003f30 0x7f7268150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 >> 172.21.15.18:0/1899347192 conn(0x7f72680afa90 msgr2=0x7f72680ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 shutdown_connections 2023-06-09T04:39:44.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:43.998+0000 7f72704bb640 1 -- 172.21.15.18:0/1899347192 wait complete. 2023-06-09T04:39:44.020 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:39:44.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fb1259640 1 Processor -- start 2023-06-09T04:39:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fb1259640 1 -- start start 2023-06-09T04:39:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fb1259640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1fac15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fb1259640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0cd820 con 0x7f1fac0cbe00 2023-06-09T04:39:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fb1259640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0cc2a0 con 0x7f1fac159300 2023-06-09T04:39:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fb1259640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0ca2a0 con 0x7f1fac0ccd70 2023-06-09T04:39:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faa59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1fac0cbe00 0x7f1fac0cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33414/0 (socket says 172.21.15.18:33414) 2023-06-09T04:39:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faa59c640 1 -- 172.21.15.18:0/436412569 learned_addr learned my addr 172.21.15.18:0/436412569 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:44.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fab59e640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1fac15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286818594 0 0) 0x7f1fac0cd820 con 0x7f1fac0cbe00 2023-06-09T04:39:44.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f98003530 con 0x7f1fac0cbe00 2023-06-09T04:39:44.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 684131657 0 0) 0x7f1f98003530 con 0x7f1fac0cbe00 2023-06-09T04:39:44.151 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 msgr2=0x7f1fac15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1fac15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 >> v1:172.21.15.81:6789/0 conn(0x7f1fac159300 legacy=0x7f1fac0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0ca4b0 con 0x7f1fac0cbe00 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f1f9c001680 con 0x7f1fac0cbe00 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 >> v1:172.21.15.18:6789/0 conn(0x7f1fac0cbe00 legacy=0x7f1fac0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f980039b0 0x7f1f98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980047d0 0x7f1f98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1f98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0ca2a0 con 0x7f1f980039b0 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9800ba40 con 0x7f1f980047d0 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9800bbd0 con 0x7f1fac0ccd70 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faad9d640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f980039b0 0x7f1f98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fab59e640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1f98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faad9d640 1 -- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 msgr2=0x7f1f98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:44.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faad9d640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1f98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faad9d640 1 -- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980047d0 msgr2=0x7f1f98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faa59c640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980047d0 0x7f1f98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faad9d640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980047d0 0x7f1f98004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1faad9d640 1 -- 172.21.15.18:0/436412569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98003530 con 0x7f1f980039b0 2023-06-09T04:39:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.146+0000 7f1fab59e640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1fac0ccd70 0x7f1f98005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1faad9d640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f980039b0 0x7f1f98003dc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001780 tx=0x7f1f9401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ca071ada0a9dd2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940052d0 con 0x7f1f980039b0 2023-06-09T04:39:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940a7050 con 0x7f1f980039b0 2023-06-09T04:39:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fa9d9b640 1 -- 172.21.15.18:0/436412569 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94003600 con 0x7f1f980039b0 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 -- 172.21.15.18:0/436412569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f980039b0 msgr2=0x7f1f98003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 --2- 172.21.15.18:0/436412569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f980039b0 0x7f1f98003dc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001780 tx=0x7f1f9401c400 comp rx=0 tx=0).stop 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fab59e640 1 -- 172.21.15.18:0/436412569 reap_dead start 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 -- 172.21.15.18:0/436412569 shutdown_connections 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 -- 172.21.15.18:0/436412569 >> 172.21.15.18:0/436412569 conn(0x7f1fac06f850 msgr2=0x7f1fac06fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 -- 172.21.15.18:0/436412569 shutdown_connections 2023-06-09T04:39:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 -- 172.21.15.18:0/436412569 wait complete. 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 Processor -- start 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.150+0000 7f1fb1259640 1 -- start start 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f980039b0 0x7f1fac14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 0x7f1fac159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fac1534f0 0x7f1fac153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac153ea0 con 0x7f1fac159aa0 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac15b0a0 con 0x7f1fac1534f0 2023-06-09T04:39:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac15a520 con 0x7f1f980039b0 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 0x7f1fac159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 0x7f1fac159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37474/0 (socket says 172.21.15.18:37474) 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 -- 172.21.15.18:0/115109094 learned_addr learned my addr 172.21.15.18:0/115109094 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fab59e640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fac1534f0 0x7f1fac153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faad9d640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f980039b0 0x7f1fac14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 -- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f980039b0 msgr2=0x7f1fac14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f980039b0 0x7f1fac14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 -- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fac1534f0 msgr2=0x7f1fac153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fac1534f0 0x7f1fac153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 -- 172.21.15.18:0/115109094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac15a800 con 0x7f1fac159aa0 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faa59c640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 0x7f1fac159ef0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00d6f0 tx=0x7f1f9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0072e0 con 0x7f1fac159aa0 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c007440 con 0x7f1fac159aa0 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac15aae0 con 0x7f1fac159aa0 2023-06-09T04:39:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0047f0 con 0x7f1fac159aa0 2023-06-09T04:39:44.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac14e670 con 0x7f1fac159aa0 2023-06-09T04:39:44.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac0cd140 con 0x7f1fac159aa0 2023-06-09T04:39:44.161 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f9c004950 con 0x7f1fac159aa0 2023-06-09T04:39:44.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fa37fe640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f8c066280 0x7f1f8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1f9c083e80 con 0x7f1fac159aa0 2023-06-09T04:39:44.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.154+0000 7f1faad9d640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f8c066280 0x7f1f8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.158+0000 7f1faad9d640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f8c066280 0x7f1f8c068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001750 tx=0x7f1f940011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.162 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.158+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f9c051250 con 0x7f1fac159aa0 2023-06-09T04:39:44.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.338+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fac06fd60 con 0x7f1fac159aa0 2023-06-09T04:39:44.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fa37fe640 1 -- 172.21.15.18:0/115109094 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f1f9c019090 con 0x7f1fac159aa0 2023-06-09T04:39:44.343 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:44.343 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/286358866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":286358866},{"type":"v1","addr":"172.21.15.81:6836","nonce":286358866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/17695310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":17695310},{"type":"v1","addr":"172.21.15.18:6834","nonce":17695310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3934903071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3934903071},{"type":"v1","addr":"172.21.15.18:6835","nonce":3934903071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:39:40.957288+0000","modified":"2023-06-09T04:39:43.978585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2632765373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2632765373},{"type":"v1","addr":"172.21.15.81:6837","nonce":2632765373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:39:44.344 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 16 2023-06-09T04:39:44.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f8c066280 msgr2=0x7f1f8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f8c066280 0x7f1f8c068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001750 tx=0x7f1f940011a0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 msgr2=0x7f1fac159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 0x7f1fac159ef0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00d6f0 tx=0x7f1f9c00dbb0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 shutdown_connections 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fac1534f0 0x7f1fac153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fac159aa0 0x7f1fac159ef0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f1f8c066280 0x7f1f8c068730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 --2- 172.21.15.18:0/115109094 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1f980039b0 0x7f1fac14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 >> 172.21.15.18:0/115109094 conn(0x7f1fac06f850 msgr2=0x7f1fac0b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.346 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 shutdown_connections 2023-06-09T04:39:44.347 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.342+0000 7f1fb1259640 1 -- 172.21.15.18:0/115109094 wait complete. 2023-06-09T04:39:44.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:39:44.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 Processor -- start 2023-06-09T04:39:44.480 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 -- start start 2023-06-09T04:39:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f05a815a3e0 0x7f05a806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f05a80700a0 0x7f05a806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a815cf10 con 0x7f05a8159320 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a8070520 con 0x7f05a80700a0 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05acfdc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a815dd90 con 0x7f05a815a3e0 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f05a8159320 0x7f05a815d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33426/0 (socket says 172.21.15.18:33426) 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a659c640 1 -- 172.21.15.18:0/2755935676 learned_addr learned my addr 172.21.15.18:0/2755935676 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:44.482 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a6d9d640 1 --2- 172.21.15.18:0/2755935676 >> v2:172.21.15.18:3300/0 conn(0x7f05a80700a0 0x7f05a806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a5d9b640 1 --2- 172.21.15.18:0/2755935676 >> v2:172.21.15.81:3300/0 conn(0x7f05a815a3e0 0x7f05a806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a559a640 1 -- 172.21.15.18:0/2755935676 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560898426 0 0) 0x7f05a815cf10 con 0x7f05a8159320 2023-06-09T04:39:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a559a640 1 -- 172.21.15.18:0/2755935676 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0590003530 con 0x7f05a8159320 2023-06-09T04:39:44.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a6d9d640 1 -- 172.21.15.18:0/2755935676 >> v2:172.21.15.81:3300/0 conn(0x7f05a815a3e0 msgr2=0x7f05a806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:44.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a6d9d640 1 --2- 172.21.15.18:0/2755935676 >> v2:172.21.15.81:3300/0 conn(0x7f05a815a3e0 0x7f05a806fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a6d9d640 1 -- 172.21.15.18:0/2755935676 >> v1:172.21.15.18:6789/0 conn(0x7f05a8159320 legacy=0x7f05a815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.484 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.478+0000 7f05a6d9d640 1 -- 172.21.15.18:0/2755935676 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a80c81b0 con 0x7f05a80700a0 2023-06-09T04:39:44.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05a6d9d640 1 --2- 172.21.15.18:0/2755935676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a80700a0 0x7f05a806bcb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f05a80cd7d0 tx=0x7f05a001c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0e1402665270ff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05a559a640 1 -- 172.21.15.18:0/2755935676 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00a6660 con 0x7f05a80700a0 2023-06-09T04:39:44.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05a559a640 1 -- 172.21.15.18:0/2755935676 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a00a67c0 con 0x7f05a80700a0 2023-06-09T04:39:44.485 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05a559a640 1 -- 172.21.15.18:0/2755935676 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00a6b30 con 0x7f05a80700a0 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 -- 172.21.15.18:0/2755935676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a80700a0 msgr2=0x7f05a806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 --2- 172.21.15.18:0/2755935676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a80700a0 0x7f05a806bcb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f05a80cd7d0 tx=0x7f05a001c590 comp rx=0 tx=0).stop 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 -- 172.21.15.18:0/2755935676 shutdown_connections 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 --2- 172.21.15.18:0/2755935676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a80700a0 0x7f05a806bcb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 --2- 172.21.15.18:0/2755935676 >> v2:172.21.15.81:3300/0 conn(0x7f05a815a3e0 0x7f05a806fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 -- 172.21.15.18:0/2755935676 >> 172.21.15.18:0/2755935676 conn(0x7f05a80b0240 msgr2=0x7f05a80cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 -- 172.21.15.18:0/2755935676 shutdown_connections 2023-06-09T04:39:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 -- 172.21.15.18:0/2755935676 wait complete. 2023-06-09T04:39:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 Processor -- start 2023-06-09T04:39:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.482+0000 7f05acfdc640 1 -- start start 2023-06-09T04:39:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f05a80700a0 0x7f05a8148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a8159320 0x7f05a8156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 0x7f05a8157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a81490a0 con 0x7f05a815a3e0 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a814fea0 con 0x7f05a8159320 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80b1af0 con 0x7f05a80700a0 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 0x7f05a8157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 0x7f05a8157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37504/0 (socket says 172.21.15.18:37504) 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 -- 172.21.15.18:0/4083560538 learned_addr learned my addr 172.21.15.18:0/4083560538 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a659c640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f05a80700a0 0x7f05a8148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a5d9b640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a8159320 0x7f05a8156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 -- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f05a80700a0 msgr2=0x7f05a8148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f05a80700a0 0x7f05a8148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 -- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a8159320 msgr2=0x7f05a8156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a8159320 0x7f05a8156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 -- 172.21.15.18:0/4083560538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a0009a70 con 0x7f05a815a3e0 2023-06-09T04:39:44.490 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a5d9b640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a8159320 0x7f05a8156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a659c640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f05a80700a0 0x7f05a8148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a6d9d640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 0x7f05a8157020 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f05a001a1c0 tx=0x7f05a0019330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00b4040 con 0x7f05a815a3e0 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a00bc680 con 0x7f05a815a3e0 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a80b1dd0 con 0x7f05a815a3e0 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00bc9f0 con 0x7f05a815a3e0 2023-06-09T04:39:44.491 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a81500f0 con 0x7f05a815a3e0 2023-06-09T04:39:44.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a8150310 con 0x7f05a815a3e0 2023-06-09T04:39:44.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05a00bcb50 con 0x7f05a815a3e0 2023-06-09T04:39:44.492 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f0596ffd640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f05880662b0 0x7f0588068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05a011f1e0 con 0x7f05a815a3e0 2023-06-09T04:39:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.486+0000 7f05a659c640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f05880662b0 0x7f0588068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.490+0000 7f05a659c640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f05880662b0 0x7f0588068760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0598005890 tx=0x7f0598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.490+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05a00ec520 con 0x7f05a815a3e0 2023-06-09T04:39:44.532 INFO:tasks.ceph.mds.b.smithi081.stderr:2023-06-09T04:39:44.528+0000 7f042e7fe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:39:44.649 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.646+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05a806bd40 con 0x7f05a815a3e0 2023-06-09T04:39:44.653 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.650+0000 7f0596ffd640 1 -- 172.21.15.18:0/4083560538 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18474 (secure 0 0 0) 0x7f05a00efb40 con 0x7f05a815a3e0 2023-06-09T04:39:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:44.653 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":41,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","created":"2023-06-09T04:37:47.222383+0000","modified":"2023-06-09T04:39:41.961229+0000","last_up_change":"2023-06-09T04:37:58.460152+0000","last_in_change":"2023-06-09T04:37:49.491271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:37:57.762846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:38:05.383505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:39:38.898942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:39:39.939335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"356c0f63-ad8a-4ac6-b443-15726a83e608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6801","nonce":1873893604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6803","nonce":1873893604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6807","nonce":1873893604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1873893604},{"type":"v1","addr":"172.21.15.18:6805","nonce":1873893604}]},"public_addr":"172.21.15.18:6801/1873893604","cluster_addr":"172.21.15.18:6803/1873893604","heartbeat_back_addr":"172.21.15.18:6807/1873893604","heartbeat_front_addr":"172.21.15.18:6805/1873893604","state":["exists","up"]},{"osd":1,"uuid":"8c385491-abcc-4edc-a6a9-7544ffb03391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6809","nonce":3186243316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6811","nonce":3186243316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6815","nonce":3186243316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":3186243316},{"type":"v1","addr":"172.21.15.18:6813","nonce":3186243316}]},"public_addr":"172.21.15.18:6809/3186243316","cluster_addr":"172.21.15.18:6811/3186243316","heartbeat_back_addr":"172.21.15.18:6815/3186243316","heartbeat_front_addr":"172.21.15.18:6813/3186243316","state":["exists","up"]},{"osd":2,"uuid":"0294f8c7-ffd3-4adc-b038-1d90f3a1277b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6820","nonce":676299974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6825","nonce":676299974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6831","nonce":676299974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":676299974},{"type":"v1","addr":"172.21.15.18:6829","nonce":676299974}]},"public_addr":"172.21.15.18:6820/676299974","cluster_addr":"172.21.15.18:6825/676299974","heartbeat_back_addr":"172.21.15.18:6831/676299974","heartbeat_front_addr":"172.21.15.18:6829/676299974","state":["exists","up"]},{"osd":3,"uuid":"02e5bf7b-dee6-4f4b-ae7a-25bb4d0a7664","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6817","nonce":3842375988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6821","nonce":3842375988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6828","nonce":3842375988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3842375988},{"type":"v1","addr":"172.21.15.18:6824","nonce":3842375988}]},"public_addr":"172.21.15.18:6817/3842375988","cluster_addr":"172.21.15.18:6821/3842375988","heartbeat_back_addr":"172.21.15.18:6828/3842375988","heartbeat_front_addr":"172.21.15.18:6824/3842375988","state":["exists","up"]},{"osd":4,"uuid":"ada1aedb-b705-438f-89cd-a123f1d2bc42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6801","nonce":2322864303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6803","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6804","nonce":2322864303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6810","nonce":2322864303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2322864303},{"type":"v1","addr":"172.21.15.81:6807","nonce":2322864303}]},"public_addr":"172.21.15.81:6801/2322864303","cluster_addr":"172.21.15.81:6804/2322864303","heartbeat_back_addr":"172.21.15.81:6810/2322864303","heartbeat_front_addr":"172.21.15.81:6807/2322864303","state":["exists","up"]},{"osd":5,"uuid":"0a5dbc2b-4d6d-4b4a-b18b-7c4e015f313f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6805","nonce":1268428013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6811","nonce":1268428013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6815","nonce":1268428013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1268428013},{"type":"v1","addr":"172.21.15.81:6813","nonce":1268428013}]},"public_addr":"172.21.15.81:6805/1268428013","cluster_addr":"172.21.15.81:6811/1268428013","heartbeat_back_addr":"172.21.15.81:6815/1268428013","heartbeat_front_addr":"172.21.15.81:6813/1268428013","state":["exists","up"]},{"osd":6,"uuid":"56bd42d6-a4fd-42c8-b24d-53c67224faab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6819","nonce":2275675681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6824","nonce":2275675681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6831","nonce":2275675681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2275675681},{"type":"v1","addr":"172.21.15.81:6828","nonce":2275675681}]},"public_addr":"172.21.15.81:6819/2275675681","cluster_addr":"172.21.15.81:6824/2275675681","heartbeat_back_addr":"172.21.15.81:6831/2275675681","heartbeat_front_addr":"172.21.15.81:6828/2275675681","state":["exists","up"]},{"osd":7,"uuid":"7f18ccf2-58b3-4f48-9858-5216768ac1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6818","nonce":2314094884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6822","nonce":2314094884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6829","nonce":2314094884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":2314094884},{"type":"v1","addr":"172.21.15.81:6825","nonce":2314094884}]},"public_addr":"172.21.15.81:6818/2314094884","cluster_addr":"172.21.15.81:6822/2314094884","heartbeat_back_addr":"172.21.15.81:6829/2314094884","heartbeat_front_addr":"172.21.15.81:6825/2314094884","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.109217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.910306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.118932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:55.113179+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.806917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.366311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.930407+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:37:54.643456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:39:44.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f05880662b0 msgr2=0x7f0588068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f05880662b0 0x7f0588068760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0598005890 tx=0x7f0598009040 comp rx=0 tx=0).stop 2023-06-09T04:39:44.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 msgr2=0x7f05a8157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.655 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 0x7f05a8157020 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f05a001a1c0 tx=0x7f05a0019330 comp rx=0 tx=0).stop 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 shutdown_connections 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05a815a3e0 0x7f05a8157020 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05a8159320 0x7f05a8156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f05880662b0 0x7f0588068760 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 --2- 172.21.15.18:0/4083560538 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f05a80700a0 0x7f05a8148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 >> 172.21.15.18:0/4083560538 conn(0x7f05a80b0240 msgr2=0x7f05a80692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.656 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 shutdown_connections 2023-06-09T04:39:44.657 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.654+0000 7f05acfdc640 1 -- 172.21.15.18:0/4083560538 wait complete. 2023-06-09T04:39:44.672 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:39:44.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:44.791 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 Processor -- start 2023-06-09T04:39:44.791 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 -- start start 2023-06-09T04:39:44.792 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcfd015a3e0 0x7fcfd006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.792 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.792 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd015cf10 con 0x7fcfd0159320 2023-06-09T04:39:44.793 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd0070520 con 0x7fcfd015a3e0 2023-06-09T04:39:44.793 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd7691640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd015dd90 con 0x7fcfd00700a0 2023-06-09T04:39:44.793 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd006bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.18:42936/0 (socket says 172.21.15.18:42936) 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 -- 172.21.15.18:0/1179953533 learned_addr learned my addr 172.21.15.18:0/1179953533 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd4c2c640 1 --2- 172.21.15.18:0/1179953533 >> v2:172.21.15.81:3300/0 conn(0x7fcfd015a3e0 0x7fcfd006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 -- 172.21.15.18:0/1179953533 >> v2:172.21.15.81:3300/0 conn(0x7fcfd015a3e0 msgr2=0x7fcfd006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 --2- 172.21.15.18:0/1179953533 >> v2:172.21.15.81:3300/0 conn(0x7fcfd015a3e0 0x7fcfd006fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 -- 172.21.15.18:0/1179953533 >> v1:172.21.15.81:6789/0 conn(0x7fcfd0159320 legacy=0x7fcfd015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.794 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.790+0000 7fcfd5c2e640 1 -- 172.21.15.18:0/1179953533 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00c81b0 con 0x7fcfd00700a0 2023-06-09T04:39:44.795 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd5c2e640 1 --2- 172.21.15.18:0/1179953533 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd006bcb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009870 tx=0x7fcfc801c1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37079d0ecdcf542 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.796 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfc7fff640 1 -- 172.21.15.18:0/1179953533 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80ab600 con 0x7fcfd00700a0 2023-06-09T04:39:44.796 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfc7fff640 1 -- 172.21.15.18:0/1179953533 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80a7050 con 0x7fcfd00700a0 2023-06-09T04:39:44.796 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfc7fff640 1 -- 172.21.15.18:0/1179953533 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80ab980 con 0x7fcfd00700a0 2023-06-09T04:39:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- 172.21.15.18:0/1179953533 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 msgr2=0x7fcfd006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1179953533 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd006bcb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009870 tx=0x7fcfc801c1c0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- 172.21.15.18:0/1179953533 shutdown_connections 2023-06-09T04:39:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1179953533 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd006bcb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1179953533 >> v2:172.21.15.81:3300/0 conn(0x7fcfd015a3e0 0x7fcfd006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.797 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- 172.21.15.18:0/1179953533 >> 172.21.15.18:0/1179953533 conn(0x7fcfd00b0240 msgr2=0x7fcfd00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- 172.21.15.18:0/1179953533 shutdown_connections 2023-06-09T04:39:44.798 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- 172.21.15.18:0/1179953533 wait complete. 2023-06-09T04:39:44.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 Processor -- start 2023-06-09T04:39:44.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- start start 2023-06-09T04:39:44.799 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd00c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 0x7fcfd014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015a3e0 0x7fcfd00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00ccb10 con 0x7fcfd0159320 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd014b780 con 0x7fcfd015a3e0 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd7691640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00cbc30 con 0x7fcfd00700a0 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd4c2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 0x7fcfd014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.800 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd4c2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 0x7fcfd014b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37508/0 (socket says 172.21.15.18:37508) 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd4c2c640 1 -- 172.21.15.18:0/1930927671 learned_addr learned my addr 172.21.15.18:0/1930927671 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd542d640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd00c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.794+0000 7fcfd5c2e640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015a3e0 0x7fcfd00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd4c2c640 1 -- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 msgr2=0x7fcfd00c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd4c2c640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd00c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd4c2c640 1 -- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015a3e0 msgr2=0x7fcfd00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.801 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd4c2c640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015a3e0 0x7fcfd00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd4c2c640 1 -- 172.21.15.18:0/1930927671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc80094d0 con 0x7fcfd0159320 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd542d640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd00c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd5c2e640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015a3e0 0x7fcfd00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd4c2c640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 0x7fcfd014b240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000e8a0 tx=0x7fcfc000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0009510 con 0x7fcfd0159320 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc000c940 con 0x7fcfd0159320 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000ccb0 con 0x7fcfd0159320 2023-06-09T04:39:44.802 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd00cbf00 con 0x7fcfd0159320 2023-06-09T04:39:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd00cc4c0 con 0x7fcfd0159320 2023-06-09T04:39:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd00cccc0 con 0x7fcfd0159320 2023-06-09T04:39:44.803 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfc0013470 con 0x7fcfd0159320 2023-06-09T04:39:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfc5ffb640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb40662b0 0x7fcfb4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcfc00842d0 con 0x7fcfd0159320 2023-06-09T04:39:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd542d640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb40662b0 0x7fcfb4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:44.804 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.798+0000 7fcfd542d640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb40662b0 0x7fcfb4068760 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc001e10 tx=0x7fcfcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:44.805 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.802+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfd00cccc0 con 0x7fcfd0159320 2023-06-09T04:39:44.959 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.958+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfd01596f0 con 0x7fcfb40662b0 2023-06-09T04:39:44.985 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.982+0000 7fcfc5ffb640 1 -- 172.21.15.18:0/1930927671 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304351 (secure 0 0 0) 0x7fcfcc001b00 con 0x7fcfb40662b0 2023-06-09T04:39:44.988 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:44.989 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:39:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb40662b0 msgr2=0x7fcfb4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb40662b0 0x7fcfb4068760 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc001e10 tx=0x7fcfcc009040 comp rx=0 tx=0).stop 2023-06-09T04:39:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 msgr2=0x7fcfd014b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:44.990 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 0x7fcfd014b240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000e8a0 tx=0x7fcfc000eca0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 shutdown_connections 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015a3e0 0x7fcfd00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcfd0159320 0x7fcfd014b240 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fcfb40662b0 0x7fcfb4068760 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 --2- 172.21.15.18:0/1930927671 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcfd00700a0 0x7fcfd00c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 >> 172.21.15.18:0/1930927671 conn(0x7fcfd00b0240 msgr2=0x7fcfd01598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 shutdown_connections 2023-06-09T04:39:44.992 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:44.986+0000 7fcfd7691640 1 -- 172.21.15.18:0/1930927671 wait complete. 2023-06-09T04:39:45.008 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-06-09T04:39:43.730626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592660,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236668,"kb_used_data":4668,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738052,"statfs":{"total":773094113280,"available":772851765248,"internally_reserved":0,"allocated":4780032,"data_stored":2727530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2292,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.167189"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414414+0000","last_change":"2023-06-09T04:39:41.000808+0000","last_active":"2023-06-09T04:39:42.414414+0000","last_peered":"2023-06-09T04:39:42.414414+0000","last_clean":"2023-06-09T04:39:42.414414+0000","last_became_active":"2023-06-09T04:39:41.000151+0000","last_became_peered":"2023-06-09T04:39:41.000151+0000","last_unstale":"2023-06-09T04:39:42.414414+0000","last_undegraded":"2023-06-09T04:39:42.414414+0000","last_fullsized":"2023-06-09T04:39:42.414414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:03.688391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982739+0000","last_change":"2023-06-09T04:39:40.996083+0000","last_active":"2023-06-09T04:39:41.982739+0000","last_peered":"2023-06-09T04:39:41.982739+0000","last_clean":"2023-06-09T04:39:41.982739+0000","last_became_active":"2023-06-09T04:39:40.994844+0000","last_became_peered":"2023-06-09T04:39:40.994844+0000","last_unstale":"2023-06-09T04:39:41.982739+0000","last_undegraded":"2023-06-09T04:39:41.982739+0000","last_fullsized":"2023-06-09T04:39:41.982739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:54.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413116+0000","last_change":"2023-06-09T04:39:41.005206+0000","last_active":"2023-06-09T04:39:42.413116+0000","last_peered":"2023-06-09T04:39:42.413116+0000","last_clean":"2023-06-09T04:39:42.413116+0000","last_became_active":"2023-06-09T04:39:41.004921+0000","last_became_peered":"2023-06-09T04:39:41.004921+0000","last_unstale":"2023-06-09T04:39:42.413116+0000","last_undegraded":"2023-06-09T04:39:42.413116+0000","last_fullsized":"2023-06-09T04:39:42.413116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980646+0000","last_change":"2023-06-09T04:39:40.995430+0000","last_active":"2023-06-09T04:39:41.980646+0000","last_peered":"2023-06-09T04:39:41.980646+0000","last_clean":"2023-06-09T04:39:41.980646+0000","last_became_active":"2023-06-09T04:39:40.995059+0000","last_became_peered":"2023-06-09T04:39:40.995059+0000","last_unstale":"2023-06-09T04:39:41.980646+0000","last_undegraded":"2023-06-09T04:39:41.980646+0000","last_fullsized":"2023-06-09T04:39:41.980646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:39.356017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413660+0000","last_change":"2023-06-09T04:39:41.011301+0000","last_active":"2023-06-09T04:39:42.413660+0000","last_peered":"2023-06-09T04:39:42.413660+0000","last_clean":"2023-06-09T04:39:42.413660+0000","last_became_active":"2023-06-09T04:39:41.011025+0000","last_became_peered":"2023-06-09T04:39:41.011025+0000","last_unstale":"2023-06-09T04:39:42.413660+0000","last_undegraded":"2023-06-09T04:39:42.413660+0000","last_fullsized":"2023-06-09T04:39:42.413660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981795+0000","last_change":"2023-06-09T04:39:40.980070+0000","last_active":"2023-06-09T04:39:41.981795+0000","last_peered":"2023-06-09T04:39:41.981795+0000","last_clean":"2023-06-09T04:39:41.981795+0000","last_became_active":"2023-06-09T04:39:40.979811+0000","last_became_peered":"2023-06-09T04:39:40.979811+0000","last_unstale":"2023-06-09T04:39:41.981795+0000","last_undegraded":"2023-06-09T04:39:41.981795+0000","last_fullsized":"2023-06-09T04:39:41.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:47.531527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983149+0000","last_change":"2023-06-09T04:39:41.006586+0000","last_active":"2023-06-09T04:39:41.983149+0000","last_peered":"2023-06-09T04:39:41.983149+0000","last_clean":"2023-06-09T04:39:41.983149+0000","last_became_active":"2023-06-09T04:39:41.006246+0000","last_became_peered":"2023-06-09T04:39:41.006246+0000","last_unstale":"2023-06-09T04:39:41.983149+0000","last_undegraded":"2023-06-09T04:39:41.983149+0000","last_fullsized":"2023-06-09T04:39:41.983149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:19.064520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414413+0000","last_change":"2023-06-09T04:39:40.993770+0000","last_active":"2023-06-09T04:39:42.414413+0000","last_peered":"2023-06-09T04:39:42.414413+0000","last_clean":"2023-06-09T04:39:42.414413+0000","last_became_active":"2023-06-09T04:39:40.993487+0000","last_became_peered":"2023-06-09T04:39:40.993487+0000","last_unstale":"2023-06-09T04:39:42.414413+0000","last_undegraded":"2023-06-09T04:39:42.414413+0000","last_fullsized":"2023-06-09T04:39:42.414413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:45.679085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413299+0000","last_change":"2023-06-09T04:39:41.005318+0000","last_active":"2023-06-09T04:39:42.413299+0000","last_peered":"2023-06-09T04:39:42.413299+0000","last_clean":"2023-06-09T04:39:42.413299+0000","last_became_active":"2023-06-09T04:39:41.004392+0000","last_became_peered":"2023-06-09T04:39:41.004392+0000","last_unstale":"2023-06-09T04:39:42.413299+0000","last_undegraded":"2023-06-09T04:39:42.413299+0000","last_fullsized":"2023-06-09T04:39:42.413299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982357+0000","last_change":"2023-06-09T04:39:40.995521+0000","last_active":"2023-06-09T04:39:41.982357+0000","last_peered":"2023-06-09T04:39:41.982357+0000","last_clean":"2023-06-09T04:39:41.982357+0000","last_became_active":"2023-06-09T04:39:40.994259+0000","last_became_peered":"2023-06-09T04:39:40.994259+0000","last_unstale":"2023-06-09T04:39:41.982357+0000","last_undegraded":"2023-06-09T04:39:41.982357+0000","last_fullsized":"2023-06-09T04:39:41.982357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:24.765697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981150+0000","last_change":"2023-06-09T04:39:40.996969+0000","last_active":"2023-06-09T04:39:41.981150+0000","last_peered":"2023-06-09T04:39:41.981150+0000","last_clean":"2023-06-09T04:39:41.981150+0000","last_became_active":"2023-06-09T04:39:40.995463+0000","last_became_peered":"2023-06-09T04:39:40.995463+0000","last_unstale":"2023-06-09T04:39:41.981150+0000","last_undegraded":"2023-06-09T04:39:41.981150+0000","last_fullsized":"2023-06-09T04:39:41.981150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:43.962204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415559+0000","last_change":"2023-06-09T04:39:40.993899+0000","last_active":"2023-06-09T04:39:42.415559+0000","last_peered":"2023-06-09T04:39:42.415559+0000","last_clean":"2023-06-09T04:39:42.415559+0000","last_became_active":"2023-06-09T04:39:40.993231+0000","last_became_peered":"2023-06-09T04:39:40.993231+0000","last_unstale":"2023-06-09T04:39:42.415559+0000","last_undegraded":"2023-06-09T04:39:42.415559+0000","last_fullsized":"2023-06-09T04:39:42.415559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:24:21.785637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981630+0000","last_change":"2023-06-09T04:39:40.998525+0000","last_active":"2023-06-09T04:39:41.981630+0000","last_peered":"2023-06-09T04:39:41.981630+0000","last_clean":"2023-06-09T04:39:41.981630+0000","last_became_active":"2023-06-09T04:39:40.993470+0000","last_became_peered":"2023-06-09T04:39:40.993470+0000","last_unstale":"2023-06-09T04:39:41.981630+0000","last_undegraded":"2023-06-09T04:39:41.981630+0000","last_fullsized":"2023-06-09T04:39:41.981630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:13.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982518+0000","last_change":"2023-06-09T04:39:40.990578+0000","last_active":"2023-06-09T04:39:41.982518+0000","last_peered":"2023-06-09T04:39:41.982518+0000","last_clean":"2023-06-09T04:39:41.982518+0000","last_became_active":"2023-06-09T04:39:40.989892+0000","last_became_peered":"2023-06-09T04:39:40.989892+0000","last_unstale":"2023-06-09T04:39:41.982518+0000","last_undegraded":"2023-06-09T04:39:41.982518+0000","last_fullsized":"2023-06-09T04:39:41.982518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:10:14.667327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414285+0000","last_change":"2023-06-09T04:39:40.998900+0000","last_active":"2023-06-09T04:39:42.414285+0000","last_peered":"2023-06-09T04:39:42.414285+0000","last_clean":"2023-06-09T04:39:42.414285+0000","last_became_active":"2023-06-09T04:39:40.998565+0000","last_became_peered":"2023-06-09T04:39:40.998565+0000","last_unstale":"2023-06-09T04:39:42.414285+0000","last_undegraded":"2023-06-09T04:39:42.414285+0000","last_fullsized":"2023-06-09T04:39:42.414285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:52.438310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412920+0000","last_change":"2023-06-09T04:39:41.008177+0000","last_active":"2023-06-09T04:39:42.412920+0000","last_peered":"2023-06-09T04:39:42.412920+0000","last_clean":"2023-06-09T04:39:42.412920+0000","last_became_active":"2023-06-09T04:39:41.007885+0000","last_became_peered":"2023-06-09T04:39:41.007885+0000","last_unstale":"2023-06-09T04:39:42.412920+0000","last_undegraded":"2023-06-09T04:39:42.412920+0000","last_fullsized":"2023-06-09T04:39:42.412920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983030+0000","last_change":"2023-06-09T04:39:41.007262+0000","last_active":"2023-06-09T04:39:41.983030+0000","last_peered":"2023-06-09T04:39:41.983030+0000","last_clean":"2023-06-09T04:39:41.983030+0000","last_became_active":"2023-06-09T04:39:41.006952+0000","last_became_peered":"2023-06-09T04:39:41.006952+0000","last_unstale":"2023-06-09T04:39:41.983030+0000","last_undegraded":"2023-06-09T04:39:41.983030+0000","last_fullsized":"2023-06-09T04:39:41.983030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:25.708053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413909+0000","last_change":"2023-06-09T04:39:40.989865+0000","last_active":"2023-06-09T04:39:42.413909+0000","last_peered":"2023-06-09T04:39:42.413909+0000","last_clean":"2023-06-09T04:39:42.413909+0000","last_became_active":"2023-06-09T04:39:40.989566+0000","last_became_peered":"2023-06-09T04:39:40.989566+0000","last_unstale":"2023-06-09T04:39:42.413909+0000","last_undegraded":"2023-06-09T04:39:42.413909+0000","last_fullsized":"2023-06-09T04:39:42.413909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412752+0000","last_change":"2023-06-09T04:39:41.006607+0000","last_active":"2023-06-09T04:39:42.412752+0000","last_peered":"2023-06-09T04:39:42.412752+0000","last_clean":"2023-06-09T04:39:42.412752+0000","last_became_active":"2023-06-09T04:39:41.006216+0000","last_became_peered":"2023-06-09T04:39:41.006216+0000","last_unstale":"2023-06-09T04:39:42.412752+0000","last_undegraded":"2023-06-09T04:39:42.412752+0000","last_fullsized":"2023-06-09T04:39:42.412752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:57.228151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980740+0000","last_change":"2023-06-09T04:39:40.992032+0000","last_active":"2023-06-09T04:39:41.980740+0000","last_peered":"2023-06-09T04:39:41.980740+0000","last_clean":"2023-06-09T04:39:41.980740+0000","last_became_active":"2023-06-09T04:39:40.990837+0000","last_became_peered":"2023-06-09T04:39:40.990837+0000","last_unstale":"2023-06-09T04:39:41.980740+0000","last_undegraded":"2023-06-09T04:39:41.980740+0000","last_fullsized":"2023-06-09T04:39:41.980740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:42.638120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414847+0000","last_change":"2023-06-09T04:39:41.009866+0000","last_active":"2023-06-09T04:39:42.414847+0000","last_peered":"2023-06-09T04:39:42.414847+0000","last_clean":"2023-06-09T04:39:42.414847+0000","last_became_active":"2023-06-09T04:39:41.009511+0000","last_became_peered":"2023-06-09T04:39:41.009511+0000","last_unstale":"2023-06-09T04:39:42.414847+0000","last_undegraded":"2023-06-09T04:39:42.414847+0000","last_fullsized":"2023-06-09T04:39:42.414847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:20.985140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413964+0000","last_change":"2023-06-09T04:39:40.604498+0000","last_active":"2023-06-09T04:39:42.413964+0000","last_peered":"2023-06-09T04:39:42.413964+0000","last_clean":"2023-06-09T04:39:42.413964+0000","last_became_active":"2023-06-09T04:39:40.603788+0000","last_became_peered":"2023-06-09T04:39:40.603788+0000","last_unstale":"2023-06-09T04:39:42.413964+0000","last_undegraded":"2023-06-09T04:39:42.413964+0000","last_fullsized":"2023-06-09T04:39:42.413964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:44.667395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414524+0000","last_change":"2023-06-09T04:39:41.011596+0000","last_active":"2023-06-09T04:39:42.414524+0000","last_peered":"2023-06-09T04:39:42.414524+0000","last_clean":"2023-06-09T04:39:42.414524+0000","last_became_active":"2023-06-09T04:39:41.011240+0000","last_became_peered":"2023-06-09T04:39:41.011240+0000","last_unstale":"2023-06-09T04:39:42.414524+0000","last_undegraded":"2023-06-09T04:39:42.414524+0000","last_fullsized":"2023-06-09T04:39:42.414524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:28:32.741830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413559+0000","last_change":"2023-06-09T04:39:40.619765+0000","last_active":"2023-06-09T04:39:42.413559+0000","last_peered":"2023-06-09T04:39:42.413559+0000","last_clean":"2023-06-09T04:39:42.413559+0000","last_became_active":"2023-06-09T04:39:40.618833+0000","last_became_peered":"2023-06-09T04:39:40.618833+0000","last_unstale":"2023-06-09T04:39:42.413559+0000","last_undegraded":"2023-06-09T04:39:42.413559+0000","last_fullsized":"2023-06-09T04:39:42.413559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983209+0000","last_change":"2023-06-09T04:39:40.994023+0000","last_active":"2023-06-09T04:39:41.983209+0000","last_peered":"2023-06-09T04:39:41.983209+0000","last_clean":"2023-06-09T04:39:41.983209+0000","last_became_active":"2023-06-09T04:39:40.993695+0000","last_became_peered":"2023-06-09T04:39:40.993695+0000","last_unstale":"2023-06-09T04:39:41.983209+0000","last_undegraded":"2023-06-09T04:39:41.983209+0000","last_fullsized":"2023-06-09T04:39:41.983209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:25.004879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413633+0000","last_change":"2023-06-09T04:39:40.607221+0000","last_active":"2023-06-09T04:39:42.413633+0000","last_peered":"2023-06-09T04:39:42.413633+0000","last_clean":"2023-06-09T04:39:42.413633+0000","last_became_active":"2023-06-09T04:39:40.606560+0000","last_became_peered":"2023-06-09T04:39:40.606560+0000","last_unstale":"2023-06-09T04:39:42.413633+0000","last_undegraded":"2023-06-09T04:39:42.413633+0000","last_fullsized":"2023-06-09T04:39:42.413633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:32.670818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981235+0000","last_change":"2023-06-09T04:39:41.000847+0000","last_active":"2023-06-09T04:39:41.981235+0000","last_peered":"2023-06-09T04:39:41.981235+0000","last_clean":"2023-06-09T04:39:41.981235+0000","last_became_active":"2023-06-09T04:39:41.000365+0000","last_became_peered":"2023-06-09T04:39:41.000365+0000","last_unstale":"2023-06-09T04:39:41.981235+0000","last_undegraded":"2023-06-09T04:39:41.981235+0000","last_fullsized":"2023-06-09T04:39:41.981235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:20:10.726424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980180+0000","last_change":"2023-06-09T04:39:40.982117+0000","last_active":"2023-06-09T04:39:41.980180+0000","last_peered":"2023-06-09T04:39:41.980180+0000","last_clean":"2023-06-09T04:39:41.980180+0000","last_became_active":"2023-06-09T04:39:40.981343+0000","last_became_peered":"2023-06-09T04:39:40.981343+0000","last_unstale":"2023-06-09T04:39:41.980180+0000","last_undegraded":"2023-06-09T04:39:41.980180+0000","last_fullsized":"2023-06-09T04:39:41.980180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:39.601908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980296+0000","last_change":"2023-06-09T04:39:40.624170+0000","last_active":"2023-06-09T04:39:41.980296+0000","last_peered":"2023-06-09T04:39:41.980296+0000","last_clean":"2023-06-09T04:39:41.980296+0000","last_became_active":"2023-06-09T04:39:40.623502+0000","last_became_peered":"2023-06-09T04:39:40.623502+0000","last_unstale":"2023-06-09T04:39:41.980296+0000","last_undegraded":"2023-06-09T04:39:41.980296+0000","last_fullsized":"2023-06-09T04:39:41.980296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:37.253525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981882+0000","last_change":"2023-06-09T04:39:40.597631+0000","last_active":"2023-06-09T04:39:41.981882+0000","last_peered":"2023-06-09T04:39:41.981882+0000","last_clean":"2023-06-09T04:39:41.981882+0000","last_became_active":"2023-06-09T04:39:40.596933+0000","last_became_peered":"2023-06-09T04:39:40.596933+0000","last_unstale":"2023-06-09T04:39:41.981882+0000","last_undegraded":"2023-06-09T04:39:41.981882+0000","last_fullsized":"2023-06-09T04:39:41.981882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:09:34.655136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982771+0000","last_change":"2023-06-09T04:39:41.000161+0000","last_active":"2023-06-09T04:39:41.982771+0000","last_peered":"2023-06-09T04:39:41.982771+0000","last_clean":"2023-06-09T04:39:41.982771+0000","last_became_active":"2023-06-09T04:39:40.999789+0000","last_became_peered":"2023-06-09T04:39:40.999789+0000","last_unstale":"2023-06-09T04:39:41.982771+0000","last_undegraded":"2023-06-09T04:39:41.982771+0000","last_fullsized":"2023-06-09T04:39:41.982771+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414775+0000","last_change":"2023-06-09T04:39:40.619981+0000","last_active":"2023-06-09T04:39:42.414775+0000","last_peered":"2023-06-09T04:39:42.414775+0000","last_clean":"2023-06-09T04:39:42.414775+0000","last_became_active":"2023-06-09T04:39:40.619566+0000","last_became_peered":"2023-06-09T04:39:40.619566+0000","last_unstale":"2023-06-09T04:39:42.414775+0000","last_undegraded":"2023-06-09T04:39:42.414775+0000","last_fullsized":"2023-06-09T04:39:42.414775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:23:23.487006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982023+0000","last_change":"2023-06-09T04:39:40.611518+0000","last_active":"2023-06-09T04:39:41.982023+0000","last_peered":"2023-06-09T04:39:41.982023+0000","last_clean":"2023-06-09T04:39:41.982023+0000","last_became_active":"2023-06-09T04:39:40.610734+0000","last_became_peered":"2023-06-09T04:39:40.610734+0000","last_unstale":"2023-06-09T04:39:41.982023+0000","last_undegraded":"2023-06-09T04:39:41.982023+0000","last_fullsized":"2023-06-09T04:39:41.982023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:30:44.123651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414946+0000","last_change":"2023-06-09T04:39:40.612040+0000","last_active":"2023-06-09T04:39:42.414946+0000","last_peered":"2023-06-09T04:39:42.414946+0000","last_clean":"2023-06-09T04:39:42.414946+0000","last_became_active":"2023-06-09T04:39:40.611172+0000","last_became_peered":"2023-06-09T04:39:40.611172+0000","last_unstale":"2023-06-09T04:39:42.414946+0000","last_undegraded":"2023-06-09T04:39:42.414946+0000","last_fullsized":"2023-06-09T04:39:42.414946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:38.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414617+0000","last_change":"2023-06-09T04:39:40.995651+0000","last_active":"2023-06-09T04:39:42.414617+0000","last_peered":"2023-06-09T04:39:42.414617+0000","last_clean":"2023-06-09T04:39:42.414617+0000","last_became_active":"2023-06-09T04:39:40.994999+0000","last_became_peered":"2023-06-09T04:39:40.994999+0000","last_unstale":"2023-06-09T04:39:42.414617+0000","last_undegraded":"2023-06-09T04:39:42.414617+0000","last_fullsized":"2023-06-09T04:39:42.414617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:13:37.121110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414139+0000","last_change":"2023-06-09T04:39:41.012348+0000","last_active":"2023-06-09T04:39:42.414139+0000","last_peered":"2023-06-09T04:39:42.414139+0000","last_clean":"2023-06-09T04:39:42.414139+0000","last_became_active":"2023-06-09T04:39:41.011938+0000","last_became_peered":"2023-06-09T04:39:41.011938+0000","last_unstale":"2023-06-09T04:39:42.414139+0000","last_undegraded":"2023-06-09T04:39:42.414139+0000","last_fullsized":"2023-06-09T04:39:42.414139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:18:48.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412936+0000","last_change":"2023-06-09T04:39:40.607242+0000","last_active":"2023-06-09T04:39:42.412936+0000","last_peered":"2023-06-09T04:39:42.412936+0000","last_clean":"2023-06-09T04:39:42.412936+0000","last_became_active":"2023-06-09T04:39:40.606331+0000","last_became_peered":"2023-06-09T04:39:40.606331+0000","last_unstale":"2023-06-09T04:39:42.412936+0000","last_undegraded":"2023-06-09T04:39:42.412936+0000","last_fullsized":"2023-06-09T04:39:42.412936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412958+0000","last_change":"2023-06-09T04:39:40.993917+0000","last_active":"2023-06-09T04:39:42.412958+0000","last_peered":"2023-06-09T04:39:42.412958+0000","last_clean":"2023-06-09T04:39:42.412958+0000","last_became_active":"2023-06-09T04:39:40.993317+0000","last_became_peered":"2023-06-09T04:39:40.993317+0000","last_unstale":"2023-06-09T04:39:42.412958+0000","last_undegraded":"2023-06-09T04:39:42.412958+0000","last_fullsized":"2023-06-09T04:39:42.412958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:28.568155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980348+0000","last_change":"2023-06-09T04:39:40.594820+0000","last_active":"2023-06-09T04:39:41.980348+0000","last_peered":"2023-06-09T04:39:41.980348+0000","last_clean":"2023-06-09T04:39:41.980348+0000","last_became_active":"2023-06-09T04:39:40.594031+0000","last_became_peered":"2023-06-09T04:39:40.594031+0000","last_unstale":"2023-06-09T04:39:41.980348+0000","last_undegraded":"2023-06-09T04:39:41.980348+0000","last_fullsized":"2023-06-09T04:39:41.980348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:15.340144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415131+0000","last_change":"2023-06-09T04:39:40.998920+0000","last_active":"2023-06-09T04:39:42.415131+0000","last_peered":"2023-06-09T04:39:42.415131+0000","last_clean":"2023-06-09T04:39:42.415131+0000","last_became_active":"2023-06-09T04:39:40.998646+0000","last_became_peered":"2023-06-09T04:39:40.998646+0000","last_unstale":"2023-06-09T04:39:42.415131+0000","last_undegraded":"2023-06-09T04:39:42.415131+0000","last_fullsized":"2023-06-09T04:39:42.415131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:38.068463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983526+0000","last_change":"2023-06-09T04:39:40.625632+0000","last_active":"2023-06-09T04:39:41.983526+0000","last_peered":"2023-06-09T04:39:41.983526+0000","last_clean":"2023-06-09T04:39:41.983526+0000","last_became_active":"2023-06-09T04:39:40.625013+0000","last_became_peered":"2023-06-09T04:39:40.625013+0000","last_unstale":"2023-06-09T04:39:41.983526+0000","last_undegraded":"2023-06-09T04:39:41.983526+0000","last_fullsized":"2023-06-09T04:39:41.983526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:47:39.355242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414848+0000","last_change":"2023-06-09T04:39:41.010054+0000","last_active":"2023-06-09T04:39:42.414848+0000","last_peered":"2023-06-09T04:39:42.414848+0000","last_clean":"2023-06-09T04:39:42.414848+0000","last_became_active":"2023-06-09T04:39:41.009721+0000","last_became_peered":"2023-06-09T04:39:41.009721+0000","last_unstale":"2023-06-09T04:39:42.414848+0000","last_undegraded":"2023-06-09T04:39:42.414848+0000","last_fullsized":"2023-06-09T04:39:42.414848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:06.660210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414779+0000","last_change":"2023-06-09T04:39:40.997482+0000","last_active":"2023-06-09T04:39:42.414779+0000","last_peered":"2023-06-09T04:39:42.414779+0000","last_clean":"2023-06-09T04:39:42.414779+0000","last_became_active":"2023-06-09T04:39:40.996995+0000","last_became_peered":"2023-06-09T04:39:40.996995+0000","last_unstale":"2023-06-09T04:39:42.414779+0000","last_undegraded":"2023-06-09T04:39:42.414779+0000","last_fullsized":"2023-06-09T04:39:42.414779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:19.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413062+0000","last_change":"2023-06-09T04:39:40.608570+0000","last_active":"2023-06-09T04:39:42.413062+0000","last_peered":"2023-06-09T04:39:42.413062+0000","last_clean":"2023-06-09T04:39:42.413062+0000","last_became_active":"2023-06-09T04:39:40.607567+0000","last_became_peered":"2023-06-09T04:39:40.607567+0000","last_unstale":"2023-06-09T04:39:42.413062+0000","last_undegraded":"2023-06-09T04:39:42.413062+0000","last_fullsized":"2023-06-09T04:39:42.413062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980707+0000","last_change":"2023-06-09T04:39:41.005808+0000","last_active":"2023-06-09T04:39:41.980707+0000","last_peered":"2023-06-09T04:39:41.980707+0000","last_clean":"2023-06-09T04:39:41.980707+0000","last_became_active":"2023-06-09T04:39:41.005505+0000","last_became_peered":"2023-06-09T04:39:41.005505+0000","last_unstale":"2023-06-09T04:39:41.980707+0000","last_undegraded":"2023-06-09T04:39:41.980707+0000","last_fullsized":"2023-06-09T04:39:41.980707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:08.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982312+0000","last_change":"2023-06-09T04:39:40.602174+0000","last_active":"2023-06-09T04:39:41.982312+0000","last_peered":"2023-06-09T04:39:41.982312+0000","last_clean":"2023-06-09T04:39:41.982312+0000","last_became_active":"2023-06-09T04:39:40.601339+0000","last_became_peered":"2023-06-09T04:39:40.601339+0000","last_unstale":"2023-06-09T04:39:41.982312+0000","last_undegraded":"2023-06-09T04:39:41.982312+0000","last_fullsized":"2023-06-09T04:39:41.982312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:31:45.907935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413386+0000","last_change":"2023-06-09T04:39:41.006006+0000","last_active":"2023-06-09T04:39:42.413386+0000","last_peered":"2023-06-09T04:39:42.413386+0000","last_clean":"2023-06-09T04:39:42.413386+0000","last_became_active":"2023-06-09T04:39:41.005756+0000","last_became_peered":"2023-06-09T04:39:41.005756+0000","last_unstale":"2023-06-09T04:39:42.413386+0000","last_undegraded":"2023-06-09T04:39:42.413386+0000","last_fullsized":"2023-06-09T04:39:42.413386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980885+0000","last_change":"2023-06-09T04:39:40.993826+0000","last_active":"2023-06-09T04:39:41.980885+0000","last_peered":"2023-06-09T04:39:41.980885+0000","last_clean":"2023-06-09T04:39:41.980885+0000","last_became_active":"2023-06-09T04:39:40.992701+0000","last_became_peered":"2023-06-09T04:39:40.992701+0000","last_unstale":"2023-06-09T04:39:41.980885+0000","last_undegraded":"2023-06-09T04:39:41.980885+0000","last_fullsized":"2023-06-09T04:39:41.980885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:52.880775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980539+0000","last_change":"2023-06-09T04:39:40.601847+0000","last_active":"2023-06-09T04:39:41.980539+0000","last_peered":"2023-06-09T04:39:41.980539+0000","last_clean":"2023-06-09T04:39:41.980539+0000","last_became_active":"2023-06-09T04:39:40.601116+0000","last_became_peered":"2023-06-09T04:39:40.601116+0000","last_unstale":"2023-06-09T04:39:41.980539+0000","last_undegraded":"2023-06-09T04:39:41.980539+0000","last_fullsized":"2023-06-09T04:39:41.980539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:16:36.582040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981457+0000","last_change":"2023-06-09T04:39:40.996654+0000","last_active":"2023-06-09T04:39:41.981457+0000","last_peered":"2023-06-09T04:39:41.981457+0000","last_clean":"2023-06-09T04:39:41.981457+0000","last_became_active":"2023-06-09T04:39:40.995096+0000","last_became_peered":"2023-06-09T04:39:40.995096+0000","last_unstale":"2023-06-09T04:39:41.981457+0000","last_undegraded":"2023-06-09T04:39:41.981457+0000","last_fullsized":"2023-06-09T04:39:41.981457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:47.503555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981090+0000","last_change":"2023-06-09T04:39:41.005886+0000","last_active":"2023-06-09T04:39:41.981090+0000","last_peered":"2023-06-09T04:39:41.981090+0000","last_clean":"2023-06-09T04:39:41.981090+0000","last_became_active":"2023-06-09T04:39:41.005622+0000","last_became_peered":"2023-06-09T04:39:41.005622+0000","last_unstale":"2023-06-09T04:39:41.981090+0000","last_undegraded":"2023-06-09T04:39:41.981090+0000","last_fullsized":"2023-06-09T04:39:41.981090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:49.238912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815672+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:39:34.815672+0000","last_peered":"2023-06-09T04:39:34.815672+0000","last_clean":"2023-06-09T04:39:34.815672+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:39:34.815672+0000","last_undegraded":"2023-06-09T04:39:34.815672+0000","last_fullsized":"2023-06-09T04:39:34.815672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:18:52.556812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982535+0000","last_change":"2023-06-09T04:39:40.994885+0000","last_active":"2023-06-09T04:39:41.982535+0000","last_peered":"2023-06-09T04:39:41.982535+0000","last_clean":"2023-06-09T04:39:41.982535+0000","last_became_active":"2023-06-09T04:39:40.993574+0000","last_became_peered":"2023-06-09T04:39:40.993574+0000","last_unstale":"2023-06-09T04:39:41.982535+0000","last_undegraded":"2023-06-09T04:39:41.982535+0000","last_fullsized":"2023-06-09T04:39:41.982535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:39:50.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981930+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:39:41.981930+0000","last_peered":"2023-06-09T04:39:41.981930+0000","last_clean":"2023-06-09T04:39:41.981930+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:39:41.981930+0000","last_undegraded":"2023-06-09T04:39:41.981930+0000","last_fullsized":"2023-06-09T04:39:41.981930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414346+0000","last_change":"2023-06-09T04:39:40.614551+0000","last_active":"2023-06-09T04:39:42.414346+0000","last_peered":"2023-06-09T04:39:42.414346+0000","last_clean":"2023-06-09T04:39:42.414346+0000","last_became_active":"2023-06-09T04:39:40.613760+0000","last_became_peered":"2023-06-09T04:39:40.613760+0000","last_unstale":"2023-06-09T04:39:42.414346+0000","last_undegraded":"2023-06-09T04:39:42.414346+0000","last_fullsized":"2023-06-09T04:39:42.414346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:02.676701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815516+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:39:34.815516+0000","last_peered":"2023-06-09T04:39:34.815516+0000","last_clean":"2023-06-09T04:39:34.815516+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:39:34.815516+0000","last_undegraded":"2023-06-09T04:39:34.815516+0000","last_fullsized":"2023-06-09T04:39:34.815516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:30:12.337587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413319+0000","last_change":"2023-06-09T04:39:40.993661+0000","last_active":"2023-06-09T04:39:42.413319+0000","last_peered":"2023-06-09T04:39:42.413319+0000","last_clean":"2023-06-09T04:39:42.413319+0000","last_became_active":"2023-06-09T04:39:40.992879+0000","last_became_peered":"2023-06-09T04:39:40.992879+0000","last_unstale":"2023-06-09T04:39:42.413319+0000","last_undegraded":"2023-06-09T04:39:42.413319+0000","last_fullsized":"2023-06-09T04:39:42.413319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414078+0000","last_change":"2023-06-09T04:39:40.615594+0000","last_active":"2023-06-09T04:39:42.414078+0000","last_peered":"2023-06-09T04:39:42.414078+0000","last_clean":"2023-06-09T04:39:42.414078+0000","last_became_active":"2023-06-09T04:39:40.614956+0000","last_became_peered":"2023-06-09T04:39:40.614956+0000","last_unstale":"2023-06-09T04:39:42.414078+0000","last_undegraded":"2023-06-09T04:39:42.414078+0000","last_fullsized":"2023-06-09T04:39:42.414078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:16.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982818+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:39:41.982818+0000","last_peered":"2023-06-09T04:39:41.982818+0000","last_clean":"2023-06-09T04:39:41.982818+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:39:41.982818+0000","last_undegraded":"2023-06-09T04:39:41.982818+0000","last_fullsized":"2023-06-09T04:39:41.982818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:05.270452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983176+0000","last_change":"2023-06-09T04:39:40.623724+0000","last_active":"2023-06-09T04:39:41.983176+0000","last_peered":"2023-06-09T04:39:41.983176+0000","last_clean":"2023-06-09T04:39:41.983176+0000","last_became_active":"2023-06-09T04:39:40.622846+0000","last_became_peered":"2023-06-09T04:39:40.622846+0000","last_unstale":"2023-06-09T04:39:41.983176+0000","last_undegraded":"2023-06-09T04:39:41.983176+0000","last_fullsized":"2023-06-09T04:39:41.983176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:36.849855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815492+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:39:34.815492+0000","last_peered":"2023-06-09T04:39:34.815492+0000","last_clean":"2023-06-09T04:39:34.815492+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:39:34.815492+0000","last_undegraded":"2023-06-09T04:39:34.815492+0000","last_fullsized":"2023-06-09T04:39:34.815492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981962+0000","last_change":"2023-06-09T04:39:40.982461+0000","last_active":"2023-06-09T04:39:41.981962+0000","last_peered":"2023-06-09T04:39:41.981962+0000","last_clean":"2023-06-09T04:39:41.981962+0000","last_became_active":"2023-06-09T04:39:40.981948+0000","last_became_peered":"2023-06-09T04:39:40.981948+0000","last_unstale":"2023-06-09T04:39:41.981962+0000","last_undegraded":"2023-06-09T04:39:41.981962+0000","last_fullsized":"2023-06-09T04:39:41.981962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:38.078169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414000+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:39:42.414000+0000","last_peered":"2023-06-09T04:39:42.414000+0000","last_clean":"2023-06-09T04:39:42.414000+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:39:42.414000+0000","last_undegraded":"2023-06-09T04:39:42.414000+0000","last_fullsized":"2023-06-09T04:39:42.414000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:40.493562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414718+0000","last_change":"2023-06-09T04:39:40.612529+0000","last_active":"2023-06-09T04:39:42.414718+0000","last_peered":"2023-06-09T04:39:42.414718+0000","last_clean":"2023-06-09T04:39:42.414718+0000","last_became_active":"2023-06-09T04:39:40.611514+0000","last_became_peered":"2023-06-09T04:39:40.611514+0000","last_unstale":"2023-06-09T04:39:42.414718+0000","last_undegraded":"2023-06-09T04:39:42.414718+0000","last_fullsized":"2023-06-09T04:39:42.414718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:30:42.783826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815492+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:39:34.815492+0000","last_peered":"2023-06-09T04:39:34.815492+0000","last_clean":"2023-06-09T04:39:34.815492+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:39:34.815492+0000","last_undegraded":"2023-06-09T04:39:34.815492+0000","last_fullsized":"2023-06-09T04:39:34.815492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:10.553303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983194+0000","last_change":"2023-06-09T04:39:40.996130+0000","last_active":"2023-06-09T04:39:41.983194+0000","last_peered":"2023-06-09T04:39:41.983194+0000","last_clean":"2023-06-09T04:39:41.983194+0000","last_became_active":"2023-06-09T04:39:40.995502+0000","last_became_peered":"2023-06-09T04:39:40.995502+0000","last_unstale":"2023-06-09T04:39:41.983194+0000","last_undegraded":"2023-06-09T04:39:41.983194+0000","last_fullsized":"2023-06-09T04:39:41.983194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:03:25.543583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815521+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:39:34.815521+0000","last_peered":"2023-06-09T04:39:34.815521+0000","last_clean":"2023-06-09T04:39:34.815521+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:39:34.815521+0000","last_undegraded":"2023-06-09T04:39:34.815521+0000","last_fullsized":"2023-06-09T04:39:34.815521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:09.871441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815984+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:39:34.815984+0000","last_peered":"2023-06-09T04:39:34.815984+0000","last_clean":"2023-06-09T04:39:34.815984+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:39:34.815984+0000","last_undegraded":"2023-06-09T04:39:34.815984+0000","last_fullsized":"2023-06-09T04:39:34.815984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:32:57.689220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2292,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":36,"acting":36,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.83499999999999996}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.73699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":768618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.432},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.315}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.443},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.044},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":18.922999999999998,"5min":18.922999999999998,"15min":18.922999999999998},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.608000000000001,"5min":12.608000000000001,"15min":12.608000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.95499999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":199170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.077},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.046}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.755}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.014}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":206725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.621},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1470000000000002,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.0869999999999997,"5min":6.0869999999999997,"15min":6.0869999999999997},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.079},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.125}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.052},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":1.226}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":789526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.234},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.4219999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.044},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.347}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.202},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.117},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.494}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.375},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.458}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.1479999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":207765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.438},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.749}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.88700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":458752,"data_stored":199226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.63},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:45.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:45.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 Processor -- start 2023-06-09T04:39:45.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 -- start start 2023-06-09T04:39:45.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e080b7480 0x7f2e080b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e0806a3e0 0x7f2e080b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0815c950 con 0x7f2e080cc9b0 2023-06-09T04:39:45.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e080ce320 con 0x7f2e080b7480 2023-06-09T04:39:45.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0e72e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080cc4b0 con 0x7f2e0806a3e0 2023-06-09T04:39:45.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e07fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e080b7480 0x7f2e080b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2dff7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2e080cc9b0 0x7f2e080692b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33442/0 (socket says 172.21.15.18:33442) 2023-06-09T04:39:45.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2dff7fe640 1 -- 172.21.15.18:0/1955268955 learned_addr learned my addr 172.21.15.18:0/1955268955 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:45.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e07fff640 1 -- 172.21.15.18:0/1955268955 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e0806a3e0 msgr2=0x7f2e080b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:45.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0cccb640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e0806a3e0 0x7f2e080b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e077fe640 1 -- 172.21.15.18:0/1955268955 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496345836 0 0) 0x7f2e0815c950 con 0x7f2e080cc9b0 2023-06-09T04:39:45.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e07fff640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e0806a3e0 0x7f2e080b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e07fff640 1 -- 172.21.15.18:0/1955268955 >> v1:172.21.15.18:6789/0 conn(0x7f2e080cc9b0 legacy=0x7f2e080692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e07fff640 1 -- 172.21.15.18:0/1955268955 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080ce010 con 0x7f2e080b7480 2023-06-09T04:39:45.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e0cccb640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e0806a3e0 0x7f2e080b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:45.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e07fff640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e080b7480 0x7f2e080b38d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2df80097c0 tx=0x7f2df801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116e11c85ceea82 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e077fe640 1 -- 172.21.15.18:0/1955268955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80a6040 con 0x7f2e080b7480 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e077fe640 1 -- 172.21.15.18:0/1955268955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df80aa600 con 0x7f2e080b7480 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.178+0000 7f2e077fe640 1 -- 172.21.15.18:0/1955268955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80aa990 con 0x7f2e080b7480 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/1955268955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e080b7480 msgr2=0x7f2e080b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e080b7480 0x7f2e080b38d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2df80097c0 tx=0x7f2df801c480 comp rx=0 tx=0).stop 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/1955268955 shutdown_connections 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e0806a3e0 0x7f2e080b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.184 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/1955268955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e080b7480 0x7f2e080b38d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/1955268955 >> 172.21.15.18:0/1955268955 conn(0x7f2e080d2ae0 msgr2=0x7f2e080ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:45.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/1955268955 shutdown_connections 2023-06-09T04:39:45.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/1955268955 wait complete. 2023-06-09T04:39:45.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 Processor -- start 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- start start 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 0x7f2e080c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e080b7480 0x7f2e081f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e081f4180 0x7f2e08154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080ca230 con 0x7f2e0806a3e0 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e081f4620 con 0x7f2e080b7480 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080c9620 con 0x7f2e081f4180 2023-06-09T04:39:45.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 0x7f2e080c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 0x7f2e080c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37530/0 (socket says 172.21.15.18:37530) 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 -- 172.21.15.18:0/3025938434 learned_addr learned my addr 172.21.15.18:0/3025938434 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0cccb640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e081f4180 0x7f2e08154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 -- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e081f4180 msgr2=0x7f2e08154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2dff7fe640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e080b7480 0x7f2e081f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e081f4180 0x7f2e08154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 -- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e080b7480 msgr2=0x7f2e081f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e080b7480 0x7f2e081f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 -- 172.21.15.18:0/3025938434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8009420 con 0x7f2e0806a3e0 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0cccb640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e081f4180 0x7f2e08154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2dff7fe640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e080b7480 0x7f2e081f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e07fff640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 0x7f2e080c8f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2df801a0b0 tx=0x7f2df801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80aae60 con 0x7f2e0806a3e0 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df80b7070 con 0x7f2e0806a3e0 2023-06-09T04:39:45.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8004220 con 0x7f2e0806a3e0 2023-06-09T04:39:45.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e080c9900 con 0x7f2e0806a3e0 2023-06-09T04:39:45.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.182+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e080c9ec0 con 0x7f2e0806a3e0 2023-06-09T04:39:45.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.186+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e08155730 con 0x7f2e0806a3e0 2023-06-09T04:39:45.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.186+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2df8004380 con 0x7f2e0806a3e0 2023-06-09T04:39:45.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.186+0000 7f2e057fa640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dec066280 0x7f2dec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.186+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2df811e2f0 con 0x7f2e0806a3e0 2023-06-09T04:39:45.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.186+0000 7f2dff7fe640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dec066280 0x7f2dec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.186+0000 7f2dff7fe640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dec066280 0x7f2dec068730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2df0000f70 tx=0x7f2df0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.190+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2df80eb6c0 con 0x7f2e0806a3e0 2023-06-09T04:39:45.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.338+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e080b7850 con 0x7f2dec066280 2023-06-09T04:39:45.365 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.362+0000 7f2e057fa640 1 -- 172.21.15.18:0/3025938434 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304351 (secure 0 0 0) 0x7f2df0001c90 con 0x7f2dec066280 2023-06-09T04:39:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:39:45.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dec066280 msgr2=0x7f2dec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dec066280 0x7f2dec068730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2df0000f70 tx=0x7f2df0009040 comp rx=0 tx=0).stop 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 msgr2=0x7f2e080c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 0x7f2e080c8f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2df801a0b0 tx=0x7f2df801acc0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 shutdown_connections 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f2dec066280 0x7f2dec068730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2e081f4180 0x7f2e08154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e080b7480 0x7f2e081f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 --2- 172.21.15.18:0/3025938434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0806a3e0 0x7f2e080c8f40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 >> 172.21.15.18:0/3025938434 conn(0x7f2e080d2ae0 msgr2=0x7f2e080cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:45.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 shutdown_connections 2023-06-09T04:39:45.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.366+0000 7f2e0e72e640 1 -- 172.21.15.18:0/3025938434 wait complete. 2023-06-09T04:39:45.388 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-06-09T04:39:43.730626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592660,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236668,"kb_used_data":4668,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738052,"statfs":{"total":773094113280,"available":772851765248,"internally_reserved":0,"allocated":4780032,"data_stored":2727530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2292,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.167189"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414414+0000","last_change":"2023-06-09T04:39:41.000808+0000","last_active":"2023-06-09T04:39:42.414414+0000","last_peered":"2023-06-09T04:39:42.414414+0000","last_clean":"2023-06-09T04:39:42.414414+0000","last_became_active":"2023-06-09T04:39:41.000151+0000","last_became_peered":"2023-06-09T04:39:41.000151+0000","last_unstale":"2023-06-09T04:39:42.414414+0000","last_undegraded":"2023-06-09T04:39:42.414414+0000","last_fullsized":"2023-06-09T04:39:42.414414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:03.688391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982739+0000","last_change":"2023-06-09T04:39:40.996083+0000","last_active":"2023-06-09T04:39:41.982739+0000","last_peered":"2023-06-09T04:39:41.982739+0000","last_clean":"2023-06-09T04:39:41.982739+0000","last_became_active":"2023-06-09T04:39:40.994844+0000","last_became_peered":"2023-06-09T04:39:40.994844+0000","last_unstale":"2023-06-09T04:39:41.982739+0000","last_undegraded":"2023-06-09T04:39:41.982739+0000","last_fullsized":"2023-06-09T04:39:41.982739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:54.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413116+0000","last_change":"2023-06-09T04:39:41.005206+0000","last_active":"2023-06-09T04:39:42.413116+0000","last_peered":"2023-06-09T04:39:42.413116+0000","last_clean":"2023-06-09T04:39:42.413116+0000","last_became_active":"2023-06-09T04:39:41.004921+0000","last_became_peered":"2023-06-09T04:39:41.004921+0000","last_unstale":"2023-06-09T04:39:42.413116+0000","last_undegraded":"2023-06-09T04:39:42.413116+0000","last_fullsized":"2023-06-09T04:39:42.413116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980646+0000","last_change":"2023-06-09T04:39:40.995430+0000","last_active":"2023-06-09T04:39:41.980646+0000","last_peered":"2023-06-09T04:39:41.980646+0000","last_clean":"2023-06-09T04:39:41.980646+0000","last_became_active":"2023-06-09T04:39:40.995059+0000","last_became_peered":"2023-06-09T04:39:40.995059+0000","last_unstale":"2023-06-09T04:39:41.980646+0000","last_undegraded":"2023-06-09T04:39:41.980646+0000","last_fullsized":"2023-06-09T04:39:41.980646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:39.356017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413660+0000","last_change":"2023-06-09T04:39:41.011301+0000","last_active":"2023-06-09T04:39:42.413660+0000","last_peered":"2023-06-09T04:39:42.413660+0000","last_clean":"2023-06-09T04:39:42.413660+0000","last_became_active":"2023-06-09T04:39:41.011025+0000","last_became_peered":"2023-06-09T04:39:41.011025+0000","last_unstale":"2023-06-09T04:39:42.413660+0000","last_undegraded":"2023-06-09T04:39:42.413660+0000","last_fullsized":"2023-06-09T04:39:42.413660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981795+0000","last_change":"2023-06-09T04:39:40.980070+0000","last_active":"2023-06-09T04:39:41.981795+0000","last_peered":"2023-06-09T04:39:41.981795+0000","last_clean":"2023-06-09T04:39:41.981795+0000","last_became_active":"2023-06-09T04:39:40.979811+0000","last_became_peered":"2023-06-09T04:39:40.979811+0000","last_unstale":"2023-06-09T04:39:41.981795+0000","last_undegraded":"2023-06-09T04:39:41.981795+0000","last_fullsized":"2023-06-09T04:39:41.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:47.531527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983149+0000","last_change":"2023-06-09T04:39:41.006586+0000","last_active":"2023-06-09T04:39:41.983149+0000","last_peered":"2023-06-09T04:39:41.983149+0000","last_clean":"2023-06-09T04:39:41.983149+0000","last_became_active":"2023-06-09T04:39:41.006246+0000","last_became_peered":"2023-06-09T04:39:41.006246+0000","last_unstale":"2023-06-09T04:39:41.983149+0000","last_undegraded":"2023-06-09T04:39:41.983149+0000","last_fullsized":"2023-06-09T04:39:41.983149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:19.064520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414413+0000","last_change":"2023-06-09T04:39:40.993770+0000","last_active":"2023-06-09T04:39:42.414413+0000","last_peered":"2023-06-09T04:39:42.414413+0000","last_clean":"2023-06-09T04:39:42.414413+0000","last_became_active":"2023-06-09T04:39:40.993487+0000","last_became_peered":"2023-06-09T04:39:40.993487+0000","last_unstale":"2023-06-09T04:39:42.414413+0000","last_undegraded":"2023-06-09T04:39:42.414413+0000","last_fullsized":"2023-06-09T04:39:42.414413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:45.679085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413299+0000","last_change":"2023-06-09T04:39:41.005318+0000","last_active":"2023-06-09T04:39:42.413299+0000","last_peered":"2023-06-09T04:39:42.413299+0000","last_clean":"2023-06-09T04:39:42.413299+0000","last_became_active":"2023-06-09T04:39:41.004392+0000","last_became_peered":"2023-06-09T04:39:41.004392+0000","last_unstale":"2023-06-09T04:39:42.413299+0000","last_undegraded":"2023-06-09T04:39:42.413299+0000","last_fullsized":"2023-06-09T04:39:42.413299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982357+0000","last_change":"2023-06-09T04:39:40.995521+0000","last_active":"2023-06-09T04:39:41.982357+0000","last_peered":"2023-06-09T04:39:41.982357+0000","last_clean":"2023-06-09T04:39:41.982357+0000","last_became_active":"2023-06-09T04:39:40.994259+0000","last_became_peered":"2023-06-09T04:39:40.994259+0000","last_unstale":"2023-06-09T04:39:41.982357+0000","last_undegraded":"2023-06-09T04:39:41.982357+0000","last_fullsized":"2023-06-09T04:39:41.982357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:24.765697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981150+0000","last_change":"2023-06-09T04:39:40.996969+0000","last_active":"2023-06-09T04:39:41.981150+0000","last_peered":"2023-06-09T04:39:41.981150+0000","last_clean":"2023-06-09T04:39:41.981150+0000","last_became_active":"2023-06-09T04:39:40.995463+0000","last_became_peered":"2023-06-09T04:39:40.995463+0000","last_unstale":"2023-06-09T04:39:41.981150+0000","last_undegraded":"2023-06-09T04:39:41.981150+0000","last_fullsized":"2023-06-09T04:39:41.981150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:43.962204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415559+0000","last_change":"2023-06-09T04:39:40.993899+0000","last_active":"2023-06-09T04:39:42.415559+0000","last_peered":"2023-06-09T04:39:42.415559+0000","last_clean":"2023-06-09T04:39:42.415559+0000","last_became_active":"2023-06-09T04:39:40.993231+0000","last_became_peered":"2023-06-09T04:39:40.993231+0000","last_unstale":"2023-06-09T04:39:42.415559+0000","last_undegraded":"2023-06-09T04:39:42.415559+0000","last_fullsized":"2023-06-09T04:39:42.415559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:24:21.785637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981630+0000","last_change":"2023-06-09T04:39:40.998525+0000","last_active":"2023-06-09T04:39:41.981630+0000","last_peered":"2023-06-09T04:39:41.981630+0000","last_clean":"2023-06-09T04:39:41.981630+0000","last_became_active":"2023-06-09T04:39:40.993470+0000","last_became_peered":"2023-06-09T04:39:40.993470+0000","last_unstale":"2023-06-09T04:39:41.981630+0000","last_undegraded":"2023-06-09T04:39:41.981630+0000","last_fullsized":"2023-06-09T04:39:41.981630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:13.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982518+0000","last_change":"2023-06-09T04:39:40.990578+0000","last_active":"2023-06-09T04:39:41.982518+0000","last_peered":"2023-06-09T04:39:41.982518+0000","last_clean":"2023-06-09T04:39:41.982518+0000","last_became_active":"2023-06-09T04:39:40.989892+0000","last_became_peered":"2023-06-09T04:39:40.989892+0000","last_unstale":"2023-06-09T04:39:41.982518+0000","last_undegraded":"2023-06-09T04:39:41.982518+0000","last_fullsized":"2023-06-09T04:39:41.982518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:10:14.667327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414285+0000","last_change":"2023-06-09T04:39:40.998900+0000","last_active":"2023-06-09T04:39:42.414285+0000","last_peered":"2023-06-09T04:39:42.414285+0000","last_clean":"2023-06-09T04:39:42.414285+0000","last_became_active":"2023-06-09T04:39:40.998565+0000","last_became_peered":"2023-06-09T04:39:40.998565+0000","last_unstale":"2023-06-09T04:39:42.414285+0000","last_undegraded":"2023-06-09T04:39:42.414285+0000","last_fullsized":"2023-06-09T04:39:42.414285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:52.438310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412920+0000","last_change":"2023-06-09T04:39:41.008177+0000","last_active":"2023-06-09T04:39:42.412920+0000","last_peered":"2023-06-09T04:39:42.412920+0000","last_clean":"2023-06-09T04:39:42.412920+0000","last_became_active":"2023-06-09T04:39:41.007885+0000","last_became_peered":"2023-06-09T04:39:41.007885+0000","last_unstale":"2023-06-09T04:39:42.412920+0000","last_undegraded":"2023-06-09T04:39:42.412920+0000","last_fullsized":"2023-06-09T04:39:42.412920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983030+0000","last_change":"2023-06-09T04:39:41.007262+0000","last_active":"2023-06-09T04:39:41.983030+0000","last_peered":"2023-06-09T04:39:41.983030+0000","last_clean":"2023-06-09T04:39:41.983030+0000","last_became_active":"2023-06-09T04:39:41.006952+0000","last_became_peered":"2023-06-09T04:39:41.006952+0000","last_unstale":"2023-06-09T04:39:41.983030+0000","last_undegraded":"2023-06-09T04:39:41.983030+0000","last_fullsized":"2023-06-09T04:39:41.983030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:25.708053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413909+0000","last_change":"2023-06-09T04:39:40.989865+0000","last_active":"2023-06-09T04:39:42.413909+0000","last_peered":"2023-06-09T04:39:42.413909+0000","last_clean":"2023-06-09T04:39:42.413909+0000","last_became_active":"2023-06-09T04:39:40.989566+0000","last_became_peered":"2023-06-09T04:39:40.989566+0000","last_unstale":"2023-06-09T04:39:42.413909+0000","last_undegraded":"2023-06-09T04:39:42.413909+0000","last_fullsized":"2023-06-09T04:39:42.413909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412752+0000","last_change":"2023-06-09T04:39:41.006607+0000","last_active":"2023-06-09T04:39:42.412752+0000","last_peered":"2023-06-09T04:39:42.412752+0000","last_clean":"2023-06-09T04:39:42.412752+0000","last_became_active":"2023-06-09T04:39:41.006216+0000","last_became_peered":"2023-06-09T04:39:41.006216+0000","last_unstale":"2023-06-09T04:39:42.412752+0000","last_undegraded":"2023-06-09T04:39:42.412752+0000","last_fullsized":"2023-06-09T04:39:42.412752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:57.228151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980740+0000","last_change":"2023-06-09T04:39:40.992032+0000","last_active":"2023-06-09T04:39:41.980740+0000","last_peered":"2023-06-09T04:39:41.980740+0000","last_clean":"2023-06-09T04:39:41.980740+0000","last_became_active":"2023-06-09T04:39:40.990837+0000","last_became_peered":"2023-06-09T04:39:40.990837+0000","last_unstale":"2023-06-09T04:39:41.980740+0000","last_undegraded":"2023-06-09T04:39:41.980740+0000","last_fullsized":"2023-06-09T04:39:41.980740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:42.638120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414847+0000","last_change":"2023-06-09T04:39:41.009866+0000","last_active":"2023-06-09T04:39:42.414847+0000","last_peered":"2023-06-09T04:39:42.414847+0000","last_clean":"2023-06-09T04:39:42.414847+0000","last_became_active":"2023-06-09T04:39:41.009511+0000","last_became_peered":"2023-06-09T04:39:41.009511+0000","last_unstale":"2023-06-09T04:39:42.414847+0000","last_undegraded":"2023-06-09T04:39:42.414847+0000","last_fullsized":"2023-06-09T04:39:42.414847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:20.985140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413964+0000","last_change":"2023-06-09T04:39:40.604498+0000","last_active":"2023-06-09T04:39:42.413964+0000","last_peered":"2023-06-09T04:39:42.413964+0000","last_clean":"2023-06-09T04:39:42.413964+0000","last_became_active":"2023-06-09T04:39:40.603788+0000","last_became_peered":"2023-06-09T04:39:40.603788+0000","last_unstale":"2023-06-09T04:39:42.413964+0000","last_undegraded":"2023-06-09T04:39:42.413964+0000","last_fullsized":"2023-06-09T04:39:42.413964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:44.667395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414524+0000","last_change":"2023-06-09T04:39:41.011596+0000","last_active":"2023-06-09T04:39:42.414524+0000","last_peered":"2023-06-09T04:39:42.414524+0000","last_clean":"2023-06-09T04:39:42.414524+0000","last_became_active":"2023-06-09T04:39:41.011240+0000","last_became_peered":"2023-06-09T04:39:41.011240+0000","last_unstale":"2023-06-09T04:39:42.414524+0000","last_undegraded":"2023-06-09T04:39:42.414524+0000","last_fullsized":"2023-06-09T04:39:42.414524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:28:32.741830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413559+0000","last_change":"2023-06-09T04:39:40.619765+0000","last_active":"2023-06-09T04:39:42.413559+0000","last_peered":"2023-06-09T04:39:42.413559+0000","last_clean":"2023-06-09T04:39:42.413559+0000","last_became_active":"2023-06-09T04:39:40.618833+0000","last_became_peered":"2023-06-09T04:39:40.618833+0000","last_unstale":"2023-06-09T04:39:42.413559+0000","last_undegraded":"2023-06-09T04:39:42.413559+0000","last_fullsized":"2023-06-09T04:39:42.413559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983209+0000","last_change":"2023-06-09T04:39:40.994023+0000","last_active":"2023-06-09T04:39:41.983209+0000","last_peered":"2023-06-09T04:39:41.983209+0000","last_clean":"2023-06-09T04:39:41.983209+0000","last_became_active":"2023-06-09T04:39:40.993695+0000","last_became_peered":"2023-06-09T04:39:40.993695+0000","last_unstale":"2023-06-09T04:39:41.983209+0000","last_undegraded":"2023-06-09T04:39:41.983209+0000","last_fullsized":"2023-06-09T04:39:41.983209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:25.004879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413633+0000","last_change":"2023-06-09T04:39:40.607221+0000","last_active":"2023-06-09T04:39:42.413633+0000","last_peered":"2023-06-09T04:39:42.413633+0000","last_clean":"2023-06-09T04:39:42.413633+0000","last_became_active":"2023-06-09T04:39:40.606560+0000","last_became_peered":"2023-06-09T04:39:40.606560+0000","last_unstale":"2023-06-09T04:39:42.413633+0000","last_undegraded":"2023-06-09T04:39:42.413633+0000","last_fullsized":"2023-06-09T04:39:42.413633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:32.670818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981235+0000","last_change":"2023-06-09T04:39:41.000847+0000","last_active":"2023-06-09T04:39:41.981235+0000","last_peered":"2023-06-09T04:39:41.981235+0000","last_clean":"2023-06-09T04:39:41.981235+0000","last_became_active":"2023-06-09T04:39:41.000365+0000","last_became_peered":"2023-06-09T04:39:41.000365+0000","last_unstale":"2023-06-09T04:39:41.981235+0000","last_undegraded":"2023-06-09T04:39:41.981235+0000","last_fullsized":"2023-06-09T04:39:41.981235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:20:10.726424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980180+0000","last_change":"2023-06-09T04:39:40.982117+0000","last_active":"2023-06-09T04:39:41.980180+0000","last_peered":"2023-06-09T04:39:41.980180+0000","last_clean":"2023-06-09T04:39:41.980180+0000","last_became_active":"2023-06-09T04:39:40.981343+0000","last_became_peered":"2023-06-09T04:39:40.981343+0000","last_unstale":"2023-06-09T04:39:41.980180+0000","last_undegraded":"2023-06-09T04:39:41.980180+0000","last_fullsized":"2023-06-09T04:39:41.980180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:39.601908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980296+0000","last_change":"2023-06-09T04:39:40.624170+0000","last_active":"2023-06-09T04:39:41.980296+0000","last_peered":"2023-06-09T04:39:41.980296+0000","last_clean":"2023-06-09T04:39:41.980296+0000","last_became_active":"2023-06-09T04:39:40.623502+0000","last_became_peered":"2023-06-09T04:39:40.623502+0000","last_unstale":"2023-06-09T04:39:41.980296+0000","last_undegraded":"2023-06-09T04:39:41.980296+0000","last_fullsized":"2023-06-09T04:39:41.980296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:37.253525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981882+0000","last_change":"2023-06-09T04:39:40.597631+0000","last_active":"2023-06-09T04:39:41.981882+0000","last_peered":"2023-06-09T04:39:41.981882+0000","last_clean":"2023-06-09T04:39:41.981882+0000","last_became_active":"2023-06-09T04:39:40.596933+0000","last_became_peered":"2023-06-09T04:39:40.596933+0000","last_unstale":"2023-06-09T04:39:41.981882+0000","last_undegraded":"2023-06-09T04:39:41.981882+0000","last_fullsized":"2023-06-09T04:39:41.981882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:09:34.655136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982771+0000","last_change":"2023-06-09T04:39:41.000161+0000","last_active":"2023-06-09T04:39:41.982771+0000","last_peered":"2023-06-09T04:39:41.982771+0000","last_clean":"2023-06-09T04:39:41.982771+0000","last_became_active":"2023-06-09T04:39:40.999789+0000","last_became_peered":"2023-06-09T04:39:40.999789+0000","last_unstale":"2023-06-09T04:39:41.982771+0000","last_undegraded":"2023-06-09T04:39:41.982771+0000","last_fullsized":"2023-06-09T04:39:41.982771+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414775+0000","last_change":"2023-06-09T04:39:40.619981+0000","last_active":"2023-06-09T04:39:42.414775+0000","last_peered":"2023-06-09T04:39:42.414775+0000","last_clean":"2023-06-09T04:39:42.414775+0000","last_became_active":"2023-06-09T04:39:40.619566+0000","last_became_peered":"2023-06-09T04:39:40.619566+0000","last_unstale":"2023-06-09T04:39:42.414775+0000","last_undegraded":"2023-06-09T04:39:42.414775+0000","last_fullsized":"2023-06-09T04:39:42.414775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:23:23.487006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982023+0000","last_change":"2023-06-09T04:39:40.611518+0000","last_active":"2023-06-09T04:39:41.982023+0000","last_peered":"2023-06-09T04:39:41.982023+0000","last_clean":"2023-06-09T04:39:41.982023+0000","last_became_active":"2023-06-09T04:39:40.610734+0000","last_became_peered":"2023-06-09T04:39:40.610734+0000","last_unstale":"2023-06-09T04:39:41.982023+0000","last_undegraded":"2023-06-09T04:39:41.982023+0000","last_fullsized":"2023-06-09T04:39:41.982023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:30:44.123651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414946+0000","last_change":"2023-06-09T04:39:40.612040+0000","last_active":"2023-06-09T04:39:42.414946+0000","last_peered":"2023-06-09T04:39:42.414946+0000","last_clean":"2023-06-09T04:39:42.414946+0000","last_became_active":"2023-06-09T04:39:40.611172+0000","last_became_peered":"2023-06-09T04:39:40.611172+0000","last_unstale":"2023-06-09T04:39:42.414946+0000","last_undegraded":"2023-06-09T04:39:42.414946+0000","last_fullsized":"2023-06-09T04:39:42.414946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:38.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414617+0000","last_change":"2023-06-09T04:39:40.995651+0000","last_active":"2023-06-09T04:39:42.414617+0000","last_peered":"2023-06-09T04:39:42.414617+0000","last_clean":"2023-06-09T04:39:42.414617+0000","last_became_active":"2023-06-09T04:39:40.994999+0000","last_became_peered":"2023-06-09T04:39:40.994999+0000","last_unstale":"2023-06-09T04:39:42.414617+0000","last_undegraded":"2023-06-09T04:39:42.414617+0000","last_fullsized":"2023-06-09T04:39:42.414617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:13:37.121110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414139+0000","last_change":"2023-06-09T04:39:41.012348+0000","last_active":"2023-06-09T04:39:42.414139+0000","last_peered":"2023-06-09T04:39:42.414139+0000","last_clean":"2023-06-09T04:39:42.414139+0000","last_became_active":"2023-06-09T04:39:41.011938+0000","last_became_peered":"2023-06-09T04:39:41.011938+0000","last_unstale":"2023-06-09T04:39:42.414139+0000","last_undegraded":"2023-06-09T04:39:42.414139+0000","last_fullsized":"2023-06-09T04:39:42.414139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:18:48.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412936+0000","last_change":"2023-06-09T04:39:40.607242+0000","last_active":"2023-06-09T04:39:42.412936+0000","last_peered":"2023-06-09T04:39:42.412936+0000","last_clean":"2023-06-09T04:39:42.412936+0000","last_became_active":"2023-06-09T04:39:40.606331+0000","last_became_peered":"2023-06-09T04:39:40.606331+0000","last_unstale":"2023-06-09T04:39:42.412936+0000","last_undegraded":"2023-06-09T04:39:42.412936+0000","last_fullsized":"2023-06-09T04:39:42.412936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412958+0000","last_change":"2023-06-09T04:39:40.993917+0000","last_active":"2023-06-09T04:39:42.412958+0000","last_peered":"2023-06-09T04:39:42.412958+0000","last_clean":"2023-06-09T04:39:42.412958+0000","last_became_active":"2023-06-09T04:39:40.993317+0000","last_became_peered":"2023-06-09T04:39:40.993317+0000","last_unstale":"2023-06-09T04:39:42.412958+0000","last_undegraded":"2023-06-09T04:39:42.412958+0000","last_fullsized":"2023-06-09T04:39:42.412958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:28.568155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980348+0000","last_change":"2023-06-09T04:39:40.594820+0000","last_active":"2023-06-09T04:39:41.980348+0000","last_peered":"2023-06-09T04:39:41.980348+0000","last_clean":"2023-06-09T04:39:41.980348+0000","last_became_active":"2023-06-09T04:39:40.594031+0000","last_became_peered":"2023-06-09T04:39:40.594031+0000","last_unstale":"2023-06-09T04:39:41.980348+0000","last_undegraded":"2023-06-09T04:39:41.980348+0000","last_fullsized":"2023-06-09T04:39:41.980348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:15.340144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415131+0000","last_change":"2023-06-09T04:39:40.998920+0000","last_active":"2023-06-09T04:39:42.415131+0000","last_peered":"2023-06-09T04:39:42.415131+0000","last_clean":"2023-06-09T04:39:42.415131+0000","last_became_active":"2023-06-09T04:39:40.998646+0000","last_became_peered":"2023-06-09T04:39:40.998646+0000","last_unstale":"2023-06-09T04:39:42.415131+0000","last_undegraded":"2023-06-09T04:39:42.415131+0000","last_fullsized":"2023-06-09T04:39:42.415131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:38.068463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983526+0000","last_change":"2023-06-09T04:39:40.625632+0000","last_active":"2023-06-09T04:39:41.983526+0000","last_peered":"2023-06-09T04:39:41.983526+0000","last_clean":"2023-06-09T04:39:41.983526+0000","last_became_active":"2023-06-09T04:39:40.625013+0000","last_became_peered":"2023-06-09T04:39:40.625013+0000","last_unstale":"2023-06-09T04:39:41.983526+0000","last_undegraded":"2023-06-09T04:39:41.983526+0000","last_fullsized":"2023-06-09T04:39:41.983526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:47:39.355242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414848+0000","last_change":"2023-06-09T04:39:41.010054+0000","last_active":"2023-06-09T04:39:42.414848+0000","last_peered":"2023-06-09T04:39:42.414848+0000","last_clean":"2023-06-09T04:39:42.414848+0000","last_became_active":"2023-06-09T04:39:41.009721+0000","last_became_peered":"2023-06-09T04:39:41.009721+0000","last_unstale":"2023-06-09T04:39:42.414848+0000","last_undegraded":"2023-06-09T04:39:42.414848+0000","last_fullsized":"2023-06-09T04:39:42.414848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:06.660210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414779+0000","last_change":"2023-06-09T04:39:40.997482+0000","last_active":"2023-06-09T04:39:42.414779+0000","last_peered":"2023-06-09T04:39:42.414779+0000","last_clean":"2023-06-09T04:39:42.414779+0000","last_became_active":"2023-06-09T04:39:40.996995+0000","last_became_peered":"2023-06-09T04:39:40.996995+0000","last_unstale":"2023-06-09T04:39:42.414779+0000","last_undegraded":"2023-06-09T04:39:42.414779+0000","last_fullsized":"2023-06-09T04:39:42.414779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:19.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413062+0000","last_change":"2023-06-09T04:39:40.608570+0000","last_active":"2023-06-09T04:39:42.413062+0000","last_peered":"2023-06-09T04:39:42.413062+0000","last_clean":"2023-06-09T04:39:42.413062+0000","last_became_active":"2023-06-09T04:39:40.607567+0000","last_became_peered":"2023-06-09T04:39:40.607567+0000","last_unstale":"2023-06-09T04:39:42.413062+0000","last_undegraded":"2023-06-09T04:39:42.413062+0000","last_fullsized":"2023-06-09T04:39:42.413062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980707+0000","last_change":"2023-06-09T04:39:41.005808+0000","last_active":"2023-06-09T04:39:41.980707+0000","last_peered":"2023-06-09T04:39:41.980707+0000","last_clean":"2023-06-09T04:39:41.980707+0000","last_became_active":"2023-06-09T04:39:41.005505+0000","last_became_peered":"2023-06-09T04:39:41.005505+0000","last_unstale":"2023-06-09T04:39:41.980707+0000","last_undegraded":"2023-06-09T04:39:41.980707+0000","last_fullsized":"2023-06-09T04:39:41.980707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:08.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982312+0000","last_change":"2023-06-09T04:39:40.602174+0000","last_active":"2023-06-09T04:39:41.982312+0000","last_peered":"2023-06-09T04:39:41.982312+0000","last_clean":"2023-06-09T04:39:41.982312+0000","last_became_active":"2023-06-09T04:39:40.601339+0000","last_became_peered":"2023-06-09T04:39:40.601339+0000","last_unstale":"2023-06-09T04:39:41.982312+0000","last_undegraded":"2023-06-09T04:39:41.982312+0000","last_fullsized":"2023-06-09T04:39:41.982312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:31:45.907935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413386+0000","last_change":"2023-06-09T04:39:41.006006+0000","last_active":"2023-06-09T04:39:42.413386+0000","last_peered":"2023-06-09T04:39:42.413386+0000","last_clean":"2023-06-09T04:39:42.413386+0000","last_became_active":"2023-06-09T04:39:41.005756+0000","last_became_peered":"2023-06-09T04:39:41.005756+0000","last_unstale":"2023-06-09T04:39:42.413386+0000","last_undegraded":"2023-06-09T04:39:42.413386+0000","last_fullsized":"2023-06-09T04:39:42.413386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980885+0000","last_change":"2023-06-09T04:39:40.993826+0000","last_active":"2023-06-09T04:39:41.980885+0000","last_peered":"2023-06-09T04:39:41.980885+0000","last_clean":"2023-06-09T04:39:41.980885+0000","last_became_active":"2023-06-09T04:39:40.992701+0000","last_became_peered":"2023-06-09T04:39:40.992701+0000","last_unstale":"2023-06-09T04:39:41.980885+0000","last_undegraded":"2023-06-09T04:39:41.980885+0000","last_fullsized":"2023-06-09T04:39:41.980885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:52.880775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980539+0000","last_change":"2023-06-09T04:39:40.601847+0000","last_active":"2023-06-09T04:39:41.980539+0000","last_peered":"2023-06-09T04:39:41.980539+0000","last_clean":"2023-06-09T04:39:41.980539+0000","last_became_active":"2023-06-09T04:39:40.601116+0000","last_became_peered":"2023-06-09T04:39:40.601116+0000","last_unstale":"2023-06-09T04:39:41.980539+0000","last_undegraded":"2023-06-09T04:39:41.980539+0000","last_fullsized":"2023-06-09T04:39:41.980539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:16:36.582040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981457+0000","last_change":"2023-06-09T04:39:40.996654+0000","last_active":"2023-06-09T04:39:41.981457+0000","last_peered":"2023-06-09T04:39:41.981457+0000","last_clean":"2023-06-09T04:39:41.981457+0000","last_became_active":"2023-06-09T04:39:40.995096+0000","last_became_peered":"2023-06-09T04:39:40.995096+0000","last_unstale":"2023-06-09T04:39:41.981457+0000","last_undegraded":"2023-06-09T04:39:41.981457+0000","last_fullsized":"2023-06-09T04:39:41.981457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:47.503555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981090+0000","last_change":"2023-06-09T04:39:41.005886+0000","last_active":"2023-06-09T04:39:41.981090+0000","last_peered":"2023-06-09T04:39:41.981090+0000","last_clean":"2023-06-09T04:39:41.981090+0000","last_became_active":"2023-06-09T04:39:41.005622+0000","last_became_peered":"2023-06-09T04:39:41.005622+0000","last_unstale":"2023-06-09T04:39:41.981090+0000","last_undegraded":"2023-06-09T04:39:41.981090+0000","last_fullsized":"2023-06-09T04:39:41.981090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:49.238912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815672+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:39:34.815672+0000","last_peered":"2023-06-09T04:39:34.815672+0000","last_clean":"2023-06-09T04:39:34.815672+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:39:34.815672+0000","last_undegraded":"2023-06-09T04:39:34.815672+0000","last_fullsized":"2023-06-09T04:39:34.815672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:18:52.556812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982535+0000","last_change":"2023-06-09T04:39:40.994885+0000","last_active":"2023-06-09T04:39:41.982535+0000","last_peered":"2023-06-09T04:39:41.982535+0000","last_clean":"2023-06-09T04:39:41.982535+0000","last_became_active":"2023-06-09T04:39:40.993574+0000","last_became_peered":"2023-06-09T04:39:40.993574+0000","last_unstale":"2023-06-09T04:39:41.982535+0000","last_undegraded":"2023-06-09T04:39:41.982535+0000","last_fullsized":"2023-06-09T04:39:41.982535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:39:50.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981930+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:39:41.981930+0000","last_peered":"2023-06-09T04:39:41.981930+0000","last_clean":"2023-06-09T04:39:41.981930+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:39:41.981930+0000","last_undegraded":"2023-06-09T04:39:41.981930+0000","last_fullsized":"2023-06-09T04:39:41.981930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414346+0000","last_change":"2023-06-09T04:39:40.614551+0000","last_active":"2023-06-09T04:39:42.414346+0000","last_peered":"2023-06-09T04:39:42.414346+0000","last_clean":"2023-06-09T04:39:42.414346+0000","last_became_active":"2023-06-09T04:39:40.613760+0000","last_became_peered":"2023-06-09T04:39:40.613760+0000","last_unstale":"2023-06-09T04:39:42.414346+0000","last_undegraded":"2023-06-09T04:39:42.414346+0000","last_fullsized":"2023-06-09T04:39:42.414346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:02.676701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815516+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:39:34.815516+0000","last_peered":"2023-06-09T04:39:34.815516+0000","last_clean":"2023-06-09T04:39:34.815516+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:39:34.815516+0000","last_undegraded":"2023-06-09T04:39:34.815516+0000","last_fullsized":"2023-06-09T04:39:34.815516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:30:12.337587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413319+0000","last_change":"2023-06-09T04:39:40.993661+0000","last_active":"2023-06-09T04:39:42.413319+0000","last_peered":"2023-06-09T04:39:42.413319+0000","last_clean":"2023-06-09T04:39:42.413319+0000","last_became_active":"2023-06-09T04:39:40.992879+0000","last_became_peered":"2023-06-09T04:39:40.992879+0000","last_unstale":"2023-06-09T04:39:42.413319+0000","last_undegraded":"2023-06-09T04:39:42.413319+0000","last_fullsized":"2023-06-09T04:39:42.413319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414078+0000","last_change":"2023-06-09T04:39:40.615594+0000","last_active":"2023-06-09T04:39:42.414078+0000","last_peered":"2023-06-09T04:39:42.414078+0000","last_clean":"2023-06-09T04:39:42.414078+0000","last_became_active":"2023-06-09T04:39:40.614956+0000","last_became_peered":"2023-06-09T04:39:40.614956+0000","last_unstale":"2023-06-09T04:39:42.414078+0000","last_undegraded":"2023-06-09T04:39:42.414078+0000","last_fullsized":"2023-06-09T04:39:42.414078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:16.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982818+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:39:41.982818+0000","last_peered":"2023-06-09T04:39:41.982818+0000","last_clean":"2023-06-09T04:39:41.982818+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:39:41.982818+0000","last_undegraded":"2023-06-09T04:39:41.982818+0000","last_fullsized":"2023-06-09T04:39:41.982818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:05.270452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983176+0000","last_change":"2023-06-09T04:39:40.623724+0000","last_active":"2023-06-09T04:39:41.983176+0000","last_peered":"2023-06-09T04:39:41.983176+0000","last_clean":"2023-06-09T04:39:41.983176+0000","last_became_active":"2023-06-09T04:39:40.622846+0000","last_became_peered":"2023-06-09T04:39:40.622846+0000","last_unstale":"2023-06-09T04:39:41.983176+0000","last_undegraded":"2023-06-09T04:39:41.983176+0000","last_fullsized":"2023-06-09T04:39:41.983176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:36.849855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815492+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:39:34.815492+0000","last_peered":"2023-06-09T04:39:34.815492+0000","last_clean":"2023-06-09T04:39:34.815492+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:39:34.815492+0000","last_undegraded":"2023-06-09T04:39:34.815492+0000","last_fullsized":"2023-06-09T04:39:34.815492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981962+0000","last_change":"2023-06-09T04:39:40.982461+0000","last_active":"2023-06-09T04:39:41.981962+0000","last_peered":"2023-06-09T04:39:41.981962+0000","last_clean":"2023-06-09T04:39:41.981962+0000","last_became_active":"2023-06-09T04:39:40.981948+0000","last_became_peered":"2023-06-09T04:39:40.981948+0000","last_unstale":"2023-06-09T04:39:41.981962+0000","last_undegraded":"2023-06-09T04:39:41.981962+0000","last_fullsized":"2023-06-09T04:39:41.981962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:38.078169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414000+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:39:42.414000+0000","last_peered":"2023-06-09T04:39:42.414000+0000","last_clean":"2023-06-09T04:39:42.414000+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:39:42.414000+0000","last_undegraded":"2023-06-09T04:39:42.414000+0000","last_fullsized":"2023-06-09T04:39:42.414000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:40.493562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414718+0000","last_change":"2023-06-09T04:39:40.612529+0000","last_active":"2023-06-09T04:39:42.414718+0000","last_peered":"2023-06-09T04:39:42.414718+0000","last_clean":"2023-06-09T04:39:42.414718+0000","last_became_active":"2023-06-09T04:39:40.611514+0000","last_became_peered":"2023-06-09T04:39:40.611514+0000","last_unstale":"2023-06-09T04:39:42.414718+0000","last_undegraded":"2023-06-09T04:39:42.414718+0000","last_fullsized":"2023-06-09T04:39:42.414718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:30:42.783826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815492+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:39:34.815492+0000","last_peered":"2023-06-09T04:39:34.815492+0000","last_clean":"2023-06-09T04:39:34.815492+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:39:34.815492+0000","last_undegraded":"2023-06-09T04:39:34.815492+0000","last_fullsized":"2023-06-09T04:39:34.815492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:10.553303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983194+0000","last_change":"2023-06-09T04:39:40.996130+0000","last_active":"2023-06-09T04:39:41.983194+0000","last_peered":"2023-06-09T04:39:41.983194+0000","last_clean":"2023-06-09T04:39:41.983194+0000","last_became_active":"2023-06-09T04:39:40.995502+0000","last_became_peered":"2023-06-09T04:39:40.995502+0000","last_unstale":"2023-06-09T04:39:41.983194+0000","last_undegraded":"2023-06-09T04:39:41.983194+0000","last_fullsized":"2023-06-09T04:39:41.983194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:03:25.543583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815521+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:39:34.815521+0000","last_peered":"2023-06-09T04:39:34.815521+0000","last_clean":"2023-06-09T04:39:34.815521+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:39:34.815521+0000","last_undegraded":"2023-06-09T04:39:34.815521+0000","last_fullsized":"2023-06-09T04:39:34.815521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:09.871441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815984+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:39:34.815984+0000","last_peered":"2023-06-09T04:39:34.815984+0000","last_clean":"2023-06-09T04:39:34.815984+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:39:34.815984+0000","last_undegraded":"2023-06-09T04:39:34.815984+0000","last_fullsized":"2023-06-09T04:39:34.815984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:32:57.689220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2292,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":36,"acting":36,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.83499999999999996}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.73699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":768618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.432},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.315}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.443},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.044},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":18.922999999999998,"5min":18.922999999999998,"15min":18.922999999999998},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.608000000000001,"5min":12.608000000000001,"15min":12.608000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.95499999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":199170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.077},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.046}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.755}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.014}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":206725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.621},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1470000000000002,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.0869999999999997,"5min":6.0869999999999997,"15min":6.0869999999999997},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.079},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.125}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.052},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":1.226}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":789526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.234},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.4219999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.044},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.347}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.202},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.117},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.494}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.375},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.458}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.1479999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":207765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.438},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.749}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.88700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":458752,"data_stored":199226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.63},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:45.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 Processor -- start 2023-06-09T04:39:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 -- start start 2023-06-09T04:39:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c415ba50 0x7f33c40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f33c40b44c0 0x7f33c40b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c40cb460 con 0x7f33c40b4050 2023-06-09T04:39:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c40cf800 con 0x7f33c40b44c0 2023-06-09T04:39:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33ca966640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40cd0c0 con 0x7f33c415ba50 2023-06-09T04:39:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f33c40b4050 0x7f33c40b05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33458/0 (socket says 172.21.15.18:33458) 2023-06-09T04:39:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c37fe640 1 -- 172.21.15.18:0/3854871093 learned_addr learned my addr 172.21.15.18:0/3854871093 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c415ba50 0x7f33c40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c8f03640 1 --2- 172.21.15.18:0/3854871093 >> v2:172.21.15.81:3300/0 conn(0x7f33c40b44c0 0x7f33c40b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564018357 0 0) 0x7f33c40cb460 con 0x7f33c40b4050 2023-06-09T04:39:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a4003530 con 0x7f33c40b4050 2023-06-09T04:39:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 738272020 0 0) 0x7f33a4003530 con 0x7f33c40b4050 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c415ba50 msgr2=0x7f33c40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c415ba50 0x7f33c40b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 >> v2:172.21.15.81:3300/0 conn(0x7f33c40b44c0 msgr2=0x7f33c40b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 --2- 172.21.15.18:0/3854871093 >> v2:172.21.15.81:3300/0 conn(0x7f33c40b44c0 0x7f33c40b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c406e290 con 0x7f33c40b4050 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f33b4001680 con 0x7f33c40b4050 2023-06-09T04:39:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 >> v1:172.21.15.18:6789/0 conn(0x7f33c40b4050 legacy=0x7f33c40b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a4003980 0x7f33a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33a40043b0 0x7f33a4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4004e00 0x7f33a4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40cf800 con 0x7f33a4003980 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40cd0c0 con 0x7f33a4004e00 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400bd30 con 0x7f33a40043b0 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a4003980 0x7f33a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.552 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c37fe640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33a40043b0 0x7f33a4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c8f03640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4004e00 0x7f33a4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 -- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33a40043b0 msgr2=0x7f33a4004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33a40043b0 0x7f33a4004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 -- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4004e00 msgr2=0x7f33a4005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4004e00 0x7f33a4005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c3fff640 1 -- 172.21.15.18:0/3854871093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4003530 con 0x7f33a4003980 2023-06-09T04:39:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.546+0000 7f33c37fe640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33a40043b0 0x7f33a4004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33c3fff640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a4003980 0x7f33a4003d90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009fc0 tx=0x7f33bc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4417aacecb4057a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0a5c40 con 0x7f33a4003980 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc00f040 con 0x7f33a4003980 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33c2ffd640 1 -- 172.21.15.18:0/3854871093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ad440 con 0x7f33a4003980 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 -- 172.21.15.18:0/3854871093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a4003980 msgr2=0x7f33a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 --2- 172.21.15.18:0/3854871093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a4003980 0x7f33a4003d90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009fc0 tx=0x7f33bc01cc30 comp rx=0 tx=0).stop 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33c8f03640 1 -- 172.21.15.18:0/3854871093 reap_dead start 2023-06-09T04:39:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 -- 172.21.15.18:0/3854871093 shutdown_connections 2023-06-09T04:39:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 -- 172.21.15.18:0/3854871093 >> 172.21.15.18:0/3854871093 conn(0x7f33c40b2720 msgr2=0x7f33c40ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 -- 172.21.15.18:0/3854871093 shutdown_connections 2023-06-09T04:39:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 -- 172.21.15.18:0/3854871093 wait complete. 2023-06-09T04:39:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 Processor -- start 2023-06-09T04:39:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.550+0000 7f33ca966640 1 -- start start 2023-06-09T04:39:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4003980 0x7f33c4164160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 0x7f33c4164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c4149f20 0x7f33c40ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40c3150 con 0x7f33c40c3570 2023-06-09T04:39:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40c39e0 con 0x7f33a4003980 2023-06-09T04:39:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4164fc0 con 0x7f33c4149f20 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 0x7f33c4164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 0x7f33c4164a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37548/0 (socket says 172.21.15.18:37548) 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 -- 172.21.15.18:0/4203372060 learned_addr learned my addr 172.21.15.18:0/4203372060 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c3fff640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4003980 0x7f33c4164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c8f03640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c4149f20 0x7f33c40ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 -- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c4149f20 msgr2=0x7f33c40ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.559 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c4149f20 0x7f33c40ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 -- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4003980 msgr2=0x7f33c4164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4003980 0x7f33c4164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 -- 172.21.15.18:0/4203372060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40c27b0 con 0x7f33c40c3570 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c37fe640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 0x7f33c4164a80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001000 tx=0x7f33b400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400c690 con 0x7f33c40c3570 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400c7f0 con 0x7f33c40c3570 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c40c2a90 con 0x7f33c40c3570 2023-06-09T04:39:45.560 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400cb60 con 0x7f33c40c3570 2023-06-09T04:39:45.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c414a390 con 0x7f33c40c3570 2023-06-09T04:39:45.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c406ea50 con 0x7f33c40c3570 2023-06-09T04:39:45.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33b400ccc0 con 0x7f33c40c3570 2023-06-09T04:39:45.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c0ff9640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f33a8066280 0x7f33a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.561 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f33b4084850 con 0x7f33c40c3570 2023-06-09T04:39:45.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.554+0000 7f33c3fff640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f33a8066280 0x7f33a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.558+0000 7f33c3fff640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f33a8066280 0x7f33a8068730 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0af000 tx=0x7f33bc0a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.562 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.558+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33b4051c00 con 0x7f33c40c3570 2023-06-09T04:39:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.706+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33c4070410 con 0x7f33a8066280 2023-06-09T04:39:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.730+0000 7f33c0ff9640 1 -- 172.21.15.18:0/4203372060 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304351 (secure 0 0 0) 0x7f33bc0bd090 con 0x7f33a8066280 2023-06-09T04:39:45.735 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:39:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f33a8066280 msgr2=0x7f33a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f33a8066280 0x7f33a8068730 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0af000 tx=0x7f33bc0a7040 comp rx=0 tx=0).stop 2023-06-09T04:39:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 msgr2=0x7f33c4164a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 0x7f33c4164a80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001000 tx=0x7f33b400ec90 comp rx=0 tx=0).stop 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 shutdown_connections 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f33a8066280 0x7f33a8068730 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c4149f20 0x7f33c40ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c40c3570 0x7f33c4164a80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 --2- 172.21.15.18:0/4203372060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33a4003980 0x7f33c4164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 >> 172.21.15.18:0/4203372060 conn(0x7f33c40b2720 msgr2=0x7f33c40af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 shutdown_connections 2023-06-09T04:39:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.738+0000 7f33ca966640 1 -- 172.21.15.18:0/4203372060 wait complete. 2023-06-09T04:39:45.758 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-06-09T04:39:43.730626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592660,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236668,"kb_used_data":4668,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738052,"statfs":{"total":773094113280,"available":772851765248,"internally_reserved":0,"allocated":4780032,"data_stored":2727530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2292,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.167189"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414414+0000","last_change":"2023-06-09T04:39:41.000808+0000","last_active":"2023-06-09T04:39:42.414414+0000","last_peered":"2023-06-09T04:39:42.414414+0000","last_clean":"2023-06-09T04:39:42.414414+0000","last_became_active":"2023-06-09T04:39:41.000151+0000","last_became_peered":"2023-06-09T04:39:41.000151+0000","last_unstale":"2023-06-09T04:39:42.414414+0000","last_undegraded":"2023-06-09T04:39:42.414414+0000","last_fullsized":"2023-06-09T04:39:42.414414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:03.688391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982739+0000","last_change":"2023-06-09T04:39:40.996083+0000","last_active":"2023-06-09T04:39:41.982739+0000","last_peered":"2023-06-09T04:39:41.982739+0000","last_clean":"2023-06-09T04:39:41.982739+0000","last_became_active":"2023-06-09T04:39:40.994844+0000","last_became_peered":"2023-06-09T04:39:40.994844+0000","last_unstale":"2023-06-09T04:39:41.982739+0000","last_undegraded":"2023-06-09T04:39:41.982739+0000","last_fullsized":"2023-06-09T04:39:41.982739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:54.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413116+0000","last_change":"2023-06-09T04:39:41.005206+0000","last_active":"2023-06-09T04:39:42.413116+0000","last_peered":"2023-06-09T04:39:42.413116+0000","last_clean":"2023-06-09T04:39:42.413116+0000","last_became_active":"2023-06-09T04:39:41.004921+0000","last_became_peered":"2023-06-09T04:39:41.004921+0000","last_unstale":"2023-06-09T04:39:42.413116+0000","last_undegraded":"2023-06-09T04:39:42.413116+0000","last_fullsized":"2023-06-09T04:39:42.413116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980646+0000","last_change":"2023-06-09T04:39:40.995430+0000","last_active":"2023-06-09T04:39:41.980646+0000","last_peered":"2023-06-09T04:39:41.980646+0000","last_clean":"2023-06-09T04:39:41.980646+0000","last_became_active":"2023-06-09T04:39:40.995059+0000","last_became_peered":"2023-06-09T04:39:40.995059+0000","last_unstale":"2023-06-09T04:39:41.980646+0000","last_undegraded":"2023-06-09T04:39:41.980646+0000","last_fullsized":"2023-06-09T04:39:41.980646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:39.356017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413660+0000","last_change":"2023-06-09T04:39:41.011301+0000","last_active":"2023-06-09T04:39:42.413660+0000","last_peered":"2023-06-09T04:39:42.413660+0000","last_clean":"2023-06-09T04:39:42.413660+0000","last_became_active":"2023-06-09T04:39:41.011025+0000","last_became_peered":"2023-06-09T04:39:41.011025+0000","last_unstale":"2023-06-09T04:39:42.413660+0000","last_undegraded":"2023-06-09T04:39:42.413660+0000","last_fullsized":"2023-06-09T04:39:42.413660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981795+0000","last_change":"2023-06-09T04:39:40.980070+0000","last_active":"2023-06-09T04:39:41.981795+0000","last_peered":"2023-06-09T04:39:41.981795+0000","last_clean":"2023-06-09T04:39:41.981795+0000","last_became_active":"2023-06-09T04:39:40.979811+0000","last_became_peered":"2023-06-09T04:39:40.979811+0000","last_unstale":"2023-06-09T04:39:41.981795+0000","last_undegraded":"2023-06-09T04:39:41.981795+0000","last_fullsized":"2023-06-09T04:39:41.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:47.531527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983149+0000","last_change":"2023-06-09T04:39:41.006586+0000","last_active":"2023-06-09T04:39:41.983149+0000","last_peered":"2023-06-09T04:39:41.983149+0000","last_clean":"2023-06-09T04:39:41.983149+0000","last_became_active":"2023-06-09T04:39:41.006246+0000","last_became_peered":"2023-06-09T04:39:41.006246+0000","last_unstale":"2023-06-09T04:39:41.983149+0000","last_undegraded":"2023-06-09T04:39:41.983149+0000","last_fullsized":"2023-06-09T04:39:41.983149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:19.064520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414413+0000","last_change":"2023-06-09T04:39:40.993770+0000","last_active":"2023-06-09T04:39:42.414413+0000","last_peered":"2023-06-09T04:39:42.414413+0000","last_clean":"2023-06-09T04:39:42.414413+0000","last_became_active":"2023-06-09T04:39:40.993487+0000","last_became_peered":"2023-06-09T04:39:40.993487+0000","last_unstale":"2023-06-09T04:39:42.414413+0000","last_undegraded":"2023-06-09T04:39:42.414413+0000","last_fullsized":"2023-06-09T04:39:42.414413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:45.679085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413299+0000","last_change":"2023-06-09T04:39:41.005318+0000","last_active":"2023-06-09T04:39:42.413299+0000","last_peered":"2023-06-09T04:39:42.413299+0000","last_clean":"2023-06-09T04:39:42.413299+0000","last_became_active":"2023-06-09T04:39:41.004392+0000","last_became_peered":"2023-06-09T04:39:41.004392+0000","last_unstale":"2023-06-09T04:39:42.413299+0000","last_undegraded":"2023-06-09T04:39:42.413299+0000","last_fullsized":"2023-06-09T04:39:42.413299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982357+0000","last_change":"2023-06-09T04:39:40.995521+0000","last_active":"2023-06-09T04:39:41.982357+0000","last_peered":"2023-06-09T04:39:41.982357+0000","last_clean":"2023-06-09T04:39:41.982357+0000","last_became_active":"2023-06-09T04:39:40.994259+0000","last_became_peered":"2023-06-09T04:39:40.994259+0000","last_unstale":"2023-06-09T04:39:41.982357+0000","last_undegraded":"2023-06-09T04:39:41.982357+0000","last_fullsized":"2023-06-09T04:39:41.982357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:24.765697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981150+0000","last_change":"2023-06-09T04:39:40.996969+0000","last_active":"2023-06-09T04:39:41.981150+0000","last_peered":"2023-06-09T04:39:41.981150+0000","last_clean":"2023-06-09T04:39:41.981150+0000","last_became_active":"2023-06-09T04:39:40.995463+0000","last_became_peered":"2023-06-09T04:39:40.995463+0000","last_unstale":"2023-06-09T04:39:41.981150+0000","last_undegraded":"2023-06-09T04:39:41.981150+0000","last_fullsized":"2023-06-09T04:39:41.981150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:43.962204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415559+0000","last_change":"2023-06-09T04:39:40.993899+0000","last_active":"2023-06-09T04:39:42.415559+0000","last_peered":"2023-06-09T04:39:42.415559+0000","last_clean":"2023-06-09T04:39:42.415559+0000","last_became_active":"2023-06-09T04:39:40.993231+0000","last_became_peered":"2023-06-09T04:39:40.993231+0000","last_unstale":"2023-06-09T04:39:42.415559+0000","last_undegraded":"2023-06-09T04:39:42.415559+0000","last_fullsized":"2023-06-09T04:39:42.415559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:24:21.785637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981630+0000","last_change":"2023-06-09T04:39:40.998525+0000","last_active":"2023-06-09T04:39:41.981630+0000","last_peered":"2023-06-09T04:39:41.981630+0000","last_clean":"2023-06-09T04:39:41.981630+0000","last_became_active":"2023-06-09T04:39:40.993470+0000","last_became_peered":"2023-06-09T04:39:40.993470+0000","last_unstale":"2023-06-09T04:39:41.981630+0000","last_undegraded":"2023-06-09T04:39:41.981630+0000","last_fullsized":"2023-06-09T04:39:41.981630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:13.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982518+0000","last_change":"2023-06-09T04:39:40.990578+0000","last_active":"2023-06-09T04:39:41.982518+0000","last_peered":"2023-06-09T04:39:41.982518+0000","last_clean":"2023-06-09T04:39:41.982518+0000","last_became_active":"2023-06-09T04:39:40.989892+0000","last_became_peered":"2023-06-09T04:39:40.989892+0000","last_unstale":"2023-06-09T04:39:41.982518+0000","last_undegraded":"2023-06-09T04:39:41.982518+0000","last_fullsized":"2023-06-09T04:39:41.982518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:10:14.667327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414285+0000","last_change":"2023-06-09T04:39:40.998900+0000","last_active":"2023-06-09T04:39:42.414285+0000","last_peered":"2023-06-09T04:39:42.414285+0000","last_clean":"2023-06-09T04:39:42.414285+0000","last_became_active":"2023-06-09T04:39:40.998565+0000","last_became_peered":"2023-06-09T04:39:40.998565+0000","last_unstale":"2023-06-09T04:39:42.414285+0000","last_undegraded":"2023-06-09T04:39:42.414285+0000","last_fullsized":"2023-06-09T04:39:42.414285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:52.438310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412920+0000","last_change":"2023-06-09T04:39:41.008177+0000","last_active":"2023-06-09T04:39:42.412920+0000","last_peered":"2023-06-09T04:39:42.412920+0000","last_clean":"2023-06-09T04:39:42.412920+0000","last_became_active":"2023-06-09T04:39:41.007885+0000","last_became_peered":"2023-06-09T04:39:41.007885+0000","last_unstale":"2023-06-09T04:39:42.412920+0000","last_undegraded":"2023-06-09T04:39:42.412920+0000","last_fullsized":"2023-06-09T04:39:42.412920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983030+0000","last_change":"2023-06-09T04:39:41.007262+0000","last_active":"2023-06-09T04:39:41.983030+0000","last_peered":"2023-06-09T04:39:41.983030+0000","last_clean":"2023-06-09T04:39:41.983030+0000","last_became_active":"2023-06-09T04:39:41.006952+0000","last_became_peered":"2023-06-09T04:39:41.006952+0000","last_unstale":"2023-06-09T04:39:41.983030+0000","last_undegraded":"2023-06-09T04:39:41.983030+0000","last_fullsized":"2023-06-09T04:39:41.983030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:25.708053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413909+0000","last_change":"2023-06-09T04:39:40.989865+0000","last_active":"2023-06-09T04:39:42.413909+0000","last_peered":"2023-06-09T04:39:42.413909+0000","last_clean":"2023-06-09T04:39:42.413909+0000","last_became_active":"2023-06-09T04:39:40.989566+0000","last_became_peered":"2023-06-09T04:39:40.989566+0000","last_unstale":"2023-06-09T04:39:42.413909+0000","last_undegraded":"2023-06-09T04:39:42.413909+0000","last_fullsized":"2023-06-09T04:39:42.413909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412752+0000","last_change":"2023-06-09T04:39:41.006607+0000","last_active":"2023-06-09T04:39:42.412752+0000","last_peered":"2023-06-09T04:39:42.412752+0000","last_clean":"2023-06-09T04:39:42.412752+0000","last_became_active":"2023-06-09T04:39:41.006216+0000","last_became_peered":"2023-06-09T04:39:41.006216+0000","last_unstale":"2023-06-09T04:39:42.412752+0000","last_undegraded":"2023-06-09T04:39:42.412752+0000","last_fullsized":"2023-06-09T04:39:42.412752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:57.228151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980740+0000","last_change":"2023-06-09T04:39:40.992032+0000","last_active":"2023-06-09T04:39:41.980740+0000","last_peered":"2023-06-09T04:39:41.980740+0000","last_clean":"2023-06-09T04:39:41.980740+0000","last_became_active":"2023-06-09T04:39:40.990837+0000","last_became_peered":"2023-06-09T04:39:40.990837+0000","last_unstale":"2023-06-09T04:39:41.980740+0000","last_undegraded":"2023-06-09T04:39:41.980740+0000","last_fullsized":"2023-06-09T04:39:41.980740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:42.638120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414847+0000","last_change":"2023-06-09T04:39:41.009866+0000","last_active":"2023-06-09T04:39:42.414847+0000","last_peered":"2023-06-09T04:39:42.414847+0000","last_clean":"2023-06-09T04:39:42.414847+0000","last_became_active":"2023-06-09T04:39:41.009511+0000","last_became_peered":"2023-06-09T04:39:41.009511+0000","last_unstale":"2023-06-09T04:39:42.414847+0000","last_undegraded":"2023-06-09T04:39:42.414847+0000","last_fullsized":"2023-06-09T04:39:42.414847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:20.985140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413964+0000","last_change":"2023-06-09T04:39:40.604498+0000","last_active":"2023-06-09T04:39:42.413964+0000","last_peered":"2023-06-09T04:39:42.413964+0000","last_clean":"2023-06-09T04:39:42.413964+0000","last_became_active":"2023-06-09T04:39:40.603788+0000","last_became_peered":"2023-06-09T04:39:40.603788+0000","last_unstale":"2023-06-09T04:39:42.413964+0000","last_undegraded":"2023-06-09T04:39:42.413964+0000","last_fullsized":"2023-06-09T04:39:42.413964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:44.667395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414524+0000","last_change":"2023-06-09T04:39:41.011596+0000","last_active":"2023-06-09T04:39:42.414524+0000","last_peered":"2023-06-09T04:39:42.414524+0000","last_clean":"2023-06-09T04:39:42.414524+0000","last_became_active":"2023-06-09T04:39:41.011240+0000","last_became_peered":"2023-06-09T04:39:41.011240+0000","last_unstale":"2023-06-09T04:39:42.414524+0000","last_undegraded":"2023-06-09T04:39:42.414524+0000","last_fullsized":"2023-06-09T04:39:42.414524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:28:32.741830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413559+0000","last_change":"2023-06-09T04:39:40.619765+0000","last_active":"2023-06-09T04:39:42.413559+0000","last_peered":"2023-06-09T04:39:42.413559+0000","last_clean":"2023-06-09T04:39:42.413559+0000","last_became_active":"2023-06-09T04:39:40.618833+0000","last_became_peered":"2023-06-09T04:39:40.618833+0000","last_unstale":"2023-06-09T04:39:42.413559+0000","last_undegraded":"2023-06-09T04:39:42.413559+0000","last_fullsized":"2023-06-09T04:39:42.413559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983209+0000","last_change":"2023-06-09T04:39:40.994023+0000","last_active":"2023-06-09T04:39:41.983209+0000","last_peered":"2023-06-09T04:39:41.983209+0000","last_clean":"2023-06-09T04:39:41.983209+0000","last_became_active":"2023-06-09T04:39:40.993695+0000","last_became_peered":"2023-06-09T04:39:40.993695+0000","last_unstale":"2023-06-09T04:39:41.983209+0000","last_undegraded":"2023-06-09T04:39:41.983209+0000","last_fullsized":"2023-06-09T04:39:41.983209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:25.004879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413633+0000","last_change":"2023-06-09T04:39:40.607221+0000","last_active":"2023-06-09T04:39:42.413633+0000","last_peered":"2023-06-09T04:39:42.413633+0000","last_clean":"2023-06-09T04:39:42.413633+0000","last_became_active":"2023-06-09T04:39:40.606560+0000","last_became_peered":"2023-06-09T04:39:40.606560+0000","last_unstale":"2023-06-09T04:39:42.413633+0000","last_undegraded":"2023-06-09T04:39:42.413633+0000","last_fullsized":"2023-06-09T04:39:42.413633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:32.670818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981235+0000","last_change":"2023-06-09T04:39:41.000847+0000","last_active":"2023-06-09T04:39:41.981235+0000","last_peered":"2023-06-09T04:39:41.981235+0000","last_clean":"2023-06-09T04:39:41.981235+0000","last_became_active":"2023-06-09T04:39:41.000365+0000","last_became_peered":"2023-06-09T04:39:41.000365+0000","last_unstale":"2023-06-09T04:39:41.981235+0000","last_undegraded":"2023-06-09T04:39:41.981235+0000","last_fullsized":"2023-06-09T04:39:41.981235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:20:10.726424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980180+0000","last_change":"2023-06-09T04:39:40.982117+0000","last_active":"2023-06-09T04:39:41.980180+0000","last_peered":"2023-06-09T04:39:41.980180+0000","last_clean":"2023-06-09T04:39:41.980180+0000","last_became_active":"2023-06-09T04:39:40.981343+0000","last_became_peered":"2023-06-09T04:39:40.981343+0000","last_unstale":"2023-06-09T04:39:41.980180+0000","last_undegraded":"2023-06-09T04:39:41.980180+0000","last_fullsized":"2023-06-09T04:39:41.980180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:39.601908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980296+0000","last_change":"2023-06-09T04:39:40.624170+0000","last_active":"2023-06-09T04:39:41.980296+0000","last_peered":"2023-06-09T04:39:41.980296+0000","last_clean":"2023-06-09T04:39:41.980296+0000","last_became_active":"2023-06-09T04:39:40.623502+0000","last_became_peered":"2023-06-09T04:39:40.623502+0000","last_unstale":"2023-06-09T04:39:41.980296+0000","last_undegraded":"2023-06-09T04:39:41.980296+0000","last_fullsized":"2023-06-09T04:39:41.980296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:37.253525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981882+0000","last_change":"2023-06-09T04:39:40.597631+0000","last_active":"2023-06-09T04:39:41.981882+0000","last_peered":"2023-06-09T04:39:41.981882+0000","last_clean":"2023-06-09T04:39:41.981882+0000","last_became_active":"2023-06-09T04:39:40.596933+0000","last_became_peered":"2023-06-09T04:39:40.596933+0000","last_unstale":"2023-06-09T04:39:41.981882+0000","last_undegraded":"2023-06-09T04:39:41.981882+0000","last_fullsized":"2023-06-09T04:39:41.981882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:09:34.655136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982771+0000","last_change":"2023-06-09T04:39:41.000161+0000","last_active":"2023-06-09T04:39:41.982771+0000","last_peered":"2023-06-09T04:39:41.982771+0000","last_clean":"2023-06-09T04:39:41.982771+0000","last_became_active":"2023-06-09T04:39:40.999789+0000","last_became_peered":"2023-06-09T04:39:40.999789+0000","last_unstale":"2023-06-09T04:39:41.982771+0000","last_undegraded":"2023-06-09T04:39:41.982771+0000","last_fullsized":"2023-06-09T04:39:41.982771+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414775+0000","last_change":"2023-06-09T04:39:40.619981+0000","last_active":"2023-06-09T04:39:42.414775+0000","last_peered":"2023-06-09T04:39:42.414775+0000","last_clean":"2023-06-09T04:39:42.414775+0000","last_became_active":"2023-06-09T04:39:40.619566+0000","last_became_peered":"2023-06-09T04:39:40.619566+0000","last_unstale":"2023-06-09T04:39:42.414775+0000","last_undegraded":"2023-06-09T04:39:42.414775+0000","last_fullsized":"2023-06-09T04:39:42.414775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:23:23.487006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982023+0000","last_change":"2023-06-09T04:39:40.611518+0000","last_active":"2023-06-09T04:39:41.982023+0000","last_peered":"2023-06-09T04:39:41.982023+0000","last_clean":"2023-06-09T04:39:41.982023+0000","last_became_active":"2023-06-09T04:39:40.610734+0000","last_became_peered":"2023-06-09T04:39:40.610734+0000","last_unstale":"2023-06-09T04:39:41.982023+0000","last_undegraded":"2023-06-09T04:39:41.982023+0000","last_fullsized":"2023-06-09T04:39:41.982023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:30:44.123651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414946+0000","last_change":"2023-06-09T04:39:40.612040+0000","last_active":"2023-06-09T04:39:42.414946+0000","last_peered":"2023-06-09T04:39:42.414946+0000","last_clean":"2023-06-09T04:39:42.414946+0000","last_became_active":"2023-06-09T04:39:40.611172+0000","last_became_peered":"2023-06-09T04:39:40.611172+0000","last_unstale":"2023-06-09T04:39:42.414946+0000","last_undegraded":"2023-06-09T04:39:42.414946+0000","last_fullsized":"2023-06-09T04:39:42.414946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:38.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414617+0000","last_change":"2023-06-09T04:39:40.995651+0000","last_active":"2023-06-09T04:39:42.414617+0000","last_peered":"2023-06-09T04:39:42.414617+0000","last_clean":"2023-06-09T04:39:42.414617+0000","last_became_active":"2023-06-09T04:39:40.994999+0000","last_became_peered":"2023-06-09T04:39:40.994999+0000","last_unstale":"2023-06-09T04:39:42.414617+0000","last_undegraded":"2023-06-09T04:39:42.414617+0000","last_fullsized":"2023-06-09T04:39:42.414617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:13:37.121110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414139+0000","last_change":"2023-06-09T04:39:41.012348+0000","last_active":"2023-06-09T04:39:42.414139+0000","last_peered":"2023-06-09T04:39:42.414139+0000","last_clean":"2023-06-09T04:39:42.414139+0000","last_became_active":"2023-06-09T04:39:41.011938+0000","last_became_peered":"2023-06-09T04:39:41.011938+0000","last_unstale":"2023-06-09T04:39:42.414139+0000","last_undegraded":"2023-06-09T04:39:42.414139+0000","last_fullsized":"2023-06-09T04:39:42.414139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:18:48.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412936+0000","last_change":"2023-06-09T04:39:40.607242+0000","last_active":"2023-06-09T04:39:42.412936+0000","last_peered":"2023-06-09T04:39:42.412936+0000","last_clean":"2023-06-09T04:39:42.412936+0000","last_became_active":"2023-06-09T04:39:40.606331+0000","last_became_peered":"2023-06-09T04:39:40.606331+0000","last_unstale":"2023-06-09T04:39:42.412936+0000","last_undegraded":"2023-06-09T04:39:42.412936+0000","last_fullsized":"2023-06-09T04:39:42.412936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412958+0000","last_change":"2023-06-09T04:39:40.993917+0000","last_active":"2023-06-09T04:39:42.412958+0000","last_peered":"2023-06-09T04:39:42.412958+0000","last_clean":"2023-06-09T04:39:42.412958+0000","last_became_active":"2023-06-09T04:39:40.993317+0000","last_became_peered":"2023-06-09T04:39:40.993317+0000","last_unstale":"2023-06-09T04:39:42.412958+0000","last_undegraded":"2023-06-09T04:39:42.412958+0000","last_fullsized":"2023-06-09T04:39:42.412958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:28.568155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980348+0000","last_change":"2023-06-09T04:39:40.594820+0000","last_active":"2023-06-09T04:39:41.980348+0000","last_peered":"2023-06-09T04:39:41.980348+0000","last_clean":"2023-06-09T04:39:41.980348+0000","last_became_active":"2023-06-09T04:39:40.594031+0000","last_became_peered":"2023-06-09T04:39:40.594031+0000","last_unstale":"2023-06-09T04:39:41.980348+0000","last_undegraded":"2023-06-09T04:39:41.980348+0000","last_fullsized":"2023-06-09T04:39:41.980348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:15.340144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415131+0000","last_change":"2023-06-09T04:39:40.998920+0000","last_active":"2023-06-09T04:39:42.415131+0000","last_peered":"2023-06-09T04:39:42.415131+0000","last_clean":"2023-06-09T04:39:42.415131+0000","last_became_active":"2023-06-09T04:39:40.998646+0000","last_became_peered":"2023-06-09T04:39:40.998646+0000","last_unstale":"2023-06-09T04:39:42.415131+0000","last_undegraded":"2023-06-09T04:39:42.415131+0000","last_fullsized":"2023-06-09T04:39:42.415131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:38.068463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983526+0000","last_change":"2023-06-09T04:39:40.625632+0000","last_active":"2023-06-09T04:39:41.983526+0000","last_peered":"2023-06-09T04:39:41.983526+0000","last_clean":"2023-06-09T04:39:41.983526+0000","last_became_active":"2023-06-09T04:39:40.625013+0000","last_became_peered":"2023-06-09T04:39:40.625013+0000","last_unstale":"2023-06-09T04:39:41.983526+0000","last_undegraded":"2023-06-09T04:39:41.983526+0000","last_fullsized":"2023-06-09T04:39:41.983526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:47:39.355242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414848+0000","last_change":"2023-06-09T04:39:41.010054+0000","last_active":"2023-06-09T04:39:42.414848+0000","last_peered":"2023-06-09T04:39:42.414848+0000","last_clean":"2023-06-09T04:39:42.414848+0000","last_became_active":"2023-06-09T04:39:41.009721+0000","last_became_peered":"2023-06-09T04:39:41.009721+0000","last_unstale":"2023-06-09T04:39:42.414848+0000","last_undegraded":"2023-06-09T04:39:42.414848+0000","last_fullsized":"2023-06-09T04:39:42.414848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:06.660210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414779+0000","last_change":"2023-06-09T04:39:40.997482+0000","last_active":"2023-06-09T04:39:42.414779+0000","last_peered":"2023-06-09T04:39:42.414779+0000","last_clean":"2023-06-09T04:39:42.414779+0000","last_became_active":"2023-06-09T04:39:40.996995+0000","last_became_peered":"2023-06-09T04:39:40.996995+0000","last_unstale":"2023-06-09T04:39:42.414779+0000","last_undegraded":"2023-06-09T04:39:42.414779+0000","last_fullsized":"2023-06-09T04:39:42.414779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:19.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413062+0000","last_change":"2023-06-09T04:39:40.608570+0000","last_active":"2023-06-09T04:39:42.413062+0000","last_peered":"2023-06-09T04:39:42.413062+0000","last_clean":"2023-06-09T04:39:42.413062+0000","last_became_active":"2023-06-09T04:39:40.607567+0000","last_became_peered":"2023-06-09T04:39:40.607567+0000","last_unstale":"2023-06-09T04:39:42.413062+0000","last_undegraded":"2023-06-09T04:39:42.413062+0000","last_fullsized":"2023-06-09T04:39:42.413062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980707+0000","last_change":"2023-06-09T04:39:41.005808+0000","last_active":"2023-06-09T04:39:41.980707+0000","last_peered":"2023-06-09T04:39:41.980707+0000","last_clean":"2023-06-09T04:39:41.980707+0000","last_became_active":"2023-06-09T04:39:41.005505+0000","last_became_peered":"2023-06-09T04:39:41.005505+0000","last_unstale":"2023-06-09T04:39:41.980707+0000","last_undegraded":"2023-06-09T04:39:41.980707+0000","last_fullsized":"2023-06-09T04:39:41.980707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:08.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982312+0000","last_change":"2023-06-09T04:39:40.602174+0000","last_active":"2023-06-09T04:39:41.982312+0000","last_peered":"2023-06-09T04:39:41.982312+0000","last_clean":"2023-06-09T04:39:41.982312+0000","last_became_active":"2023-06-09T04:39:40.601339+0000","last_became_peered":"2023-06-09T04:39:40.601339+0000","last_unstale":"2023-06-09T04:39:41.982312+0000","last_undegraded":"2023-06-09T04:39:41.982312+0000","last_fullsized":"2023-06-09T04:39:41.982312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:31:45.907935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413386+0000","last_change":"2023-06-09T04:39:41.006006+0000","last_active":"2023-06-09T04:39:42.413386+0000","last_peered":"2023-06-09T04:39:42.413386+0000","last_clean":"2023-06-09T04:39:42.413386+0000","last_became_active":"2023-06-09T04:39:41.005756+0000","last_became_peered":"2023-06-09T04:39:41.005756+0000","last_unstale":"2023-06-09T04:39:42.413386+0000","last_undegraded":"2023-06-09T04:39:42.413386+0000","last_fullsized":"2023-06-09T04:39:42.413386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980885+0000","last_change":"2023-06-09T04:39:40.993826+0000","last_active":"2023-06-09T04:39:41.980885+0000","last_peered":"2023-06-09T04:39:41.980885+0000","last_clean":"2023-06-09T04:39:41.980885+0000","last_became_active":"2023-06-09T04:39:40.992701+0000","last_became_peered":"2023-06-09T04:39:40.992701+0000","last_unstale":"2023-06-09T04:39:41.980885+0000","last_undegraded":"2023-06-09T04:39:41.980885+0000","last_fullsized":"2023-06-09T04:39:41.980885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:52.880775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980539+0000","last_change":"2023-06-09T04:39:40.601847+0000","last_active":"2023-06-09T04:39:41.980539+0000","last_peered":"2023-06-09T04:39:41.980539+0000","last_clean":"2023-06-09T04:39:41.980539+0000","last_became_active":"2023-06-09T04:39:40.601116+0000","last_became_peered":"2023-06-09T04:39:40.601116+0000","last_unstale":"2023-06-09T04:39:41.980539+0000","last_undegraded":"2023-06-09T04:39:41.980539+0000","last_fullsized":"2023-06-09T04:39:41.980539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:16:36.582040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981457+0000","last_change":"2023-06-09T04:39:40.996654+0000","last_active":"2023-06-09T04:39:41.981457+0000","last_peered":"2023-06-09T04:39:41.981457+0000","last_clean":"2023-06-09T04:39:41.981457+0000","last_became_active":"2023-06-09T04:39:40.995096+0000","last_became_peered":"2023-06-09T04:39:40.995096+0000","last_unstale":"2023-06-09T04:39:41.981457+0000","last_undegraded":"2023-06-09T04:39:41.981457+0000","last_fullsized":"2023-06-09T04:39:41.981457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:47.503555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981090+0000","last_change":"2023-06-09T04:39:41.005886+0000","last_active":"2023-06-09T04:39:41.981090+0000","last_peered":"2023-06-09T04:39:41.981090+0000","last_clean":"2023-06-09T04:39:41.981090+0000","last_became_active":"2023-06-09T04:39:41.005622+0000","last_became_peered":"2023-06-09T04:39:41.005622+0000","last_unstale":"2023-06-09T04:39:41.981090+0000","last_undegraded":"2023-06-09T04:39:41.981090+0000","last_fullsized":"2023-06-09T04:39:41.981090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:49.238912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815672+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:39:34.815672+0000","last_peered":"2023-06-09T04:39:34.815672+0000","last_clean":"2023-06-09T04:39:34.815672+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:39:34.815672+0000","last_undegraded":"2023-06-09T04:39:34.815672+0000","last_fullsized":"2023-06-09T04:39:34.815672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:18:52.556812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982535+0000","last_change":"2023-06-09T04:39:40.994885+0000","last_active":"2023-06-09T04:39:41.982535+0000","last_peered":"2023-06-09T04:39:41.982535+0000","last_clean":"2023-06-09T04:39:41.982535+0000","last_became_active":"2023-06-09T04:39:40.993574+0000","last_became_peered":"2023-06-09T04:39:40.993574+0000","last_unstale":"2023-06-09T04:39:41.982535+0000","last_undegraded":"2023-06-09T04:39:41.982535+0000","last_fullsized":"2023-06-09T04:39:41.982535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:39:50.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981930+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:39:41.981930+0000","last_peered":"2023-06-09T04:39:41.981930+0000","last_clean":"2023-06-09T04:39:41.981930+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:39:41.981930+0000","last_undegraded":"2023-06-09T04:39:41.981930+0000","last_fullsized":"2023-06-09T04:39:41.981930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414346+0000","last_change":"2023-06-09T04:39:40.614551+0000","last_active":"2023-06-09T04:39:42.414346+0000","last_peered":"2023-06-09T04:39:42.414346+0000","last_clean":"2023-06-09T04:39:42.414346+0000","last_became_active":"2023-06-09T04:39:40.613760+0000","last_became_peered":"2023-06-09T04:39:40.613760+0000","last_unstale":"2023-06-09T04:39:42.414346+0000","last_undegraded":"2023-06-09T04:39:42.414346+0000","last_fullsized":"2023-06-09T04:39:42.414346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:02.676701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815516+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:39:34.815516+0000","last_peered":"2023-06-09T04:39:34.815516+0000","last_clean":"2023-06-09T04:39:34.815516+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:39:34.815516+0000","last_undegraded":"2023-06-09T04:39:34.815516+0000","last_fullsized":"2023-06-09T04:39:34.815516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:30:12.337587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413319+0000","last_change":"2023-06-09T04:39:40.993661+0000","last_active":"2023-06-09T04:39:42.413319+0000","last_peered":"2023-06-09T04:39:42.413319+0000","last_clean":"2023-06-09T04:39:42.413319+0000","last_became_active":"2023-06-09T04:39:40.992879+0000","last_became_peered":"2023-06-09T04:39:40.992879+0000","last_unstale":"2023-06-09T04:39:42.413319+0000","last_undegraded":"2023-06-09T04:39:42.413319+0000","last_fullsized":"2023-06-09T04:39:42.413319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414078+0000","last_change":"2023-06-09T04:39:40.615594+0000","last_active":"2023-06-09T04:39:42.414078+0000","last_peered":"2023-06-09T04:39:42.414078+0000","last_clean":"2023-06-09T04:39:42.414078+0000","last_became_active":"2023-06-09T04:39:40.614956+0000","last_became_peered":"2023-06-09T04:39:40.614956+0000","last_unstale":"2023-06-09T04:39:42.414078+0000","last_undegraded":"2023-06-09T04:39:42.414078+0000","last_fullsized":"2023-06-09T04:39:42.414078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:16.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982818+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:39:41.982818+0000","last_peered":"2023-06-09T04:39:41.982818+0000","last_clean":"2023-06-09T04:39:41.982818+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:39:41.982818+0000","last_undegraded":"2023-06-09T04:39:41.982818+0000","last_fullsized":"2023-06-09T04:39:41.982818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:05.270452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983176+0000","last_change":"2023-06-09T04:39:40.623724+0000","last_active":"2023-06-09T04:39:41.983176+0000","last_peered":"2023-06-09T04:39:41.983176+0000","last_clean":"2023-06-09T04:39:41.983176+0000","last_became_active":"2023-06-09T04:39:40.622846+0000","last_became_peered":"2023-06-09T04:39:40.622846+0000","last_unstale":"2023-06-09T04:39:41.983176+0000","last_undegraded":"2023-06-09T04:39:41.983176+0000","last_fullsized":"2023-06-09T04:39:41.983176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:36.849855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815492+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:39:34.815492+0000","last_peered":"2023-06-09T04:39:34.815492+0000","last_clean":"2023-06-09T04:39:34.815492+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:39:34.815492+0000","last_undegraded":"2023-06-09T04:39:34.815492+0000","last_fullsized":"2023-06-09T04:39:34.815492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981962+0000","last_change":"2023-06-09T04:39:40.982461+0000","last_active":"2023-06-09T04:39:41.981962+0000","last_peered":"2023-06-09T04:39:41.981962+0000","last_clean":"2023-06-09T04:39:41.981962+0000","last_became_active":"2023-06-09T04:39:40.981948+0000","last_became_peered":"2023-06-09T04:39:40.981948+0000","last_unstale":"2023-06-09T04:39:41.981962+0000","last_undegraded":"2023-06-09T04:39:41.981962+0000","last_fullsized":"2023-06-09T04:39:41.981962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:38.078169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414000+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:39:42.414000+0000","last_peered":"2023-06-09T04:39:42.414000+0000","last_clean":"2023-06-09T04:39:42.414000+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:39:42.414000+0000","last_undegraded":"2023-06-09T04:39:42.414000+0000","last_fullsized":"2023-06-09T04:39:42.414000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:40.493562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:40.561275+0000","last_change":"2023-06-09T04:39:40.561275+0000","last_active":"2023-06-09T04:39:40.561275+0000","last_peered":"2023-06-09T04:39:40.561275+0000","last_clean":"2023-06-09T04:39:40.561275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:40.561275+0000","last_undegraded":"2023-06-09T04:39:40.561275+0000","last_fullsized":"2023-06-09T04:39:40.561275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414718+0000","last_change":"2023-06-09T04:39:40.612529+0000","last_active":"2023-06-09T04:39:42.414718+0000","last_peered":"2023-06-09T04:39:42.414718+0000","last_clean":"2023-06-09T04:39:42.414718+0000","last_became_active":"2023-06-09T04:39:40.611514+0000","last_became_peered":"2023-06-09T04:39:40.611514+0000","last_unstale":"2023-06-09T04:39:42.414718+0000","last_undegraded":"2023-06-09T04:39:42.414718+0000","last_fullsized":"2023-06-09T04:39:42.414718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:30:42.783826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815492+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:39:34.815492+0000","last_peered":"2023-06-09T04:39:34.815492+0000","last_clean":"2023-06-09T04:39:34.815492+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:39:34.815492+0000","last_undegraded":"2023-06-09T04:39:34.815492+0000","last_fullsized":"2023-06-09T04:39:34.815492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:29:10.553303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983194+0000","last_change":"2023-06-09T04:39:40.996130+0000","last_active":"2023-06-09T04:39:41.983194+0000","last_peered":"2023-06-09T04:39:41.983194+0000","last_clean":"2023-06-09T04:39:41.983194+0000","last_became_active":"2023-06-09T04:39:40.995502+0000","last_became_peered":"2023-06-09T04:39:40.995502+0000","last_unstale":"2023-06-09T04:39:41.983194+0000","last_undegraded":"2023-06-09T04:39:41.983194+0000","last_fullsized":"2023-06-09T04:39:41.983194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:03:25.543583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:39:39.549584+0000","last_change":"2023-06-09T04:39:39.549584+0000","last_active":"2023-06-09T04:39:39.549584+0000","last_peered":"2023-06-09T04:39:39.549584+0000","last_clean":"2023-06-09T04:39:39.549584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:39:39.549584+0000","last_undegraded":"2023-06-09T04:39:39.549584+0000","last_fullsized":"2023-06-09T04:39:39.549584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815521+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:39:34.815521+0000","last_peered":"2023-06-09T04:39:34.815521+0000","last_clean":"2023-06-09T04:39:34.815521+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:39:34.815521+0000","last_undegraded":"2023-06-09T04:39:34.815521+0000","last_fullsized":"2023-06-09T04:39:34.815521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:15:09.871441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:39:34.815984+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:39:34.815984+0000","last_peered":"2023-06-09T04:39:34.815984+0000","last_clean":"2023-06-09T04:39:34.815984+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:39:34.815984+0000","last_undegraded":"2023-06-09T04:39:34.815984+0000","last_fullsized":"2023-06-09T04:39:34.815984+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:32:57.689220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2292,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":36,"acting":36,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.83499999999999996}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.73699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":768618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.40400000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.432},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.315}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":417792,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.443},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.044},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":18.922999999999998,"5min":18.922999999999998,"15min":18.922999999999998},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.608000000000001,"5min":12.608000000000001,"15min":12.608000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.95499999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":199170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.077},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.046}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.755}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.014}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":206725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.621},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1470000000000002,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.0869999999999997,"5min":6.0869999999999997,"15min":6.0869999999999997},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.079},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.125}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.052},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":1.226}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":789526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.234},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.4219999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.044},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.347}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.202},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.117},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.494}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.375},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.458}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.1479999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":207765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.438},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.749}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.88700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":458752,"data_stored":199226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.63},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:45.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-06-09T04:39:45.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-06-09T04:39:45.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-06-09T04:39:45.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-06-09T04:39:45.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-06-09T04:39:45.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-06-09T04:39:45.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-06-09T04:39:45.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-06-09T04:39:45.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-06-09T04:39:45.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-06-09T04:39:45.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-06-09T04:39:45.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-06-09T04:39:45.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-06-09T04:39:45.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-06-09T04:39:45.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-06-09T04:39:45.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-06-09T04:39:45.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-06-09T04:39:45.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-06-09T04:39:45.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-06-09T04:39:45.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-06-09T04:39:45.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-06-09T04:39:45.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-06-09T04:39:45.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-06-09T04:39:45.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-06-09T04:39:45.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-06-09T04:39:45.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-06-09T04:39:45.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-06-09T04:39:45.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-06-09T04:39:45.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-06-09T04:39:45.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-06-09T04:39:45.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-06-09T04:39:45.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-06-09T04:39:45.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-06-09T04:39:45.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-06-09T04:39:45.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-06-09T04:39:45.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-06-09T04:39:45.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:40.561275+0000', 'last_change': '2023-06-09T04:39:40.561275+0000', 'last_active': '2023-06-09T04:39:40.561275+0000', 'last_peered': '2023-06-09T04:39:40.561275+0000', 'last_clean': '2023-06-09T04:39:40.561275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:40.561275+0000', 'last_undegraded': '2023-06-09T04:39:40.561275+0000', 'last_fullsized': '2023-06-09T04:39:40.561275+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:40.561275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-06-09T04:39:45.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T04:39:39.549584+0000', 'last_change': '2023-06-09T04:39:39.549584+0000', 'last_active': '2023-06-09T04:39:39.549584+0000', 'last_peered': '2023-06-09T04:39:39.549584+0000', 'last_clean': '2023-06-09T04:39:39.549584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T04:39:39.549584+0000', 'last_undegraded': '2023-06-09T04:39:39.549584+0000', 'last_fullsized': '2023-06-09T04:39:39.549584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'last_clean_scrub_stamp': '2023-06-09T04:39:39.549584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T04:39:45.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-09T04:39:45.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 Processor -- start 2023-06-09T04:39:45.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 -- start start 2023-06-09T04:39:45.922 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd840703f0 0x7fdd8406c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd841597e0 0x7fdd840707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd84070d00 con 0x7fdd840c9d10 2023-06-09T04:39:45.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd84159d90 con 0x7fdd841597e0 2023-06-09T04:39:45.923 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.918+0000 7fdd8977e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8415a070 con 0x7fdd840703f0 2023-06-09T04:39:45.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd827fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd841597e0 0x7fdd840707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd837fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdd840c9d10 0x7fdd8415d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33466/0 (socket says 172.21.15.18:33466) 2023-06-09T04:39:45.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd837fe640 1 -- 172.21.15.18:0/3487780139 learned_addr learned my addr 172.21.15.18:0/3487780139 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:45.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd82ffd640 1 --2- 172.21.15.18:0/3487780139 >> v2:172.21.15.81:3300/0 conn(0x7fdd840703f0 0x7fdd8406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.924 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd827fc640 1 -- 172.21.15.18:0/3487780139 >> v2:172.21.15.81:3300/0 conn(0x7fdd840703f0 msgr2=0x7fdd8406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:45.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd827fc640 1 --2- 172.21.15.18:0/3487780139 >> v2:172.21.15.81:3300/0 conn(0x7fdd840703f0 0x7fdd8406c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd827fc640 1 -- 172.21.15.18:0/3487780139 >> v1:172.21.15.18:6789/0 conn(0x7fdd840c9d10 legacy=0x7fdd8415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd827fc640 1 -- 172.21.15.18:0/3487780139 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8415a350 con 0x7fdd841597e0 2023-06-09T04:39:45.925 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd827fc640 1 --2- 172.21.15.18:0/3487780139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841597e0 0x7fdd840707c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdd8406f530 tx=0x7fdd7801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e53c56822502cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd81ffb640 1 -- 172.21.15.18:0/3487780139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780ab600 con 0x7fdd841597e0 2023-06-09T04:39:45.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd81ffb640 1 -- 172.21.15.18:0/3487780139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd780a7050 con 0x7fdd841597e0 2023-06-09T04:39:45.926 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd81ffb640 1 -- 172.21.15.18:0/3487780139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780ab980 con 0x7fdd841597e0 2023-06-09T04:39:45.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 -- 172.21.15.18:0/3487780139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841597e0 msgr2=0x7fdd840707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 --2- 172.21.15.18:0/3487780139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841597e0 0x7fdd840707c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdd8406f530 tx=0x7fdd7801c3d0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 -- 172.21.15.18:0/3487780139 shutdown_connections 2023-06-09T04:39:45.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 --2- 172.21.15.18:0/3487780139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd841597e0 0x7fdd840707c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 --2- 172.21.15.18:0/3487780139 >> v2:172.21.15.81:3300/0 conn(0x7fdd840703f0 0x7fdd8406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.927 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 -- 172.21.15.18:0/3487780139 >> 172.21.15.18:0/3487780139 conn(0x7fdd840af5b0 msgr2=0x7fdd840af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:45.928 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 -- 172.21.15.18:0/3487780139 shutdown_connections 2023-06-09T04:39:45.928 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.922+0000 7fdd8977e640 1 -- 172.21.15.18:0/3487780139 wait complete. 2023-06-09T04:39:45.928 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 Processor -- start 2023-06-09T04:39:45.928 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 -- start start 2023-06-09T04:39:45.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd840703f0 0x7fdd840c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 0x7fdd8414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.930 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd841597e0 0x7fdd8414ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414bf00 con 0x7fdd840c9d10 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414cca0 con 0x7fdd841597e0 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414c1a0 con 0x7fdd840703f0 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 0x7fdd8414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 0x7fdd8414c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37558/0 (socket says 172.21.15.18:37558) 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 -- 172.21.15.18:0/2878600778 learned_addr learned my addr 172.21.15.18:0/2878600778 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd82ffd640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd840703f0 0x7fdd840c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.931 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd837fe640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd841597e0 0x7fdd8414ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 -- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd840703f0 msgr2=0x7fdd840c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd840703f0 0x7fdd840c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 -- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd841597e0 msgr2=0x7fdd8414ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd841597e0 0x7fdd8414ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 -- 172.21.15.18:0/2878600778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78009420 con 0x7fdd840c9d10 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd837fe640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd841597e0 0x7fdd8414ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:45.932 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd827fc640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 0x7fdd8414c760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000c10 tx=0x7fdd78019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.933 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780b5410 con 0x7fdd840c9d10 2023-06-09T04:39:45.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd780b5590 con 0x7fdd840c9d10 2023-06-09T04:39:45.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780b5940 con 0x7fdd840c9d10 2023-06-09T04:39:45.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8414c480 con 0x7fdd840c9d10 2023-06-09T04:39:45.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.926+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8406a1d0 con 0x7fdd840c9d10 2023-06-09T04:39:45.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.930+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8404dea0 con 0x7fdd840c9d10 2023-06-09T04:39:45.934 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.930+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd780b2070 con 0x7fdd840c9d10 2023-06-09T04:39:45.935 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.930+0000 7fdd6b7fe640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd70066280 0x7fdd70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:45.935 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.930+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd7811e010 con 0x7fdd840c9d10 2023-06-09T04:39:45.935 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.930+0000 7fdd82ffd640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd70066280 0x7fdd70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:45.935 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.930+0000 7fdd82ffd640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd70066280 0x7fdd70068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd840aee80 tx=0x7fdd74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:45.937 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:45.934+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd780eb3e0 con 0x7fdd840c9d10 2023-06-09T04:39:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.146+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdd840c7d90 con 0x7fdd840c9d10 2023-06-09T04:39:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.146+0000 7fdd6b7fe640 1 -- 172.21.15.18:0/2878600778 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7fdd780b5aa0 con 0x7fdd840c9d10 2023-06-09T04:39:46.150 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:46.150 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":118,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1686285478,"num_in_osds":8,"osd_in_since":1686285469,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":242520064,"bytes_avail":772851593216,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-06-09T04:39:19.723098+0000","services":{}},"progress_events":{}} 2023-06-09T04:39:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd70066280 msgr2=0x7fdd70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd70066280 0x7fdd70068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd840aee80 tx=0x7fdd74008040 comp rx=0 tx=0).stop 2023-06-09T04:39:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 msgr2=0x7fdd8414c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 0x7fdd8414c760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000c10 tx=0x7fdd78019170 comp rx=0 tx=0).stop 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 shutdown_connections 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd841597e0 0x7fdd8414ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd840c9d10 0x7fdd8414c760 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fdd70066280 0x7fdd70068730 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 --2- 172.21.15.18:0/2878600778 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd840703f0 0x7fdd840c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 >> 172.21.15.18:0/2878600778 conn(0x7fdd840af5b0 msgr2=0x7fdd840af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 shutdown_connections 2023-06-09T04:39:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.150+0000 7fdd8977e640 1 -- 172.21.15.18:0/2878600778 wait complete. 2023-06-09T04:39:46.168 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-09T04:39:46.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:46.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 Processor -- start 2023-06-09T04:39:46.279 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 -- start start 2023-06-09T04:39:46.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73e0069440 0x7f73e0069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:46.280 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73e00c8ab0 0x7f73e00c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e0159b50 con 0x7f73e015cfa0 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e015d4d0 con 0x7f73e00c8ab0 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e62e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e015d7b0 con 0x7f73e0069440 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73e00c8ab0 0x7f73e00c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73e00c8ab0 0x7f73e00c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37566/0 (socket says 172.21.15.18:37566) 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 -- 172.21.15.18:0/3095853476 learned_addr learned my addr 172.21.15.18:0/3095853476 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:46.281 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73dffff640 1 --2- 172.21.15.18:0/3095853476 >> v2:172.21.15.81:3300/0 conn(0x7f73e0069440 0x7f73e0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:46.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 -- 172.21.15.18:0/3095853476 >> v2:172.21.15.81:3300/0 conn(0x7f73e0069440 msgr2=0x7f73e0069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:46.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 --2- 172.21.15.18:0/3095853476 >> v2:172.21.15.81:3300/0 conn(0x7f73e0069440 0x7f73e0069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 -- 172.21.15.18:0/3095853476 >> v1:172.21.15.81:6789/0 conn(0x7f73e015cfa0 legacy=0x7f73e00ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.282 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.278+0000 7f73e4881640 1 -- 172.21.15.18:0/3095853476 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e015da90 con 0x7f73e00c8ab0 2023-06-09T04:39:46.283 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e4881640 1 --2- 172.21.15.18:0/3095853476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00c8ab0 0x7f73e00c8ef0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f73e006f840 tx=0x7f73d801c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9608b65553d4daa8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:46.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73deffd640 1 -- 172.21.15.18:0/3095853476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80ab600 con 0x7f73e00c8ab0 2023-06-09T04:39:46.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73deffd640 1 -- 172.21.15.18:0/3095853476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d80a7050 con 0x7f73e00c8ab0 2023-06-09T04:39:46.284 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73deffd640 1 -- 172.21.15.18:0/3095853476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80ab980 con 0x7f73e00c8ab0 2023-06-09T04:39:46.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- 172.21.15.18:0/3095853476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00c8ab0 msgr2=0x7f73e00c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 --2- 172.21.15.18:0/3095853476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00c8ab0 0x7f73e00c8ef0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f73e006f840 tx=0x7f73d801c060 comp rx=0 tx=0).stop 2023-06-09T04:39:46.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- 172.21.15.18:0/3095853476 shutdown_connections 2023-06-09T04:39:46.285 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 --2- 172.21.15.18:0/3095853476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00c8ab0 0x7f73e00c8ef0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 --2- 172.21.15.18:0/3095853476 >> v2:172.21.15.81:3300/0 conn(0x7f73e0069440 0x7f73e0069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- 172.21.15.18:0/3095853476 >> 172.21.15.18:0/3095853476 conn(0x7f73e00cb960 msgr2=0x7f73e00ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- 172.21.15.18:0/3095853476 shutdown_connections 2023-06-09T04:39:46.286 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- 172.21.15.18:0/3095853476 wait complete. 2023-06-09T04:39:46.287 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 Processor -- start 2023-06-09T04:39:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- start start 2023-06-09T04:39:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 0x7f73e014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73e00c8ab0 0x7f73e0155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f73e015cfa0 0x7f73e0155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e014bc60 con 0x7f73e0069440 2023-06-09T04:39:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e014bdc0 con 0x7f73e00c8ab0 2023-06-09T04:39:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73e62e4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e014cc20 con 0x7f73e015cfa0 2023-06-09T04:39:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.282+0000 7f73dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 0x7f73e014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 0x7f73e014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37570/0 (socket says 172.21.15.18:37570) 2023-06-09T04:39:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 -- 172.21.15.18:0/240541076 learned_addr learned my addr 172.21.15.18:0/240541076 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73e4881640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f73e015cfa0 0x7f73e0155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73df7fe640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73e00c8ab0 0x7f73e0155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 -- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f73e015cfa0 msgr2=0x7f73e0155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f73e015cfa0 0x7f73e0155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 -- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73e00c8ab0 msgr2=0x7f73e0155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.290 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73e00c8ab0 0x7f73e0155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 -- 172.21.15.18:0/240541076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80094d0 con 0x7f73e0069440 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73df7fe640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73e00c8ab0 0x7f73e0155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dffff640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 0x7f73e014b720 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f73d000e8a0 tx=0x7f73d000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0009510 con 0x7f73e0069440 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d000c940 con 0x7f73e0069440 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e014d650 con 0x7f73e0069440 2023-06-09T04:39:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d000ccb0 con 0x7f73e0069440 2023-06-09T04:39:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e014c2f0 con 0x7f73e0069440 2023-06-09T04:39:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e006ac20 con 0x7f73e0069440 2023-06-09T04:39:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73d0013470 con 0x7f73e0069440 2023-06-09T04:39:46.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dcff9640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f73cc066280 0x7f73cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:46.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f73d00846d0 con 0x7f73e0069440 2023-06-09T04:39:46.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73df7fe640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f73cc066280 0x7f73cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:46.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.286+0000 7f73df7fe640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f73cc066280 0x7f73cc068730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73d4007fd0 tx=0x7f73d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:46.293 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.290+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73d0051af0 con 0x7f73e0069440 2023-06-09T04:39:46.436 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.434+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73e0166130 con 0x7f73cc066280 2023-06-09T04:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.458+0000 7f73dcff9640 1 -- 172.21.15.18:0/240541076 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310000 (secure 0 0 0) 0x7f73d400d900 con 0x7f73cc066280 2023-06-09T04:39:46.461 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:46.464 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:39:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f73cc066280 msgr2=0x7f73cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f73cc066280 0x7f73cc068730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73d4007fd0 tx=0x7f73d4009040 comp rx=0 tx=0).stop 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 msgr2=0x7f73e014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 0x7f73e014b720 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f73d000e8a0 tx=0x7f73d000eca0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 shutdown_connections 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f73cc066280 0x7f73cc068730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f73e015cfa0 0x7f73e0155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73e00c8ab0 0x7f73e0155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 --2- 172.21.15.18:0/240541076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e0069440 0x7f73e014b720 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 >> 172.21.15.18:0/240541076 conn(0x7f73e00cb960 msgr2=0x7f73e01508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 shutdown_connections 2023-06-09T04:39:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:46.462+0000 7f73e62e4640 1 -- 172.21.15.18:0/240541076 wait complete. 2023-06-09T04:39:46.482 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-06-09T04:39:45.732663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236836,"kb_used_data":4836,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737884,"statfs":{"total":773094113280,"available":772851593216,"internally_reserved":0,"allocated":4952064,"data_stored":2813413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.003267"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416844+0000","last_change":"2023-06-09T04:39:40.995945+0000","last_active":"2023-06-09T04:39:42.416844+0000","last_peered":"2023-06-09T04:39:42.416844+0000","last_clean":"2023-06-09T04:39:42.416844+0000","last_became_active":"2023-06-09T04:39:40.995027+0000","last_became_peered":"2023-06-09T04:39:40.995027+0000","last_unstale":"2023-06-09T04:39:42.416844+0000","last_undegraded":"2023-06-09T04:39:42.416844+0000","last_fullsized":"2023-06-09T04:39:42.416844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414414+0000","last_change":"2023-06-09T04:39:41.000808+0000","last_active":"2023-06-09T04:39:42.414414+0000","last_peered":"2023-06-09T04:39:42.414414+0000","last_clean":"2023-06-09T04:39:42.414414+0000","last_became_active":"2023-06-09T04:39:41.000151+0000","last_became_peered":"2023-06-09T04:39:41.000151+0000","last_unstale":"2023-06-09T04:39:42.414414+0000","last_undegraded":"2023-06-09T04:39:42.414414+0000","last_fullsized":"2023-06-09T04:39:42.414414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:03.688391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414824+0000","last_change":"2023-06-09T04:39:41.013638+0000","last_active":"2023-06-09T04:39:42.414824+0000","last_peered":"2023-06-09T04:39:42.414824+0000","last_clean":"2023-06-09T04:39:42.414824+0000","last_became_active":"2023-06-09T04:39:41.013242+0000","last_became_peered":"2023-06-09T04:39:41.013242+0000","last_unstale":"2023-06-09T04:39:42.414824+0000","last_undegraded":"2023-06-09T04:39:42.414824+0000","last_fullsized":"2023-06-09T04:39:42.414824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:54:05.966812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982739+0000","last_change":"2023-06-09T04:39:40.996083+0000","last_active":"2023-06-09T04:39:41.982739+0000","last_peered":"2023-06-09T04:39:41.982739+0000","last_clean":"2023-06-09T04:39:41.982739+0000","last_became_active":"2023-06-09T04:39:40.994844+0000","last_became_peered":"2023-06-09T04:39:40.994844+0000","last_unstale":"2023-06-09T04:39:41.982739+0000","last_undegraded":"2023-06-09T04:39:41.982739+0000","last_fullsized":"2023-06-09T04:39:41.982739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:54.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415989+0000","last_change":"2023-06-09T04:39:41.009003+0000","last_active":"2023-06-09T04:39:42.415989+0000","last_peered":"2023-06-09T04:39:42.415989+0000","last_clean":"2023-06-09T04:39:42.415989+0000","last_became_active":"2023-06-09T04:39:41.008666+0000","last_became_peered":"2023-06-09T04:39:41.008666+0000","last_unstale":"2023-06-09T04:39:42.415989+0000","last_undegraded":"2023-06-09T04:39:42.415989+0000","last_fullsized":"2023-06-09T04:39:42.415989+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:33.257704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413116+0000","last_change":"2023-06-09T04:39:41.005206+0000","last_active":"2023-06-09T04:39:42.413116+0000","last_peered":"2023-06-09T04:39:42.413116+0000","last_clean":"2023-06-09T04:39:42.413116+0000","last_became_active":"2023-06-09T04:39:41.004921+0000","last_became_peered":"2023-06-09T04:39:41.004921+0000","last_unstale":"2023-06-09T04:39:42.413116+0000","last_undegraded":"2023-06-09T04:39:42.413116+0000","last_fullsized":"2023-06-09T04:39:42.413116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978816+0000","last_change":"2023-06-09T04:39:41.002479+0000","last_active":"2023-06-09T04:39:41.978816+0000","last_peered":"2023-06-09T04:39:41.978816+0000","last_clean":"2023-06-09T04:39:41.978816+0000","last_became_active":"2023-06-09T04:39:41.000503+0000","last_became_peered":"2023-06-09T04:39:41.000503+0000","last_unstale":"2023-06-09T04:39:41.978816+0000","last_undegraded":"2023-06-09T04:39:41.978816+0000","last_fullsized":"2023-06-09T04:39:41.978816+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:30:17.933177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980646+0000","last_change":"2023-06-09T04:39:40.995430+0000","last_active":"2023-06-09T04:39:41.980646+0000","last_peered":"2023-06-09T04:39:41.980646+0000","last_clean":"2023-06-09T04:39:41.980646+0000","last_became_active":"2023-06-09T04:39:40.995059+0000","last_became_peered":"2023-06-09T04:39:40.995059+0000","last_unstale":"2023-06-09T04:39:41.980646+0000","last_undegraded":"2023-06-09T04:39:41.980646+0000","last_fullsized":"2023-06-09T04:39:41.980646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:39.356017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413660+0000","last_change":"2023-06-09T04:39:41.011301+0000","last_active":"2023-06-09T04:39:42.413660+0000","last_peered":"2023-06-09T04:39:42.413660+0000","last_clean":"2023-06-09T04:39:42.413660+0000","last_became_active":"2023-06-09T04:39:41.011025+0000","last_became_peered":"2023-06-09T04:39:41.011025+0000","last_unstale":"2023-06-09T04:39:42.413660+0000","last_undegraded":"2023-06-09T04:39:42.413660+0000","last_fullsized":"2023-06-09T04:39:42.413660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981795+0000","last_change":"2023-06-09T04:39:40.980070+0000","last_active":"2023-06-09T04:39:41.981795+0000","last_peered":"2023-06-09T04:39:41.981795+0000","last_clean":"2023-06-09T04:39:41.981795+0000","last_became_active":"2023-06-09T04:39:40.979811+0000","last_became_peered":"2023-06-09T04:39:40.979811+0000","last_unstale":"2023-06-09T04:39:41.981795+0000","last_undegraded":"2023-06-09T04:39:41.981795+0000","last_fullsized":"2023-06-09T04:39:41.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:47.531527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983149+0000","last_change":"2023-06-09T04:39:41.006586+0000","last_active":"2023-06-09T04:39:41.983149+0000","last_peered":"2023-06-09T04:39:41.983149+0000","last_clean":"2023-06-09T04:39:41.983149+0000","last_became_active":"2023-06-09T04:39:41.006246+0000","last_became_peered":"2023-06-09T04:39:41.006246+0000","last_unstale":"2023-06-09T04:39:41.983149+0000","last_undegraded":"2023-06-09T04:39:41.983149+0000","last_fullsized":"2023-06-09T04:39:41.983149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:19.064520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414413+0000","last_change":"2023-06-09T04:39:40.993770+0000","last_active":"2023-06-09T04:39:42.414413+0000","last_peered":"2023-06-09T04:39:42.414413+0000","last_clean":"2023-06-09T04:39:42.414413+0000","last_became_active":"2023-06-09T04:39:40.993487+0000","last_became_peered":"2023-06-09T04:39:40.993487+0000","last_unstale":"2023-06-09T04:39:42.414413+0000","last_undegraded":"2023-06-09T04:39:42.414413+0000","last_fullsized":"2023-06-09T04:39:42.414413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:45.679085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413299+0000","last_change":"2023-06-09T04:39:41.005318+0000","last_active":"2023-06-09T04:39:42.413299+0000","last_peered":"2023-06-09T04:39:42.413299+0000","last_clean":"2023-06-09T04:39:42.413299+0000","last_became_active":"2023-06-09T04:39:41.004392+0000","last_became_peered":"2023-06-09T04:39:41.004392+0000","last_unstale":"2023-06-09T04:39:42.413299+0000","last_undegraded":"2023-06-09T04:39:42.413299+0000","last_fullsized":"2023-06-09T04:39:42.413299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982357+0000","last_change":"2023-06-09T04:39:40.995521+0000","last_active":"2023-06-09T04:39:41.982357+0000","last_peered":"2023-06-09T04:39:41.982357+0000","last_clean":"2023-06-09T04:39:41.982357+0000","last_became_active":"2023-06-09T04:39:40.994259+0000","last_became_peered":"2023-06-09T04:39:40.994259+0000","last_unstale":"2023-06-09T04:39:41.982357+0000","last_undegraded":"2023-06-09T04:39:41.982357+0000","last_fullsized":"2023-06-09T04:39:41.982357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:24.765697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981150+0000","last_change":"2023-06-09T04:39:40.996969+0000","last_active":"2023-06-09T04:39:41.981150+0000","last_peered":"2023-06-09T04:39:41.981150+0000","last_clean":"2023-06-09T04:39:41.981150+0000","last_became_active":"2023-06-09T04:39:40.995463+0000","last_became_peered":"2023-06-09T04:39:40.995463+0000","last_unstale":"2023-06-09T04:39:41.981150+0000","last_undegraded":"2023-06-09T04:39:41.981150+0000","last_fullsized":"2023-06-09T04:39:41.981150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:43.962204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415647+0000","last_change":"2023-06-09T04:39:41.002893+0000","last_active":"2023-06-09T04:39:42.415647+0000","last_peered":"2023-06-09T04:39:42.415647+0000","last_clean":"2023-06-09T04:39:42.415647+0000","last_became_active":"2023-06-09T04:39:41.002577+0000","last_became_peered":"2023-06-09T04:39:41.002577+0000","last_unstale":"2023-06-09T04:39:42.415647+0000","last_undegraded":"2023-06-09T04:39:42.415647+0000","last_fullsized":"2023-06-09T04:39:42.415647+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:07:57.524795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415559+0000","last_change":"2023-06-09T04:39:40.993899+0000","last_active":"2023-06-09T04:39:42.415559+0000","last_peered":"2023-06-09T04:39:42.415559+0000","last_clean":"2023-06-09T04:39:42.415559+0000","last_became_active":"2023-06-09T04:39:40.993231+0000","last_became_peered":"2023-06-09T04:39:40.993231+0000","last_unstale":"2023-06-09T04:39:42.415559+0000","last_undegraded":"2023-06-09T04:39:42.415559+0000","last_fullsized":"2023-06-09T04:39:42.415559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:24:21.785637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414075+0000","last_change":"2023-06-09T04:39:40.997373+0000","last_active":"2023-06-09T04:39:42.414075+0000","last_peered":"2023-06-09T04:39:42.414075+0000","last_clean":"2023-06-09T04:39:42.414075+0000","last_became_active":"2023-06-09T04:39:40.996941+0000","last_became_peered":"2023-06-09T04:39:40.996941+0000","last_unstale":"2023-06-09T04:39:42.414075+0000","last_undegraded":"2023-06-09T04:39:42.414075+0000","last_fullsized":"2023-06-09T04:39:42.414075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:26.947127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416334+0000","last_change":"2023-06-09T04:39:41.006737+0000","last_active":"2023-06-09T04:39:42.416334+0000","last_peered":"2023-06-09T04:39:42.416334+0000","last_clean":"2023-06-09T04:39:42.416334+0000","last_became_active":"2023-06-09T04:39:41.006418+0000","last_became_peered":"2023-06-09T04:39:41.006418+0000","last_unstale":"2023-06-09T04:39:42.416334+0000","last_undegraded":"2023-06-09T04:39:42.416334+0000","last_fullsized":"2023-06-09T04:39:42.416334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:02.617460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981630+0000","last_change":"2023-06-09T04:39:40.998525+0000","last_active":"2023-06-09T04:39:41.981630+0000","last_peered":"2023-06-09T04:39:41.981630+0000","last_clean":"2023-06-09T04:39:41.981630+0000","last_became_active":"2023-06-09T04:39:40.993470+0000","last_became_peered":"2023-06-09T04:39:40.993470+0000","last_unstale":"2023-06-09T04:39:41.981630+0000","last_undegraded":"2023-06-09T04:39:41.981630+0000","last_fullsized":"2023-06-09T04:39:41.981630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:13.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982518+0000","last_change":"2023-06-09T04:39:40.990578+0000","last_active":"2023-06-09T04:39:41.982518+0000","last_peered":"2023-06-09T04:39:41.982518+0000","last_clean":"2023-06-09T04:39:41.982518+0000","last_became_active":"2023-06-09T04:39:40.989892+0000","last_became_peered":"2023-06-09T04:39:40.989892+0000","last_unstale":"2023-06-09T04:39:41.982518+0000","last_undegraded":"2023-06-09T04:39:41.982518+0000","last_fullsized":"2023-06-09T04:39:41.982518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:10:14.667327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414285+0000","last_change":"2023-06-09T04:39:40.998900+0000","last_active":"2023-06-09T04:39:42.414285+0000","last_peered":"2023-06-09T04:39:42.414285+0000","last_clean":"2023-06-09T04:39:42.414285+0000","last_became_active":"2023-06-09T04:39:40.998565+0000","last_became_peered":"2023-06-09T04:39:40.998565+0000","last_unstale":"2023-06-09T04:39:42.414285+0000","last_undegraded":"2023-06-09T04:39:42.414285+0000","last_fullsized":"2023-06-09T04:39:42.414285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:52.438310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979021+0000","last_change":"2023-06-09T04:39:40.988038+0000","last_active":"2023-06-09T04:39:41.979021+0000","last_peered":"2023-06-09T04:39:41.979021+0000","last_clean":"2023-06-09T04:39:41.979021+0000","last_became_active":"2023-06-09T04:39:40.987571+0000","last_became_peered":"2023-06-09T04:39:40.987571+0000","last_unstale":"2023-06-09T04:39:41.979021+0000","last_undegraded":"2023-06-09T04:39:41.979021+0000","last_fullsized":"2023-06-09T04:39:41.979021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:25.256108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412920+0000","last_change":"2023-06-09T04:39:41.008177+0000","last_active":"2023-06-09T04:39:42.412920+0000","last_peered":"2023-06-09T04:39:42.412920+0000","last_clean":"2023-06-09T04:39:42.412920+0000","last_became_active":"2023-06-09T04:39:41.007885+0000","last_became_peered":"2023-06-09T04:39:41.007885+0000","last_unstale":"2023-06-09T04:39:42.412920+0000","last_undegraded":"2023-06-09T04:39:42.412920+0000","last_fullsized":"2023-06-09T04:39:42.412920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416859+0000","last_change":"2023-06-09T04:39:40.996163+0000","last_active":"2023-06-09T04:39:42.416859+0000","last_peered":"2023-06-09T04:39:42.416859+0000","last_clean":"2023-06-09T04:39:42.416859+0000","last_became_active":"2023-06-09T04:39:40.995844+0000","last_became_peered":"2023-06-09T04:39:40.995844+0000","last_unstale":"2023-06-09T04:39:42.416859+0000","last_undegraded":"2023-06-09T04:39:42.416859+0000","last_fullsized":"2023-06-09T04:39:42.416859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983030+0000","last_change":"2023-06-09T04:39:41.007262+0000","last_active":"2023-06-09T04:39:41.983030+0000","last_peered":"2023-06-09T04:39:41.983030+0000","last_clean":"2023-06-09T04:39:41.983030+0000","last_became_active":"2023-06-09T04:39:41.006952+0000","last_became_peered":"2023-06-09T04:39:41.006952+0000","last_unstale":"2023-06-09T04:39:41.983030+0000","last_undegraded":"2023-06-09T04:39:41.983030+0000","last_fullsized":"2023-06-09T04:39:41.983030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:25.708053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979677+0000","last_change":"2023-06-09T04:39:41.002912+0000","last_active":"2023-06-09T04:39:41.979677+0000","last_peered":"2023-06-09T04:39:41.979677+0000","last_clean":"2023-06-09T04:39:41.979677+0000","last_became_active":"2023-06-09T04:39:41.002540+0000","last_became_peered":"2023-06-09T04:39:41.002540+0000","last_unstale":"2023-06-09T04:39:41.979677+0000","last_undegraded":"2023-06-09T04:39:41.979677+0000","last_fullsized":"2023-06-09T04:39:41.979677+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:58.300999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979370+0000","last_change":"2023-06-09T04:39:41.003505+0000","last_active":"2023-06-09T04:39:41.979370+0000","last_peered":"2023-06-09T04:39:41.979370+0000","last_clean":"2023-06-09T04:39:41.979370+0000","last_became_active":"2023-06-09T04:39:41.003036+0000","last_became_peered":"2023-06-09T04:39:41.003036+0000","last_unstale":"2023-06-09T04:39:41.979370+0000","last_undegraded":"2023-06-09T04:39:41.979370+0000","last_fullsized":"2023-06-09T04:39:41.979370+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:53.963967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416800+0000","last_change":"2023-06-09T04:39:41.002034+0000","last_active":"2023-06-09T04:39:42.416800+0000","last_peered":"2023-06-09T04:39:42.416800+0000","last_clean":"2023-06-09T04:39:42.416800+0000","last_became_active":"2023-06-09T04:39:41.001685+0000","last_became_peered":"2023-06-09T04:39:41.001685+0000","last_unstale":"2023-06-09T04:39:42.416800+0000","last_undegraded":"2023-06-09T04:39:42.416800+0000","last_fullsized":"2023-06-09T04:39:42.416800+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413909+0000","last_change":"2023-06-09T04:39:40.989865+0000","last_active":"2023-06-09T04:39:42.413909+0000","last_peered":"2023-06-09T04:39:42.413909+0000","last_clean":"2023-06-09T04:39:42.413909+0000","last_became_active":"2023-06-09T04:39:40.989566+0000","last_became_peered":"2023-06-09T04:39:40.989566+0000","last_unstale":"2023-06-09T04:39:42.413909+0000","last_undegraded":"2023-06-09T04:39:42.413909+0000","last_fullsized":"2023-06-09T04:39:42.413909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412752+0000","last_change":"2023-06-09T04:39:41.006607+0000","last_active":"2023-06-09T04:39:42.412752+0000","last_peered":"2023-06-09T04:39:42.412752+0000","last_clean":"2023-06-09T04:39:42.412752+0000","last_became_active":"2023-06-09T04:39:41.006216+0000","last_became_peered":"2023-06-09T04:39:41.006216+0000","last_unstale":"2023-06-09T04:39:42.412752+0000","last_undegraded":"2023-06-09T04:39:42.412752+0000","last_fullsized":"2023-06-09T04:39:42.412752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:57.228151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980740+0000","last_change":"2023-06-09T04:39:40.992032+0000","last_active":"2023-06-09T04:39:41.980740+0000","last_peered":"2023-06-09T04:39:41.980740+0000","last_clean":"2023-06-09T04:39:41.980740+0000","last_became_active":"2023-06-09T04:39:40.990837+0000","last_became_peered":"2023-06-09T04:39:40.990837+0000","last_unstale":"2023-06-09T04:39:41.980740+0000","last_undegraded":"2023-06-09T04:39:41.980740+0000","last_fullsized":"2023-06-09T04:39:41.980740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:42.638120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414847+0000","last_change":"2023-06-09T04:39:41.009866+0000","last_active":"2023-06-09T04:39:42.414847+0000","last_peered":"2023-06-09T04:39:42.414847+0000","last_clean":"2023-06-09T04:39:42.414847+0000","last_became_active":"2023-06-09T04:39:41.009511+0000","last_became_peered":"2023-06-09T04:39:41.009511+0000","last_unstale":"2023-06-09T04:39:42.414847+0000","last_undegraded":"2023-06-09T04:39:42.414847+0000","last_fullsized":"2023-06-09T04:39:42.414847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:20.985140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413964+0000","last_change":"2023-06-09T04:39:40.604498+0000","last_active":"2023-06-09T04:39:42.413964+0000","last_peered":"2023-06-09T04:39:42.413964+0000","last_clean":"2023-06-09T04:39:42.413964+0000","last_became_active":"2023-06-09T04:39:40.603788+0000","last_became_peered":"2023-06-09T04:39:40.603788+0000","last_unstale":"2023-06-09T04:39:42.413964+0000","last_undegraded":"2023-06-09T04:39:42.413964+0000","last_fullsized":"2023-06-09T04:39:42.413964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:44.667395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.417178+0000","last_change":"2023-06-09T04:39:41.007158+0000","last_active":"2023-06-09T04:39:42.417178+0000","last_peered":"2023-06-09T04:39:42.417178+0000","last_clean":"2023-06-09T04:39:42.417178+0000","last_became_active":"2023-06-09T04:39:41.006639+0000","last_became_peered":"2023-06-09T04:39:41.006639+0000","last_unstale":"2023-06-09T04:39:42.417178+0000","last_undegraded":"2023-06-09T04:39:42.417178+0000","last_fullsized":"2023-06-09T04:39:42.417178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979820+0000","last_change":"2023-06-09T04:39:40.605078+0000","last_active":"2023-06-09T04:39:41.979820+0000","last_peered":"2023-06-09T04:39:41.979820+0000","last_clean":"2023-06-09T04:39:41.979820+0000","last_became_active":"2023-06-09T04:39:40.604691+0000","last_became_peered":"2023-06-09T04:39:40.604691+0000","last_unstale":"2023-06-09T04:39:41.979820+0000","last_undegraded":"2023-06-09T04:39:41.979820+0000","last_fullsized":"2023-06-09T04:39:41.979820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:02.483438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414524+0000","last_change":"2023-06-09T04:39:41.011596+0000","last_active":"2023-06-09T04:39:42.414524+0000","last_peered":"2023-06-09T04:39:42.414524+0000","last_clean":"2023-06-09T04:39:42.414524+0000","last_became_active":"2023-06-09T04:39:41.011240+0000","last_became_peered":"2023-06-09T04:39:41.011240+0000","last_unstale":"2023-06-09T04:39:42.414524+0000","last_undegraded":"2023-06-09T04:39:42.414524+0000","last_fullsized":"2023-06-09T04:39:42.414524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:28:32.741830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413559+0000","last_change":"2023-06-09T04:39:40.619765+0000","last_active":"2023-06-09T04:39:42.413559+0000","last_peered":"2023-06-09T04:39:42.413559+0000","last_clean":"2023-06-09T04:39:42.413559+0000","last_became_active":"2023-06-09T04:39:40.618833+0000","last_became_peered":"2023-06-09T04:39:40.618833+0000","last_unstale":"2023-06-09T04:39:42.413559+0000","last_undegraded":"2023-06-09T04:39:42.413559+0000","last_fullsized":"2023-06-09T04:39:42.413559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983209+0000","last_change":"2023-06-09T04:39:40.994023+0000","last_active":"2023-06-09T04:39:41.983209+0000","last_peered":"2023-06-09T04:39:41.983209+0000","last_clean":"2023-06-09T04:39:41.983209+0000","last_became_active":"2023-06-09T04:39:40.993695+0000","last_became_peered":"2023-06-09T04:39:40.993695+0000","last_unstale":"2023-06-09T04:39:41.983209+0000","last_undegraded":"2023-06-09T04:39:41.983209+0000","last_fullsized":"2023-06-09T04:39:41.983209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:25.004879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979442+0000","last_change":"2023-06-09T04:39:40.605638+0000","last_active":"2023-06-09T04:39:41.979442+0000","last_peered":"2023-06-09T04:39:41.979442+0000","last_clean":"2023-06-09T04:39:41.979442+0000","last_became_active":"2023-06-09T04:39:40.604752+0000","last_became_peered":"2023-06-09T04:39:40.604752+0000","last_unstale":"2023-06-09T04:39:41.979442+0000","last_undegraded":"2023-06-09T04:39:41.979442+0000","last_fullsized":"2023-06-09T04:39:41.979442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:38.672735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978921+0000","last_change":"2023-06-09T04:39:40.988659+0000","last_active":"2023-06-09T04:39:41.978921+0000","last_peered":"2023-06-09T04:39:41.978921+0000","last_clean":"2023-06-09T04:39:41.978921+0000","last_became_active":"2023-06-09T04:39:40.988316+0000","last_became_peered":"2023-06-09T04:39:40.988316+0000","last_unstale":"2023-06-09T04:39:41.978921+0000","last_undegraded":"2023-06-09T04:39:41.978921+0000","last_fullsized":"2023-06-09T04:39:41.978921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:45.973226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413633+0000","last_change":"2023-06-09T04:39:40.607221+0000","last_active":"2023-06-09T04:39:42.413633+0000","last_peered":"2023-06-09T04:39:42.413633+0000","last_clean":"2023-06-09T04:39:42.413633+0000","last_became_active":"2023-06-09T04:39:40.606560+0000","last_became_peered":"2023-06-09T04:39:40.606560+0000","last_unstale":"2023-06-09T04:39:42.413633+0000","last_undegraded":"2023-06-09T04:39:42.413633+0000","last_fullsized":"2023-06-09T04:39:42.413633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:32.670818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981235+0000","last_change":"2023-06-09T04:39:41.000847+0000","last_active":"2023-06-09T04:39:41.981235+0000","last_peered":"2023-06-09T04:39:41.981235+0000","last_clean":"2023-06-09T04:39:41.981235+0000","last_became_active":"2023-06-09T04:39:41.000365+0000","last_became_peered":"2023-06-09T04:39:41.000365+0000","last_unstale":"2023-06-09T04:39:41.981235+0000","last_undegraded":"2023-06-09T04:39:41.981235+0000","last_fullsized":"2023-06-09T04:39:41.981235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:20:10.726424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979275+0000","last_change":"2023-06-09T04:39:40.620806+0000","last_active":"2023-06-09T04:39:41.979275+0000","last_peered":"2023-06-09T04:39:41.979275+0000","last_clean":"2023-06-09T04:39:41.979275+0000","last_became_active":"2023-06-09T04:39:40.620038+0000","last_became_peered":"2023-06-09T04:39:40.620038+0000","last_unstale":"2023-06-09T04:39:41.979275+0000","last_undegraded":"2023-06-09T04:39:41.979275+0000","last_fullsized":"2023-06-09T04:39:41.979275+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:17.169645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980180+0000","last_change":"2023-06-09T04:39:40.982117+0000","last_active":"2023-06-09T04:39:41.980180+0000","last_peered":"2023-06-09T04:39:41.980180+0000","last_clean":"2023-06-09T04:39:41.980180+0000","last_became_active":"2023-06-09T04:39:40.981343+0000","last_became_peered":"2023-06-09T04:39:40.981343+0000","last_unstale":"2023-06-09T04:39:41.980180+0000","last_undegraded":"2023-06-09T04:39:41.980180+0000","last_fullsized":"2023-06-09T04:39:41.980180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:39.601908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415964+0000","last_change":"2023-06-09T04:39:40.624719+0000","last_active":"2023-06-09T04:39:42.415964+0000","last_peered":"2023-06-09T04:39:42.415964+0000","last_clean":"2023-06-09T04:39:42.415964+0000","last_became_active":"2023-06-09T04:39:40.624153+0000","last_became_peered":"2023-06-09T04:39:40.624153+0000","last_unstale":"2023-06-09T04:39:42.415964+0000","last_undegraded":"2023-06-09T04:39:42.415964+0000","last_fullsized":"2023-06-09T04:39:42.415964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:44:00.342333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979094+0000","last_change":"2023-06-09T04:39:41.007604+0000","last_active":"2023-06-09T04:39:41.979094+0000","last_peered":"2023-06-09T04:39:41.979094+0000","last_clean":"2023-06-09T04:39:41.979094+0000","last_became_active":"2023-06-09T04:39:41.007116+0000","last_became_peered":"2023-06-09T04:39:41.007116+0000","last_unstale":"2023-06-09T04:39:41.979094+0000","last_undegraded":"2023-06-09T04:39:41.979094+0000","last_fullsized":"2023-06-09T04:39:41.979094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:45.507184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980296+0000","last_change":"2023-06-09T04:39:40.624170+0000","last_active":"2023-06-09T04:39:41.980296+0000","last_peered":"2023-06-09T04:39:41.980296+0000","last_clean":"2023-06-09T04:39:41.980296+0000","last_became_active":"2023-06-09T04:39:40.623502+0000","last_became_peered":"2023-06-09T04:39:40.623502+0000","last_unstale":"2023-06-09T04:39:41.980296+0000","last_undegraded":"2023-06-09T04:39:41.980296+0000","last_fullsized":"2023-06-09T04:39:41.980296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:37.253525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415330+0000","last_change":"2023-06-09T04:39:40.991307+0000","last_active":"2023-06-09T04:39:42.415330+0000","last_peered":"2023-06-09T04:39:42.415330+0000","last_clean":"2023-06-09T04:39:42.415330+0000","last_became_active":"2023-06-09T04:39:40.991009+0000","last_became_peered":"2023-06-09T04:39:40.991009+0000","last_unstale":"2023-06-09T04:39:42.415330+0000","last_undegraded":"2023-06-09T04:39:42.415330+0000","last_fullsized":"2023-06-09T04:39:42.415330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:25:32.369003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414341+0000","last_change":"2023-06-09T04:39:40.609952+0000","last_active":"2023-06-09T04:39:42.414341+0000","last_peered":"2023-06-09T04:39:42.414341+0000","last_clean":"2023-06-09T04:39:42.414341+0000","last_became_active":"2023-06-09T04:39:40.609555+0000","last_became_peered":"2023-06-09T04:39:40.609555+0000","last_unstale":"2023-06-09T04:39:42.414341+0000","last_undegraded":"2023-06-09T04:39:42.414341+0000","last_fullsized":"2023-06-09T04:39:42.414341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:21:42.898956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414332+0000","last_change":"2023-06-09T04:39:40.983352+0000","last_active":"2023-06-09T04:39:42.414332+0000","last_peered":"2023-06-09T04:39:42.414332+0000","last_clean":"2023-06-09T04:39:42.414332+0000","last_became_active":"2023-06-09T04:39:40.983017+0000","last_became_peered":"2023-06-09T04:39:40.983017+0000","last_unstale":"2023-06-09T04:39:42.414332+0000","last_undegraded":"2023-06-09T04:39:42.414332+0000","last_fullsized":"2023-06-09T04:39:42.414332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:29:22.543858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981882+0000","last_change":"2023-06-09T04:39:40.597631+0000","last_active":"2023-06-09T04:39:41.981882+0000","last_peered":"2023-06-09T04:39:41.981882+0000","last_clean":"2023-06-09T04:39:41.981882+0000","last_became_active":"2023-06-09T04:39:40.596933+0000","last_became_peered":"2023-06-09T04:39:40.596933+0000","last_unstale":"2023-06-09T04:39:41.981882+0000","last_undegraded":"2023-06-09T04:39:41.981882+0000","last_fullsized":"2023-06-09T04:39:41.981882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:09:34.655136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982771+0000","last_change":"2023-06-09T04:39:41.000161+0000","last_active":"2023-06-09T04:39:41.982771+0000","last_peered":"2023-06-09T04:39:41.982771+0000","last_clean":"2023-06-09T04:39:41.982771+0000","last_became_active":"2023-06-09T04:39:40.999789+0000","last_became_peered":"2023-06-09T04:39:40.999789+0000","last_unstale":"2023-06-09T04:39:41.982771+0000","last_undegraded":"2023-06-09T04:39:41.982771+0000","last_fullsized":"2023-06-09T04:39:41.982771+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414775+0000","last_change":"2023-06-09T04:39:40.619981+0000","last_active":"2023-06-09T04:39:42.414775+0000","last_peered":"2023-06-09T04:39:42.414775+0000","last_clean":"2023-06-09T04:39:42.414775+0000","last_became_active":"2023-06-09T04:39:40.619566+0000","last_became_peered":"2023-06-09T04:39:40.619566+0000","last_unstale":"2023-06-09T04:39:42.414775+0000","last_undegraded":"2023-06-09T04:39:42.414775+0000","last_fullsized":"2023-06-09T04:39:42.414775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:23:23.487006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979615+0000","last_change":"2023-06-09T04:39:41.000297+0000","last_active":"2023-06-09T04:39:41.979615+0000","last_peered":"2023-06-09T04:39:41.979615+0000","last_clean":"2023-06-09T04:39:41.979615+0000","last_became_active":"2023-06-09T04:39:40.999612+0000","last_became_peered":"2023-06-09T04:39:40.999612+0000","last_unstale":"2023-06-09T04:39:41.979615+0000","last_undegraded":"2023-06-09T04:39:41.979615+0000","last_fullsized":"2023-06-09T04:39:41.979615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:19:48.372401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982023+0000","last_change":"2023-06-09T04:39:40.611518+0000","last_active":"2023-06-09T04:39:41.982023+0000","last_peered":"2023-06-09T04:39:41.982023+0000","last_clean":"2023-06-09T04:39:41.982023+0000","last_became_active":"2023-06-09T04:39:40.610734+0000","last_became_peered":"2023-06-09T04:39:40.610734+0000","last_unstale":"2023-06-09T04:39:41.982023+0000","last_undegraded":"2023-06-09T04:39:41.982023+0000","last_fullsized":"2023-06-09T04:39:41.982023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:30:44.123651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413966+0000","last_change":"2023-06-09T04:39:40.995808+0000","last_active":"2023-06-09T04:39:42.413966+0000","last_peered":"2023-06-09T04:39:42.413966+0000","last_clean":"2023-06-09T04:39:42.413966+0000","last_became_active":"2023-06-09T04:39:40.995324+0000","last_became_peered":"2023-06-09T04:39:40.995324+0000","last_unstale":"2023-06-09T04:39:42.413966+0000","last_undegraded":"2023-06-09T04:39:42.413966+0000","last_fullsized":"2023-06-09T04:39:42.413966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:34:23.314771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414946+0000","last_change":"2023-06-09T04:39:40.612040+0000","last_active":"2023-06-09T04:39:42.414946+0000","last_peered":"2023-06-09T04:39:42.414946+0000","last_clean":"2023-06-09T04:39:42.414946+0000","last_became_active":"2023-06-09T04:39:40.611172+0000","last_became_peered":"2023-06-09T04:39:40.611172+0000","last_unstale":"2023-06-09T04:39:42.414946+0000","last_undegraded":"2023-06-09T04:39:42.414946+0000","last_fullsized":"2023-06-09T04:39:42.414946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:38.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414617+0000","last_change":"2023-06-09T04:39:40.995651+0000","last_active":"2023-06-09T04:39:42.414617+0000","last_peered":"2023-06-09T04:39:42.414617+0000","last_clean":"2023-06-09T04:39:42.414617+0000","last_became_active":"2023-06-09T04:39:40.994999+0000","last_became_peered":"2023-06-09T04:39:40.994999+0000","last_unstale":"2023-06-09T04:39:42.414617+0000","last_undegraded":"2023-06-09T04:39:42.414617+0000","last_fullsized":"2023-06-09T04:39:42.414617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:13:37.121110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416351+0000","last_change":"2023-06-09T04:39:40.617532+0000","last_active":"2023-06-09T04:39:42.416351+0000","last_peered":"2023-06-09T04:39:42.416351+0000","last_clean":"2023-06-09T04:39:42.416351+0000","last_became_active":"2023-06-09T04:39:40.615774+0000","last_became_peered":"2023-06-09T04:39:40.615774+0000","last_unstale":"2023-06-09T04:39:42.416351+0000","last_undegraded":"2023-06-09T04:39:42.416351+0000","last_fullsized":"2023-06-09T04:39:42.416351+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414139+0000","last_change":"2023-06-09T04:39:41.012348+0000","last_active":"2023-06-09T04:39:42.414139+0000","last_peered":"2023-06-09T04:39:42.414139+0000","last_clean":"2023-06-09T04:39:42.414139+0000","last_became_active":"2023-06-09T04:39:41.011938+0000","last_became_peered":"2023-06-09T04:39:41.011938+0000","last_unstale":"2023-06-09T04:39:42.414139+0000","last_undegraded":"2023-06-09T04:39:42.414139+0000","last_fullsized":"2023-06-09T04:39:42.414139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:18:48.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412936+0000","last_change":"2023-06-09T04:39:40.607242+0000","last_active":"2023-06-09T04:39:42.412936+0000","last_peered":"2023-06-09T04:39:42.412936+0000","last_clean":"2023-06-09T04:39:42.412936+0000","last_became_active":"2023-06-09T04:39:40.606331+0000","last_became_peered":"2023-06-09T04:39:40.606331+0000","last_unstale":"2023-06-09T04:39:42.412936+0000","last_undegraded":"2023-06-09T04:39:42.412936+0000","last_fullsized":"2023-06-09T04:39:42.412936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412958+0000","last_change":"2023-06-09T04:39:40.993917+0000","last_active":"2023-06-09T04:39:42.412958+0000","last_peered":"2023-06-09T04:39:42.412958+0000","last_clean":"2023-06-09T04:39:42.412958+0000","last_became_active":"2023-06-09T04:39:40.993317+0000","last_became_peered":"2023-06-09T04:39:40.993317+0000","last_unstale":"2023-06-09T04:39:42.412958+0000","last_undegraded":"2023-06-09T04:39:42.412958+0000","last_fullsized":"2023-06-09T04:39:42.412958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:28.568155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980348+0000","last_change":"2023-06-09T04:39:40.594820+0000","last_active":"2023-06-09T04:39:41.980348+0000","last_peered":"2023-06-09T04:39:41.980348+0000","last_clean":"2023-06-09T04:39:41.980348+0000","last_became_active":"2023-06-09T04:39:40.594031+0000","last_became_peered":"2023-06-09T04:39:40.594031+0000","last_unstale":"2023-06-09T04:39:41.980348+0000","last_undegraded":"2023-06-09T04:39:41.980348+0000","last_fullsized":"2023-06-09T04:39:41.980348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:15.340144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415131+0000","last_change":"2023-06-09T04:39:40.998920+0000","last_active":"2023-06-09T04:39:42.415131+0000","last_peered":"2023-06-09T04:39:42.415131+0000","last_clean":"2023-06-09T04:39:42.415131+0000","last_became_active":"2023-06-09T04:39:40.998646+0000","last_became_peered":"2023-06-09T04:39:40.998646+0000","last_unstale":"2023-06-09T04:39:42.415131+0000","last_undegraded":"2023-06-09T04:39:42.415131+0000","last_fullsized":"2023-06-09T04:39:42.415131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:38.068463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983526+0000","last_change":"2023-06-09T04:39:40.625632+0000","last_active":"2023-06-09T04:39:41.983526+0000","last_peered":"2023-06-09T04:39:41.983526+0000","last_clean":"2023-06-09T04:39:41.983526+0000","last_became_active":"2023-06-09T04:39:40.625013+0000","last_became_peered":"2023-06-09T04:39:40.625013+0000","last_unstale":"2023-06-09T04:39:41.983526+0000","last_undegraded":"2023-06-09T04:39:41.983526+0000","last_fullsized":"2023-06-09T04:39:41.983526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:47:39.355242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414848+0000","last_change":"2023-06-09T04:39:41.010054+0000","last_active":"2023-06-09T04:39:42.414848+0000","last_peered":"2023-06-09T04:39:42.414848+0000","last_clean":"2023-06-09T04:39:42.414848+0000","last_became_active":"2023-06-09T04:39:41.009721+0000","last_became_peered":"2023-06-09T04:39:41.009721+0000","last_unstale":"2023-06-09T04:39:42.414848+0000","last_undegraded":"2023-06-09T04:39:42.414848+0000","last_fullsized":"2023-06-09T04:39:42.414848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:06.660210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414826+0000","last_change":"2023-06-09T04:39:40.616701+0000","last_active":"2023-06-09T04:39:42.414826+0000","last_peered":"2023-06-09T04:39:42.414826+0000","last_clean":"2023-06-09T04:39:42.414826+0000","last_became_active":"2023-06-09T04:39:40.615708+0000","last_became_peered":"2023-06-09T04:39:40.615708+0000","last_unstale":"2023-06-09T04:39:42.414826+0000","last_undegraded":"2023-06-09T04:39:42.414826+0000","last_fullsized":"2023-06-09T04:39:42.414826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:16:14.228577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414779+0000","last_change":"2023-06-09T04:39:40.997482+0000","last_active":"2023-06-09T04:39:42.414779+0000","last_peered":"2023-06-09T04:39:42.414779+0000","last_clean":"2023-06-09T04:39:42.414779+0000","last_became_active":"2023-06-09T04:39:40.996995+0000","last_became_peered":"2023-06-09T04:39:40.996995+0000","last_unstale":"2023-06-09T04:39:42.414779+0000","last_undegraded":"2023-06-09T04:39:42.414779+0000","last_fullsized":"2023-06-09T04:39:42.414779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:19.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414455+0000","last_change":"2023-06-09T04:39:40.595975+0000","last_active":"2023-06-09T04:39:42.414455+0000","last_peered":"2023-06-09T04:39:42.414455+0000","last_clean":"2023-06-09T04:39:42.414455+0000","last_became_active":"2023-06-09T04:39:40.595583+0000","last_became_peered":"2023-06-09T04:39:40.595583+0000","last_unstale":"2023-06-09T04:39:42.414455+0000","last_undegraded":"2023-06-09T04:39:42.414455+0000","last_fullsized":"2023-06-09T04:39:42.414455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:17:14.690457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414084+0000","last_change":"2023-06-09T04:39:41.011755+0000","last_active":"2023-06-09T04:39:42.414084+0000","last_peered":"2023-06-09T04:39:42.414084+0000","last_clean":"2023-06-09T04:39:42.414084+0000","last_became_active":"2023-06-09T04:39:41.011362+0000","last_became_peered":"2023-06-09T04:39:41.011362+0000","last_unstale":"2023-06-09T04:39:42.414084+0000","last_undegraded":"2023-06-09T04:39:42.414084+0000","last_fullsized":"2023-06-09T04:39:42.414084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:54.909398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413062+0000","last_change":"2023-06-09T04:39:40.608570+0000","last_active":"2023-06-09T04:39:42.413062+0000","last_peered":"2023-06-09T04:39:42.413062+0000","last_clean":"2023-06-09T04:39:42.413062+0000","last_became_active":"2023-06-09T04:39:40.607567+0000","last_became_peered":"2023-06-09T04:39:40.607567+0000","last_unstale":"2023-06-09T04:39:42.413062+0000","last_undegraded":"2023-06-09T04:39:42.413062+0000","last_fullsized":"2023-06-09T04:39:42.413062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980707+0000","last_change":"2023-06-09T04:39:41.005808+0000","last_active":"2023-06-09T04:39:41.980707+0000","last_peered":"2023-06-09T04:39:41.980707+0000","last_clean":"2023-06-09T04:39:41.980707+0000","last_became_active":"2023-06-09T04:39:41.005505+0000","last_became_peered":"2023-06-09T04:39:41.005505+0000","last_unstale":"2023-06-09T04:39:41.980707+0000","last_undegraded":"2023-06-09T04:39:41.980707+0000","last_fullsized":"2023-06-09T04:39:41.980707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:08.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982312+0000","last_change":"2023-06-09T04:39:40.602174+0000","last_active":"2023-06-09T04:39:41.982312+0000","last_peered":"2023-06-09T04:39:41.982312+0000","last_clean":"2023-06-09T04:39:41.982312+0000","last_became_active":"2023-06-09T04:39:40.601339+0000","last_became_peered":"2023-06-09T04:39:40.601339+0000","last_unstale":"2023-06-09T04:39:41.982312+0000","last_undegraded":"2023-06-09T04:39:41.982312+0000","last_fullsized":"2023-06-09T04:39:41.982312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:31:45.907935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413386+0000","last_change":"2023-06-09T04:39:41.006006+0000","last_active":"2023-06-09T04:39:42.413386+0000","last_peered":"2023-06-09T04:39:42.413386+0000","last_clean":"2023-06-09T04:39:42.413386+0000","last_became_active":"2023-06-09T04:39:41.005756+0000","last_became_peered":"2023-06-09T04:39:41.005756+0000","last_unstale":"2023-06-09T04:39:42.413386+0000","last_undegraded":"2023-06-09T04:39:42.413386+0000","last_fullsized":"2023-06-09T04:39:42.413386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416403+0000","last_change":"2023-06-09T04:39:40.615155+0000","last_active":"2023-06-09T04:39:42.416403+0000","last_peered":"2023-06-09T04:39:42.416403+0000","last_clean":"2023-06-09T04:39:42.416403+0000","last_became_active":"2023-06-09T04:39:40.614735+0000","last_became_peered":"2023-06-09T04:39:40.614735+0000","last_unstale":"2023-06-09T04:39:42.416403+0000","last_undegraded":"2023-06-09T04:39:42.416403+0000","last_fullsized":"2023-06-09T04:39:42.416403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980885+0000","last_change":"2023-06-09T04:39:40.993826+0000","last_active":"2023-06-09T04:39:41.980885+0000","last_peered":"2023-06-09T04:39:41.980885+0000","last_clean":"2023-06-09T04:39:41.980885+0000","last_became_active":"2023-06-09T04:39:40.992701+0000","last_became_peered":"2023-06-09T04:39:40.992701+0000","last_unstale":"2023-06-09T04:39:41.980885+0000","last_undegraded":"2023-06-09T04:39:41.980885+0000","last_fullsized":"2023-06-09T04:39:41.980885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:52.880775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980539+0000","last_change":"2023-06-09T04:39:40.601847+0000","last_active":"2023-06-09T04:39:41.980539+0000","last_peered":"2023-06-09T04:39:41.980539+0000","last_clean":"2023-06-09T04:39:41.980539+0000","last_became_active":"2023-06-09T04:39:40.601116+0000","last_became_peered":"2023-06-09T04:39:40.601116+0000","last_unstale":"2023-06-09T04:39:41.980539+0000","last_undegraded":"2023-06-09T04:39:41.980539+0000","last_fullsized":"2023-06-09T04:39:41.980539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:16:36.582040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981457+0000","last_change":"2023-06-09T04:39:40.996654+0000","last_active":"2023-06-09T04:39:41.981457+0000","last_peered":"2023-06-09T04:39:41.981457+0000","last_clean":"2023-06-09T04:39:41.981457+0000","last_became_active":"2023-06-09T04:39:40.995096+0000","last_became_peered":"2023-06-09T04:39:40.995096+0000","last_unstale":"2023-06-09T04:39:41.981457+0000","last_undegraded":"2023-06-09T04:39:41.981457+0000","last_fullsized":"2023-06-09T04:39:41.981457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:47.503555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978689+0000","last_change":"2023-06-09T04:39:40.611511+0000","last_active":"2023-06-09T04:39:41.978689+0000","last_peered":"2023-06-09T04:39:41.978689+0000","last_clean":"2023-06-09T04:39:41.978689+0000","last_became_active":"2023-06-09T04:39:40.611148+0000","last_became_peered":"2023-06-09T04:39:40.611148+0000","last_unstale":"2023-06-09T04:39:41.978689+0000","last_undegraded":"2023-06-09T04:39:41.978689+0000","last_fullsized":"2023-06-09T04:39:41.978689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.510119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981090+0000","last_change":"2023-06-09T04:39:41.005886+0000","last_active":"2023-06-09T04:39:41.981090+0000","last_peered":"2023-06-09T04:39:41.981090+0000","last_clean":"2023-06-09T04:39:41.981090+0000","last_became_active":"2023-06-09T04:39:41.005622+0000","last_became_peered":"2023-06-09T04:39:41.005622+0000","last_unstale":"2023-06-09T04:39:41.981090+0000","last_undegraded":"2023-06-09T04:39:41.981090+0000","last_fullsized":"2023-06-09T04:39:41.981090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:49.238912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416950+0000","last_change":"2023-06-09T04:39:40.627150+0000","last_active":"2023-06-09T04:39:42.416950+0000","last_peered":"2023-06-09T04:39:42.416950+0000","last_clean":"2023-06-09T04:39:42.416950+0000","last_became_active":"2023-06-09T04:39:40.626838+0000","last_became_peered":"2023-06-09T04:39:40.626838+0000","last_unstale":"2023-06-09T04:39:42.416950+0000","last_undegraded":"2023-06-09T04:39:42.416950+0000","last_fullsized":"2023-06-09T04:39:42.416950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979730+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:39:41.979730+0000","last_peered":"2023-06-09T04:39:41.979730+0000","last_clean":"2023-06-09T04:39:41.979730+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:39:41.979730+0000","last_undegraded":"2023-06-09T04:39:41.979730+0000","last_fullsized":"2023-06-09T04:39:41.979730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:08:53.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982535+0000","last_change":"2023-06-09T04:39:40.994885+0000","last_active":"2023-06-09T04:39:41.982535+0000","last_peered":"2023-06-09T04:39:41.982535+0000","last_clean":"2023-06-09T04:39:41.982535+0000","last_became_active":"2023-06-09T04:39:40.993574+0000","last_became_peered":"2023-06-09T04:39:40.993574+0000","last_unstale":"2023-06-09T04:39:41.982535+0000","last_undegraded":"2023-06-09T04:39:41.982535+0000","last_fullsized":"2023-06-09T04:39:41.982535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:39:50.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979037+0000","last_change":"2023-06-09T04:39:40.615348+0000","last_active":"2023-06-09T04:39:41.979037+0000","last_peered":"2023-06-09T04:39:41.979037+0000","last_clean":"2023-06-09T04:39:41.979037+0000","last_became_active":"2023-06-09T04:39:40.614915+0000","last_became_peered":"2023-06-09T04:39:40.614915+0000","last_unstale":"2023-06-09T04:39:41.979037+0000","last_undegraded":"2023-06-09T04:39:41.979037+0000","last_fullsized":"2023-06-09T04:39:41.979037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:16:05.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981930+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:39:41.981930+0000","last_peered":"2023-06-09T04:39:41.981930+0000","last_clean":"2023-06-09T04:39:41.981930+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:39:41.981930+0000","last_undegraded":"2023-06-09T04:39:41.981930+0000","last_fullsized":"2023-06-09T04:39:41.981930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413267+0000","last_change":"2023-06-09T04:39:41.002863+0000","last_active":"2023-06-09T04:39:42.413267+0000","last_peered":"2023-06-09T04:39:42.413267+0000","last_clean":"2023-06-09T04:39:42.413267+0000","last_became_active":"2023-06-09T04:39:41.002424+0000","last_became_peered":"2023-06-09T04:39:41.002424+0000","last_unstale":"2023-06-09T04:39:42.413267+0000","last_undegraded":"2023-06-09T04:39:42.413267+0000","last_fullsized":"2023-06-09T04:39:42.413267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:15:39.739410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414346+0000","last_change":"2023-06-09T04:39:40.614551+0000","last_active":"2023-06-09T04:39:42.414346+0000","last_peered":"2023-06-09T04:39:42.414346+0000","last_clean":"2023-06-09T04:39:42.414346+0000","last_became_active":"2023-06-09T04:39:40.613760+0000","last_became_peered":"2023-06-09T04:39:40.613760+0000","last_unstale":"2023-06-09T04:39:42.414346+0000","last_undegraded":"2023-06-09T04:39:42.414346+0000","last_fullsized":"2023-06-09T04:39:42.414346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:02.676701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979890+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:39:41.979890+0000","last_peered":"2023-06-09T04:39:41.979890+0000","last_clean":"2023-06-09T04:39:41.979890+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:39:41.979890+0000","last_undegraded":"2023-06-09T04:39:41.979890+0000","last_fullsized":"2023-06-09T04:39:41.979890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:09.925082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413319+0000","last_change":"2023-06-09T04:39:40.993661+0000","last_active":"2023-06-09T04:39:42.413319+0000","last_peered":"2023-06-09T04:39:42.413319+0000","last_clean":"2023-06-09T04:39:42.413319+0000","last_became_active":"2023-06-09T04:39:40.992879+0000","last_became_peered":"2023-06-09T04:39:40.992879+0000","last_unstale":"2023-06-09T04:39:42.413319+0000","last_undegraded":"2023-06-09T04:39:42.413319+0000","last_fullsized":"2023-06-09T04:39:42.413319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414078+0000","last_change":"2023-06-09T04:39:40.615594+0000","last_active":"2023-06-09T04:39:42.414078+0000","last_peered":"2023-06-09T04:39:42.414078+0000","last_clean":"2023-06-09T04:39:42.414078+0000","last_became_active":"2023-06-09T04:39:40.614956+0000","last_became_peered":"2023-06-09T04:39:40.614956+0000","last_unstale":"2023-06-09T04:39:42.414078+0000","last_undegraded":"2023-06-09T04:39:42.414078+0000","last_fullsized":"2023-06-09T04:39:42.414078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:16.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982818+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:39:41.982818+0000","last_peered":"2023-06-09T04:39:41.982818+0000","last_clean":"2023-06-09T04:39:41.982818+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:39:41.982818+0000","last_undegraded":"2023-06-09T04:39:41.982818+0000","last_fullsized":"2023-06-09T04:39:41.982818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:05.270452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979647+0000","last_change":"2023-06-09T04:39:41.005826+0000","last_active":"2023-06-09T04:39:41.979647+0000","last_peered":"2023-06-09T04:39:41.979647+0000","last_clean":"2023-06-09T04:39:41.979647+0000","last_became_active":"2023-06-09T04:39:41.005376+0000","last_became_peered":"2023-06-09T04:39:41.005376+0000","last_unstale":"2023-06-09T04:39:41.979647+0000","last_undegraded":"2023-06-09T04:39:41.979647+0000","last_fullsized":"2023-06-09T04:39:41.979647+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:29:39.223258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983176+0000","last_change":"2023-06-09T04:39:40.623724+0000","last_active":"2023-06-09T04:39:41.983176+0000","last_peered":"2023-06-09T04:39:41.983176+0000","last_clean":"2023-06-09T04:39:41.983176+0000","last_became_active":"2023-06-09T04:39:40.622846+0000","last_became_peered":"2023-06-09T04:39:40.622846+0000","last_unstale":"2023-06-09T04:39:41.983176+0000","last_undegraded":"2023-06-09T04:39:41.983176+0000","last_fullsized":"2023-06-09T04:39:41.983176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:36.849855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979117+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:39:41.979117+0000","last_peered":"2023-06-09T04:39:41.979117+0000","last_clean":"2023-06-09T04:39:41.979117+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:39:41.979117+0000","last_undegraded":"2023-06-09T04:39:41.979117+0000","last_fullsized":"2023-06-09T04:39:41.979117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:31.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981962+0000","last_change":"2023-06-09T04:39:40.982461+0000","last_active":"2023-06-09T04:39:41.981962+0000","last_peered":"2023-06-09T04:39:41.981962+0000","last_clean":"2023-06-09T04:39:41.981962+0000","last_became_active":"2023-06-09T04:39:40.981948+0000","last_became_peered":"2023-06-09T04:39:40.981948+0000","last_unstale":"2023-06-09T04:39:41.981962+0000","last_undegraded":"2023-06-09T04:39:41.981962+0000","last_fullsized":"2023-06-09T04:39:41.981962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:38.078169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416336+0000","last_change":"2023-06-09T04:39:40.611505+0000","last_active":"2023-06-09T04:39:42.416336+0000","last_peered":"2023-06-09T04:39:42.416336+0000","last_clean":"2023-06-09T04:39:42.416336+0000","last_became_active":"2023-06-09T04:39:40.609878+0000","last_became_peered":"2023-06-09T04:39:40.609878+0000","last_unstale":"2023-06-09T04:39:42.416336+0000","last_undegraded":"2023-06-09T04:39:42.416336+0000","last_fullsized":"2023-06-09T04:39:42.416336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:56.216461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414000+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:39:42.414000+0000","last_peered":"2023-06-09T04:39:42.414000+0000","last_clean":"2023-06-09T04:39:42.414000+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:39:42.414000+0000","last_undegraded":"2023-06-09T04:39:42.414000+0000","last_fullsized":"2023-06-09T04:39:42.414000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:40.493562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979829+0000","last_change":"2023-06-09T04:39:41.000103+0000","last_active":"2023-06-09T04:39:41.979829+0000","last_peered":"2023-06-09T04:39:41.979829+0000","last_clean":"2023-06-09T04:39:41.979829+0000","last_became_active":"2023-06-09T04:39:40.999338+0000","last_became_peered":"2023-06-09T04:39:40.999338+0000","last_unstale":"2023-06-09T04:39:41.979829+0000","last_undegraded":"2023-06-09T04:39:41.979829+0000","last_fullsized":"2023-06-09T04:39:41.979829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:23:54.257011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414718+0000","last_change":"2023-06-09T04:39:40.612529+0000","last_active":"2023-06-09T04:39:42.414718+0000","last_peered":"2023-06-09T04:39:42.414718+0000","last_clean":"2023-06-09T04:39:42.414718+0000","last_became_active":"2023-06-09T04:39:40.611514+0000","last_became_peered":"2023-06-09T04:39:40.611514+0000","last_unstale":"2023-06-09T04:39:42.414718+0000","last_undegraded":"2023-06-09T04:39:42.414718+0000","last_fullsized":"2023-06-09T04:39:42.414718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:30:42.783826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978716+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:39:41.978716+0000","last_peered":"2023-06-09T04:39:41.978716+0000","last_clean":"2023-06-09T04:39:41.978716+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:39:41.978716+0000","last_undegraded":"2023-06-09T04:39:41.978716+0000","last_fullsized":"2023-06-09T04:39:41.978716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:34:18.482882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983194+0000","last_change":"2023-06-09T04:39:40.996130+0000","last_active":"2023-06-09T04:39:41.983194+0000","last_peered":"2023-06-09T04:39:41.983194+0000","last_clean":"2023-06-09T04:39:41.983194+0000","last_became_active":"2023-06-09T04:39:40.995502+0000","last_became_peered":"2023-06-09T04:39:40.995502+0000","last_unstale":"2023-06-09T04:39:41.983194+0000","last_undegraded":"2023-06-09T04:39:41.983194+0000","last_fullsized":"2023-06-09T04:39:41.983194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:03:25.543583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979759+0000","last_change":"2023-06-09T04:39:40.623024+0000","last_active":"2023-06-09T04:39:41.979759+0000","last_peered":"2023-06-09T04:39:41.979759+0000","last_clean":"2023-06-09T04:39:41.979759+0000","last_became_active":"2023-06-09T04:39:40.622717+0000","last_became_peered":"2023-06-09T04:39:40.622717+0000","last_unstale":"2023-06-09T04:39:41.979759+0000","last_undegraded":"2023-06-09T04:39:41.979759+0000","last_fullsized":"2023-06-09T04:39:41.979759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:45:23.910127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978985+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:39:41.978985+0000","last_peered":"2023-06-09T04:39:41.978985+0000","last_clean":"2023-06-09T04:39:41.978985+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:39:41.978985+0000","last_undegraded":"2023-06-09T04:39:41.978985+0000","last_fullsized":"2023-06-09T04:39:41.978985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:40:51.059901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415547+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:39:42.415547+0000","last_peered":"2023-06-09T04:39:42.415547+0000","last_clean":"2023-06-09T04:39:42.415547+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:39:42.415547+0000","last_undegraded":"2023-06-09T04:39:42.415547+0000","last_fullsized":"2023-06-09T04:39:42.415547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:42:17.779240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":479232,"data_stored":207673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.437},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.76600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":1064960,"data_stored":796547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.75}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.80800000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":475136,"data_stored":206781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.745},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":18.922999999999998,"5min":18.922999999999998,"15min":18.922999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.608000000000001,"5min":12.608000000000001,"15min":12.608000000000001},"last":0.87},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.80200000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":199170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.077},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.046}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.755}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.014}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1240000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.1699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":206725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.621},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1470000000000002,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.0869999999999997,"5min":6.0869999999999997,"15min":6.0869999999999997},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.079},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.125}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.052},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":1.226}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":789526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.234},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.4219999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.044},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.347}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.202},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.3080000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.117},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.494}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.375},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.458}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.1479999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":207765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.438},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.749}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.88700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":458752,"data_stored":199226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.63},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.82599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:49.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:39:49.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.618+0000 7f2804f9e640 1 Processor -- start 2023-06-09T04:39:49.623 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f2804f9e640 1 -- start start 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f2804f9e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2800159320 0x7f280015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f2804f9e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f280015d680 0x7f280006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f2804f9e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280015cf10 con 0x7f280015dad0 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f2804f9e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280015a920 con 0x7f280015d680 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f2804f9e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000c81b0 con 0x7f2800159320 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f280015d680 0x7f280006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:49.625 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f280015d680 0x7f280006fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34180/0 (socket says 172.21.15.18:34180) 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 -- 172.21.15.18:0/3480708052 learned_addr learned my addr 172.21.15.18:0/3480708052 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fe59c640 1 --2- 172.21.15.18:0/3480708052 >> v2:172.21.15.81:3300/0 conn(0x7f2800159320 0x7f280015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 -- 172.21.15.18:0/3480708052 >> v2:172.21.15.81:3300/0 conn(0x7f2800159320 msgr2=0x7f280015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 --2- 172.21.15.18:0/3480708052 >> v2:172.21.15.81:3300/0 conn(0x7f2800159320 0x7f280015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 -- 172.21.15.18:0/3480708052 >> v1:172.21.15.81:6789/0 conn(0x7f280015dad0 legacy=0x7f28000692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fdd9b640 1 -- 172.21.15.18:0/3480708052 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000c8490 con 0x7f280015d680 2023-06-09T04:39:49.626 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.622+0000 7f27fe59c640 1 --2- 172.21.15.18:0/3480708052 >> v2:172.21.15.81:3300/0 conn(0x7f2800159320 0x7f280015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f27fdd9b640 1 --2- 172.21.15.18:0/3480708052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015d680 0x7f280006fb60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f280006f610 tx=0x7f27e801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9bfbf8c3080065 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f27fd59a640 1 -- 172.21.15.18:0/3480708052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80ab600 con 0x7f280015d680 2023-06-09T04:39:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f27fd59a640 1 -- 172.21.15.18:0/3480708052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80ab760 con 0x7f280015d680 2023-06-09T04:39:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f27fd59a640 1 -- 172.21.15.18:0/3480708052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80abaf0 con 0x7f280015d680 2023-06-09T04:39:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 -- 172.21.15.18:0/3480708052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015d680 msgr2=0x7f280006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 --2- 172.21.15.18:0/3480708052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015d680 0x7f280006fb60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f280006f610 tx=0x7f27e801c400 comp rx=0 tx=0).stop 2023-06-09T04:39:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 -- 172.21.15.18:0/3480708052 shutdown_connections 2023-06-09T04:39:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 --2- 172.21.15.18:0/3480708052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015d680 0x7f280006fb60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 --2- 172.21.15.18:0/3480708052 >> v2:172.21.15.81:3300/0 conn(0x7f2800159320 0x7f280015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 -- 172.21.15.18:0/3480708052 >> 172.21.15.18:0/3480708052 conn(0x7f28000b0240 msgr2=0x7f28000cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 -- 172.21.15.18:0/3480708052 shutdown_connections 2023-06-09T04:39:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.626+0000 7f2804f9e640 1 -- 172.21.15.18:0/3480708052 wait complete. 2023-06-09T04:39:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 Processor -- start 2023-06-09T04:39:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- start start 2023-06-09T04:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2800159320 0x7f2800145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280015d680 0x7f28001501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 0x7f280014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28001462b0 con 0x7f280015dad0 2023-06-09T04:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2800146070 con 0x7f280015d680 2023-06-09T04:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000b0c90 con 0x7f2800159320 2023-06-09T04:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 0x7f280014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 0x7f280014d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34182/0 (socket says 172.21.15.18:34182) 2023-06-09T04:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 -- 172.21.15.18:0/1737462906 learned_addr learned my addr 172.21.15.18:0/1737462906 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fe59c640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2800159320 0x7f2800145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fdd9b640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280015d680 0x7f28001501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 -- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2800159320 msgr2=0x7f2800145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2800159320 0x7f2800145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 -- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280015d680 msgr2=0x7f28001501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280015d680 0x7f28001501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 -- 172.21.15.18:0/1737462906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80094d0 con 0x7f280015dad0 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fe59c640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2800159320 0x7f2800145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fdd9b640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280015d680 0x7f28001501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27fed9d640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 0x7f280014d120 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f27f800b970 tx=0x7f27f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800cb40 con 0x7f280015dad0 2023-06-09T04:39:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800cca0 con 0x7f280015dad0 2023-06-09T04:39:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000b0f70 con 0x7f280015dad0 2023-06-09T04:39:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8014680 con 0x7f280015dad0 2023-06-09T04:39:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28000b1530 con 0x7f280015dad0 2023-06-09T04:39:49.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28000b1c80 con 0x7f280015dad0 2023-06-09T04:39:49.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27f801d3b0 con 0x7f280015dad0 2023-06-09T04:39:49.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.630+0000 7f27f6ffd640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f27e0066280 0x7f27e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:49.637 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.634+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f27f8083ce0 con 0x7f280015dad0 2023-06-09T04:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.634+0000 7f27fe59c640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f27e0066280 0x7f27e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.634+0000 7f27fe59c640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f27e0066280 0x7f27e0068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f27f0006fd0 tx=0x7f27f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.638+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27f8051020 con 0x7f280015dad0 2023-06-09T04:39:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.786+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 --> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28000704b0 con 0x7f27e0066280 2023-06-09T04:39:49.813 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.810+0000 7f27f6ffd640 1 -- 172.21.15.18:0/1737462906 <== mgr.4100 v2:172.21.15.81:6832/468192741 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309996 (secure 0 0 0) 0x7f27f000a7f0 con 0x7f27e0066280 2023-06-09T04:39:49.815 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:49.818 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f27e0066280 msgr2=0x7f27e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f27e0066280 0x7f27e0068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f27f0006fd0 tx=0x7f27f0008040 comp rx=0 tx=0).stop 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 msgr2=0x7f280014d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 0x7f280014d120 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f27f800b970 tx=0x7f27f800be30 comp rx=0 tx=0).stop 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 shutdown_connections 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f280015dad0 0x7f280014d120 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.819 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f280015d680 0x7f28001501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f27e0066280 0x7f27e0068730 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 --2- 172.21.15.18:0/1737462906 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2800159320 0x7f2800145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 >> 172.21.15.18:0/1737462906 conn(0x7f28000b0240 msgr2=0x7f280006c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 shutdown_connections 2023-06-09T04:39:49.820 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:49.814+0000 7f2804f9e640 1 -- 172.21.15.18:0/1737462906 wait complete. 2023-06-09T04:39:49.836 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-06-09T04:39:49.734052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236872,"kb_used_data":4872,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737848,"statfs":{"total":773094113280,"available":772851556352,"internally_reserved":0,"allocated":4988928,"data_stored":2834332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.769415"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416844+0000","last_change":"2023-06-09T04:39:40.995945+0000","last_active":"2023-06-09T04:39:42.416844+0000","last_peered":"2023-06-09T04:39:42.416844+0000","last_clean":"2023-06-09T04:39:42.416844+0000","last_became_active":"2023-06-09T04:39:40.995027+0000","last_became_peered":"2023-06-09T04:39:40.995027+0000","last_unstale":"2023-06-09T04:39:42.416844+0000","last_undegraded":"2023-06-09T04:39:42.416844+0000","last_fullsized":"2023-06-09T04:39:42.416844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414414+0000","last_change":"2023-06-09T04:39:41.000808+0000","last_active":"2023-06-09T04:39:42.414414+0000","last_peered":"2023-06-09T04:39:42.414414+0000","last_clean":"2023-06-09T04:39:42.414414+0000","last_became_active":"2023-06-09T04:39:41.000151+0000","last_became_peered":"2023-06-09T04:39:41.000151+0000","last_unstale":"2023-06-09T04:39:42.414414+0000","last_undegraded":"2023-06-09T04:39:42.414414+0000","last_fullsized":"2023-06-09T04:39:42.414414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:03.688391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414824+0000","last_change":"2023-06-09T04:39:41.013638+0000","last_active":"2023-06-09T04:39:42.414824+0000","last_peered":"2023-06-09T04:39:42.414824+0000","last_clean":"2023-06-09T04:39:42.414824+0000","last_became_active":"2023-06-09T04:39:41.013242+0000","last_became_peered":"2023-06-09T04:39:41.013242+0000","last_unstale":"2023-06-09T04:39:42.414824+0000","last_undegraded":"2023-06-09T04:39:42.414824+0000","last_fullsized":"2023-06-09T04:39:42.414824+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:54:05.966812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982739+0000","last_change":"2023-06-09T04:39:40.996083+0000","last_active":"2023-06-09T04:39:41.982739+0000","last_peered":"2023-06-09T04:39:41.982739+0000","last_clean":"2023-06-09T04:39:41.982739+0000","last_became_active":"2023-06-09T04:39:40.994844+0000","last_became_peered":"2023-06-09T04:39:40.994844+0000","last_unstale":"2023-06-09T04:39:41.982739+0000","last_undegraded":"2023-06-09T04:39:41.982739+0000","last_fullsized":"2023-06-09T04:39:41.982739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:54.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415989+0000","last_change":"2023-06-09T04:39:41.009003+0000","last_active":"2023-06-09T04:39:42.415989+0000","last_peered":"2023-06-09T04:39:42.415989+0000","last_clean":"2023-06-09T04:39:42.415989+0000","last_became_active":"2023-06-09T04:39:41.008666+0000","last_became_peered":"2023-06-09T04:39:41.008666+0000","last_unstale":"2023-06-09T04:39:42.415989+0000","last_undegraded":"2023-06-09T04:39:42.415989+0000","last_fullsized":"2023-06-09T04:39:42.415989+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:33.257704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413116+0000","last_change":"2023-06-09T04:39:41.005206+0000","last_active":"2023-06-09T04:39:42.413116+0000","last_peered":"2023-06-09T04:39:42.413116+0000","last_clean":"2023-06-09T04:39:42.413116+0000","last_became_active":"2023-06-09T04:39:41.004921+0000","last_became_peered":"2023-06-09T04:39:41.004921+0000","last_unstale":"2023-06-09T04:39:42.413116+0000","last_undegraded":"2023-06-09T04:39:42.413116+0000","last_fullsized":"2023-06-09T04:39:42.413116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978816+0000","last_change":"2023-06-09T04:39:41.002479+0000","last_active":"2023-06-09T04:39:41.978816+0000","last_peered":"2023-06-09T04:39:41.978816+0000","last_clean":"2023-06-09T04:39:41.978816+0000","last_became_active":"2023-06-09T04:39:41.000503+0000","last_became_peered":"2023-06-09T04:39:41.000503+0000","last_unstale":"2023-06-09T04:39:41.978816+0000","last_undegraded":"2023-06-09T04:39:41.978816+0000","last_fullsized":"2023-06-09T04:39:41.978816+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:30:17.933177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980646+0000","last_change":"2023-06-09T04:39:40.995430+0000","last_active":"2023-06-09T04:39:41.980646+0000","last_peered":"2023-06-09T04:39:41.980646+0000","last_clean":"2023-06-09T04:39:41.980646+0000","last_became_active":"2023-06-09T04:39:40.995059+0000","last_became_peered":"2023-06-09T04:39:40.995059+0000","last_unstale":"2023-06-09T04:39:41.980646+0000","last_undegraded":"2023-06-09T04:39:41.980646+0000","last_fullsized":"2023-06-09T04:39:41.980646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:39.356017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413660+0000","last_change":"2023-06-09T04:39:41.011301+0000","last_active":"2023-06-09T04:39:42.413660+0000","last_peered":"2023-06-09T04:39:42.413660+0000","last_clean":"2023-06-09T04:39:42.413660+0000","last_became_active":"2023-06-09T04:39:41.011025+0000","last_became_peered":"2023-06-09T04:39:41.011025+0000","last_unstale":"2023-06-09T04:39:42.413660+0000","last_undegraded":"2023-06-09T04:39:42.413660+0000","last_fullsized":"2023-06-09T04:39:42.413660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981795+0000","last_change":"2023-06-09T04:39:40.980070+0000","last_active":"2023-06-09T04:39:41.981795+0000","last_peered":"2023-06-09T04:39:41.981795+0000","last_clean":"2023-06-09T04:39:41.981795+0000","last_became_active":"2023-06-09T04:39:40.979811+0000","last_became_peered":"2023-06-09T04:39:40.979811+0000","last_unstale":"2023-06-09T04:39:41.981795+0000","last_undegraded":"2023-06-09T04:39:41.981795+0000","last_fullsized":"2023-06-09T04:39:41.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:47.531527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983149+0000","last_change":"2023-06-09T04:39:41.006586+0000","last_active":"2023-06-09T04:39:41.983149+0000","last_peered":"2023-06-09T04:39:41.983149+0000","last_clean":"2023-06-09T04:39:41.983149+0000","last_became_active":"2023-06-09T04:39:41.006246+0000","last_became_peered":"2023-06-09T04:39:41.006246+0000","last_unstale":"2023-06-09T04:39:41.983149+0000","last_undegraded":"2023-06-09T04:39:41.983149+0000","last_fullsized":"2023-06-09T04:39:41.983149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:51:19.064520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414413+0000","last_change":"2023-06-09T04:39:40.993770+0000","last_active":"2023-06-09T04:39:42.414413+0000","last_peered":"2023-06-09T04:39:42.414413+0000","last_clean":"2023-06-09T04:39:42.414413+0000","last_became_active":"2023-06-09T04:39:40.993487+0000","last_became_peered":"2023-06-09T04:39:40.993487+0000","last_unstale":"2023-06-09T04:39:42.414413+0000","last_undegraded":"2023-06-09T04:39:42.414413+0000","last_fullsized":"2023-06-09T04:39:42.414413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:45.679085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413299+0000","last_change":"2023-06-09T04:39:41.005318+0000","last_active":"2023-06-09T04:39:42.413299+0000","last_peered":"2023-06-09T04:39:42.413299+0000","last_clean":"2023-06-09T04:39:42.413299+0000","last_became_active":"2023-06-09T04:39:41.004392+0000","last_became_peered":"2023-06-09T04:39:41.004392+0000","last_unstale":"2023-06-09T04:39:42.413299+0000","last_undegraded":"2023-06-09T04:39:42.413299+0000","last_fullsized":"2023-06-09T04:39:42.413299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.706964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982357+0000","last_change":"2023-06-09T04:39:40.995521+0000","last_active":"2023-06-09T04:39:41.982357+0000","last_peered":"2023-06-09T04:39:41.982357+0000","last_clean":"2023-06-09T04:39:41.982357+0000","last_became_active":"2023-06-09T04:39:40.994259+0000","last_became_peered":"2023-06-09T04:39:40.994259+0000","last_unstale":"2023-06-09T04:39:41.982357+0000","last_undegraded":"2023-06-09T04:39:41.982357+0000","last_fullsized":"2023-06-09T04:39:41.982357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:24.765697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981150+0000","last_change":"2023-06-09T04:39:40.996969+0000","last_active":"2023-06-09T04:39:41.981150+0000","last_peered":"2023-06-09T04:39:41.981150+0000","last_clean":"2023-06-09T04:39:41.981150+0000","last_became_active":"2023-06-09T04:39:40.995463+0000","last_became_peered":"2023-06-09T04:39:40.995463+0000","last_unstale":"2023-06-09T04:39:41.981150+0000","last_undegraded":"2023-06-09T04:39:41.981150+0000","last_fullsized":"2023-06-09T04:39:41.981150+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:43.962204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415647+0000","last_change":"2023-06-09T04:39:41.002893+0000","last_active":"2023-06-09T04:39:42.415647+0000","last_peered":"2023-06-09T04:39:42.415647+0000","last_clean":"2023-06-09T04:39:42.415647+0000","last_became_active":"2023-06-09T04:39:41.002577+0000","last_became_peered":"2023-06-09T04:39:41.002577+0000","last_unstale":"2023-06-09T04:39:42.415647+0000","last_undegraded":"2023-06-09T04:39:42.415647+0000","last_fullsized":"2023-06-09T04:39:42.415647+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:07:57.524795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415559+0000","last_change":"2023-06-09T04:39:40.993899+0000","last_active":"2023-06-09T04:39:42.415559+0000","last_peered":"2023-06-09T04:39:42.415559+0000","last_clean":"2023-06-09T04:39:42.415559+0000","last_became_active":"2023-06-09T04:39:40.993231+0000","last_became_peered":"2023-06-09T04:39:40.993231+0000","last_unstale":"2023-06-09T04:39:42.415559+0000","last_undegraded":"2023-06-09T04:39:42.415559+0000","last_fullsized":"2023-06-09T04:39:42.415559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:24:21.785637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414075+0000","last_change":"2023-06-09T04:39:40.997373+0000","last_active":"2023-06-09T04:39:42.414075+0000","last_peered":"2023-06-09T04:39:42.414075+0000","last_clean":"2023-06-09T04:39:42.414075+0000","last_became_active":"2023-06-09T04:39:40.996941+0000","last_became_peered":"2023-06-09T04:39:40.996941+0000","last_unstale":"2023-06-09T04:39:42.414075+0000","last_undegraded":"2023-06-09T04:39:42.414075+0000","last_fullsized":"2023-06-09T04:39:42.414075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:26.947127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416334+0000","last_change":"2023-06-09T04:39:41.006737+0000","last_active":"2023-06-09T04:39:42.416334+0000","last_peered":"2023-06-09T04:39:42.416334+0000","last_clean":"2023-06-09T04:39:42.416334+0000","last_became_active":"2023-06-09T04:39:41.006418+0000","last_became_peered":"2023-06-09T04:39:41.006418+0000","last_unstale":"2023-06-09T04:39:42.416334+0000","last_undegraded":"2023-06-09T04:39:42.416334+0000","last_fullsized":"2023-06-09T04:39:42.416334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:02.617460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981630+0000","last_change":"2023-06-09T04:39:40.998525+0000","last_active":"2023-06-09T04:39:41.981630+0000","last_peered":"2023-06-09T04:39:41.981630+0000","last_clean":"2023-06-09T04:39:41.981630+0000","last_became_active":"2023-06-09T04:39:40.993470+0000","last_became_peered":"2023-06-09T04:39:40.993470+0000","last_unstale":"2023-06-09T04:39:41.981630+0000","last_undegraded":"2023-06-09T04:39:41.981630+0000","last_fullsized":"2023-06-09T04:39:41.981630+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:13.701468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982518+0000","last_change":"2023-06-09T04:39:40.990578+0000","last_active":"2023-06-09T04:39:41.982518+0000","last_peered":"2023-06-09T04:39:41.982518+0000","last_clean":"2023-06-09T04:39:41.982518+0000","last_became_active":"2023-06-09T04:39:40.989892+0000","last_became_peered":"2023-06-09T04:39:40.989892+0000","last_unstale":"2023-06-09T04:39:41.982518+0000","last_undegraded":"2023-06-09T04:39:41.982518+0000","last_fullsized":"2023-06-09T04:39:41.982518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:10:14.667327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414285+0000","last_change":"2023-06-09T04:39:40.998900+0000","last_active":"2023-06-09T04:39:42.414285+0000","last_peered":"2023-06-09T04:39:42.414285+0000","last_clean":"2023-06-09T04:39:42.414285+0000","last_became_active":"2023-06-09T04:39:40.998565+0000","last_became_peered":"2023-06-09T04:39:40.998565+0000","last_unstale":"2023-06-09T04:39:42.414285+0000","last_undegraded":"2023-06-09T04:39:42.414285+0000","last_fullsized":"2023-06-09T04:39:42.414285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:52.438310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979021+0000","last_change":"2023-06-09T04:39:40.988038+0000","last_active":"2023-06-09T04:39:41.979021+0000","last_peered":"2023-06-09T04:39:41.979021+0000","last_clean":"2023-06-09T04:39:41.979021+0000","last_became_active":"2023-06-09T04:39:40.987571+0000","last_became_peered":"2023-06-09T04:39:40.987571+0000","last_unstale":"2023-06-09T04:39:41.979021+0000","last_undegraded":"2023-06-09T04:39:41.979021+0000","last_fullsized":"2023-06-09T04:39:41.979021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:25.256108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412920+0000","last_change":"2023-06-09T04:39:41.008177+0000","last_active":"2023-06-09T04:39:42.412920+0000","last_peered":"2023-06-09T04:39:42.412920+0000","last_clean":"2023-06-09T04:39:42.412920+0000","last_became_active":"2023-06-09T04:39:41.007885+0000","last_became_peered":"2023-06-09T04:39:41.007885+0000","last_unstale":"2023-06-09T04:39:42.412920+0000","last_undegraded":"2023-06-09T04:39:42.412920+0000","last_fullsized":"2023-06-09T04:39:42.412920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416859+0000","last_change":"2023-06-09T04:39:40.996163+0000","last_active":"2023-06-09T04:39:42.416859+0000","last_peered":"2023-06-09T04:39:42.416859+0000","last_clean":"2023-06-09T04:39:42.416859+0000","last_became_active":"2023-06-09T04:39:40.995844+0000","last_became_peered":"2023-06-09T04:39:40.995844+0000","last_unstale":"2023-06-09T04:39:42.416859+0000","last_undegraded":"2023-06-09T04:39:42.416859+0000","last_fullsized":"2023-06-09T04:39:42.416859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983030+0000","last_change":"2023-06-09T04:39:41.007262+0000","last_active":"2023-06-09T04:39:41.983030+0000","last_peered":"2023-06-09T04:39:41.983030+0000","last_clean":"2023-06-09T04:39:41.983030+0000","last_became_active":"2023-06-09T04:39:41.006952+0000","last_became_peered":"2023-06-09T04:39:41.006952+0000","last_unstale":"2023-06-09T04:39:41.983030+0000","last_undegraded":"2023-06-09T04:39:41.983030+0000","last_fullsized":"2023-06-09T04:39:41.983030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:25.708053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979677+0000","last_change":"2023-06-09T04:39:41.002912+0000","last_active":"2023-06-09T04:39:41.979677+0000","last_peered":"2023-06-09T04:39:41.979677+0000","last_clean":"2023-06-09T04:39:41.979677+0000","last_became_active":"2023-06-09T04:39:41.002540+0000","last_became_peered":"2023-06-09T04:39:41.002540+0000","last_unstale":"2023-06-09T04:39:41.979677+0000","last_undegraded":"2023-06-09T04:39:41.979677+0000","last_fullsized":"2023-06-09T04:39:41.979677+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:58.300999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979370+0000","last_change":"2023-06-09T04:39:41.003505+0000","last_active":"2023-06-09T04:39:41.979370+0000","last_peered":"2023-06-09T04:39:41.979370+0000","last_clean":"2023-06-09T04:39:41.979370+0000","last_became_active":"2023-06-09T04:39:41.003036+0000","last_became_peered":"2023-06-09T04:39:41.003036+0000","last_unstale":"2023-06-09T04:39:41.979370+0000","last_undegraded":"2023-06-09T04:39:41.979370+0000","last_fullsized":"2023-06-09T04:39:41.979370+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:25:53.963967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416800+0000","last_change":"2023-06-09T04:39:41.002034+0000","last_active":"2023-06-09T04:39:42.416800+0000","last_peered":"2023-06-09T04:39:42.416800+0000","last_clean":"2023-06-09T04:39:42.416800+0000","last_became_active":"2023-06-09T04:39:41.001685+0000","last_became_peered":"2023-06-09T04:39:41.001685+0000","last_unstale":"2023-06-09T04:39:42.416800+0000","last_undegraded":"2023-06-09T04:39:42.416800+0000","last_fullsized":"2023-06-09T04:39:42.416800+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:33.281660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413909+0000","last_change":"2023-06-09T04:39:40.989865+0000","last_active":"2023-06-09T04:39:42.413909+0000","last_peered":"2023-06-09T04:39:42.413909+0000","last_clean":"2023-06-09T04:39:42.413909+0000","last_became_active":"2023-06-09T04:39:40.989566+0000","last_became_peered":"2023-06-09T04:39:40.989566+0000","last_unstale":"2023-06-09T04:39:42.413909+0000","last_undegraded":"2023-06-09T04:39:42.413909+0000","last_fullsized":"2023-06-09T04:39:42.413909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.156003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412752+0000","last_change":"2023-06-09T04:39:41.006607+0000","last_active":"2023-06-09T04:39:42.412752+0000","last_peered":"2023-06-09T04:39:42.412752+0000","last_clean":"2023-06-09T04:39:42.412752+0000","last_became_active":"2023-06-09T04:39:41.006216+0000","last_became_peered":"2023-06-09T04:39:41.006216+0000","last_unstale":"2023-06-09T04:39:42.412752+0000","last_undegraded":"2023-06-09T04:39:42.412752+0000","last_fullsized":"2023-06-09T04:39:42.412752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:57.228151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980740+0000","last_change":"2023-06-09T04:39:40.992032+0000","last_active":"2023-06-09T04:39:41.980740+0000","last_peered":"2023-06-09T04:39:41.980740+0000","last_clean":"2023-06-09T04:39:41.980740+0000","last_became_active":"2023-06-09T04:39:40.990837+0000","last_became_peered":"2023-06-09T04:39:40.990837+0000","last_unstale":"2023-06-09T04:39:41.980740+0000","last_undegraded":"2023-06-09T04:39:41.980740+0000","last_fullsized":"2023-06-09T04:39:41.980740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:42.638120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414847+0000","last_change":"2023-06-09T04:39:41.009866+0000","last_active":"2023-06-09T04:39:42.414847+0000","last_peered":"2023-06-09T04:39:42.414847+0000","last_clean":"2023-06-09T04:39:42.414847+0000","last_became_active":"2023-06-09T04:39:41.009511+0000","last_became_peered":"2023-06-09T04:39:41.009511+0000","last_unstale":"2023-06-09T04:39:42.414847+0000","last_undegraded":"2023-06-09T04:39:42.414847+0000","last_fullsized":"2023-06-09T04:39:42.414847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:20.985140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413964+0000","last_change":"2023-06-09T04:39:40.604498+0000","last_active":"2023-06-09T04:39:42.413964+0000","last_peered":"2023-06-09T04:39:42.413964+0000","last_clean":"2023-06-09T04:39:42.413964+0000","last_became_active":"2023-06-09T04:39:40.603788+0000","last_became_peered":"2023-06-09T04:39:40.603788+0000","last_unstale":"2023-06-09T04:39:42.413964+0000","last_undegraded":"2023-06-09T04:39:42.413964+0000","last_fullsized":"2023-06-09T04:39:42.413964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:31:44.667395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.417178+0000","last_change":"2023-06-09T04:39:41.007158+0000","last_active":"2023-06-09T04:39:42.417178+0000","last_peered":"2023-06-09T04:39:42.417178+0000","last_clean":"2023-06-09T04:39:42.417178+0000","last_became_active":"2023-06-09T04:39:41.006639+0000","last_became_peered":"2023-06-09T04:39:41.006639+0000","last_unstale":"2023-06-09T04:39:42.417178+0000","last_undegraded":"2023-06-09T04:39:42.417178+0000","last_fullsized":"2023-06-09T04:39:42.417178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979820+0000","last_change":"2023-06-09T04:39:40.605078+0000","last_active":"2023-06-09T04:39:41.979820+0000","last_peered":"2023-06-09T04:39:41.979820+0000","last_clean":"2023-06-09T04:39:41.979820+0000","last_became_active":"2023-06-09T04:39:40.604691+0000","last_became_peered":"2023-06-09T04:39:40.604691+0000","last_unstale":"2023-06-09T04:39:41.979820+0000","last_undegraded":"2023-06-09T04:39:41.979820+0000","last_fullsized":"2023-06-09T04:39:41.979820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:02.483438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414524+0000","last_change":"2023-06-09T04:39:41.011596+0000","last_active":"2023-06-09T04:39:42.414524+0000","last_peered":"2023-06-09T04:39:42.414524+0000","last_clean":"2023-06-09T04:39:42.414524+0000","last_became_active":"2023-06-09T04:39:41.011240+0000","last_became_peered":"2023-06-09T04:39:41.011240+0000","last_unstale":"2023-06-09T04:39:42.414524+0000","last_undegraded":"2023-06-09T04:39:42.414524+0000","last_fullsized":"2023-06-09T04:39:42.414524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:28:32.741830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413559+0000","last_change":"2023-06-09T04:39:40.619765+0000","last_active":"2023-06-09T04:39:42.413559+0000","last_peered":"2023-06-09T04:39:42.413559+0000","last_clean":"2023-06-09T04:39:42.413559+0000","last_became_active":"2023-06-09T04:39:40.618833+0000","last_became_peered":"2023-06-09T04:39:40.618833+0000","last_unstale":"2023-06-09T04:39:42.413559+0000","last_undegraded":"2023-06-09T04:39:42.413559+0000","last_fullsized":"2023-06-09T04:39:42.413559+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983209+0000","last_change":"2023-06-09T04:39:40.994023+0000","last_active":"2023-06-09T04:39:41.983209+0000","last_peered":"2023-06-09T04:39:41.983209+0000","last_clean":"2023-06-09T04:39:41.983209+0000","last_became_active":"2023-06-09T04:39:40.993695+0000","last_became_peered":"2023-06-09T04:39:40.993695+0000","last_unstale":"2023-06-09T04:39:41.983209+0000","last_undegraded":"2023-06-09T04:39:41.983209+0000","last_fullsized":"2023-06-09T04:39:41.983209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:25.004879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979442+0000","last_change":"2023-06-09T04:39:40.605638+0000","last_active":"2023-06-09T04:39:41.979442+0000","last_peered":"2023-06-09T04:39:41.979442+0000","last_clean":"2023-06-09T04:39:41.979442+0000","last_became_active":"2023-06-09T04:39:40.604752+0000","last_became_peered":"2023-06-09T04:39:40.604752+0000","last_unstale":"2023-06-09T04:39:41.979442+0000","last_undegraded":"2023-06-09T04:39:41.979442+0000","last_fullsized":"2023-06-09T04:39:41.979442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:38.672735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978921+0000","last_change":"2023-06-09T04:39:40.988659+0000","last_active":"2023-06-09T04:39:41.978921+0000","last_peered":"2023-06-09T04:39:41.978921+0000","last_clean":"2023-06-09T04:39:41.978921+0000","last_became_active":"2023-06-09T04:39:40.988316+0000","last_became_peered":"2023-06-09T04:39:40.988316+0000","last_unstale":"2023-06-09T04:39:41.978921+0000","last_undegraded":"2023-06-09T04:39:41.978921+0000","last_fullsized":"2023-06-09T04:39:41.978921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:23:45.973226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413633+0000","last_change":"2023-06-09T04:39:40.607221+0000","last_active":"2023-06-09T04:39:42.413633+0000","last_peered":"2023-06-09T04:39:42.413633+0000","last_clean":"2023-06-09T04:39:42.413633+0000","last_became_active":"2023-06-09T04:39:40.606560+0000","last_became_peered":"2023-06-09T04:39:40.606560+0000","last_unstale":"2023-06-09T04:39:42.413633+0000","last_undegraded":"2023-06-09T04:39:42.413633+0000","last_fullsized":"2023-06-09T04:39:42.413633+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:32.670818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981235+0000","last_change":"2023-06-09T04:39:41.000847+0000","last_active":"2023-06-09T04:39:41.981235+0000","last_peered":"2023-06-09T04:39:41.981235+0000","last_clean":"2023-06-09T04:39:41.981235+0000","last_became_active":"2023-06-09T04:39:41.000365+0000","last_became_peered":"2023-06-09T04:39:41.000365+0000","last_unstale":"2023-06-09T04:39:41.981235+0000","last_undegraded":"2023-06-09T04:39:41.981235+0000","last_fullsized":"2023-06-09T04:39:41.981235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:20:10.726424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979275+0000","last_change":"2023-06-09T04:39:40.620806+0000","last_active":"2023-06-09T04:39:41.979275+0000","last_peered":"2023-06-09T04:39:41.979275+0000","last_clean":"2023-06-09T04:39:41.979275+0000","last_became_active":"2023-06-09T04:39:40.620038+0000","last_became_peered":"2023-06-09T04:39:40.620038+0000","last_unstale":"2023-06-09T04:39:41.979275+0000","last_undegraded":"2023-06-09T04:39:41.979275+0000","last_fullsized":"2023-06-09T04:39:41.979275+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:46:17.169645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980180+0000","last_change":"2023-06-09T04:39:40.982117+0000","last_active":"2023-06-09T04:39:41.980180+0000","last_peered":"2023-06-09T04:39:41.980180+0000","last_clean":"2023-06-09T04:39:41.980180+0000","last_became_active":"2023-06-09T04:39:40.981343+0000","last_became_peered":"2023-06-09T04:39:40.981343+0000","last_unstale":"2023-06-09T04:39:41.980180+0000","last_undegraded":"2023-06-09T04:39:41.980180+0000","last_fullsized":"2023-06-09T04:39:41.980180+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:39.601908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415964+0000","last_change":"2023-06-09T04:39:40.624719+0000","last_active":"2023-06-09T04:39:42.415964+0000","last_peered":"2023-06-09T04:39:42.415964+0000","last_clean":"2023-06-09T04:39:42.415964+0000","last_became_active":"2023-06-09T04:39:40.624153+0000","last_became_peered":"2023-06-09T04:39:40.624153+0000","last_unstale":"2023-06-09T04:39:42.415964+0000","last_undegraded":"2023-06-09T04:39:42.415964+0000","last_fullsized":"2023-06-09T04:39:42.415964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:44:00.342333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979094+0000","last_change":"2023-06-09T04:39:41.007604+0000","last_active":"2023-06-09T04:39:41.979094+0000","last_peered":"2023-06-09T04:39:41.979094+0000","last_clean":"2023-06-09T04:39:41.979094+0000","last_became_active":"2023-06-09T04:39:41.007116+0000","last_became_peered":"2023-06-09T04:39:41.007116+0000","last_unstale":"2023-06-09T04:39:41.979094+0000","last_undegraded":"2023-06-09T04:39:41.979094+0000","last_fullsized":"2023-06-09T04:39:41.979094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:58:45.507184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980296+0000","last_change":"2023-06-09T04:39:40.624170+0000","last_active":"2023-06-09T04:39:41.980296+0000","last_peered":"2023-06-09T04:39:41.980296+0000","last_clean":"2023-06-09T04:39:41.980296+0000","last_became_active":"2023-06-09T04:39:40.623502+0000","last_became_peered":"2023-06-09T04:39:40.623502+0000","last_unstale":"2023-06-09T04:39:41.980296+0000","last_undegraded":"2023-06-09T04:39:41.980296+0000","last_fullsized":"2023-06-09T04:39:41.980296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:30:37.253525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415330+0000","last_change":"2023-06-09T04:39:40.991307+0000","last_active":"2023-06-09T04:39:42.415330+0000","last_peered":"2023-06-09T04:39:42.415330+0000","last_clean":"2023-06-09T04:39:42.415330+0000","last_became_active":"2023-06-09T04:39:40.991009+0000","last_became_peered":"2023-06-09T04:39:40.991009+0000","last_unstale":"2023-06-09T04:39:42.415330+0000","last_undegraded":"2023-06-09T04:39:42.415330+0000","last_fullsized":"2023-06-09T04:39:42.415330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:25:32.369003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414341+0000","last_change":"2023-06-09T04:39:40.609952+0000","last_active":"2023-06-09T04:39:42.414341+0000","last_peered":"2023-06-09T04:39:42.414341+0000","last_clean":"2023-06-09T04:39:42.414341+0000","last_became_active":"2023-06-09T04:39:40.609555+0000","last_became_peered":"2023-06-09T04:39:40.609555+0000","last_unstale":"2023-06-09T04:39:42.414341+0000","last_undegraded":"2023-06-09T04:39:42.414341+0000","last_fullsized":"2023-06-09T04:39:42.414341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:21:42.898956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414332+0000","last_change":"2023-06-09T04:39:40.983352+0000","last_active":"2023-06-09T04:39:42.414332+0000","last_peered":"2023-06-09T04:39:42.414332+0000","last_clean":"2023-06-09T04:39:42.414332+0000","last_became_active":"2023-06-09T04:39:40.983017+0000","last_became_peered":"2023-06-09T04:39:40.983017+0000","last_unstale":"2023-06-09T04:39:42.414332+0000","last_undegraded":"2023-06-09T04:39:42.414332+0000","last_fullsized":"2023-06-09T04:39:42.414332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:29:22.543858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981882+0000","last_change":"2023-06-09T04:39:40.597631+0000","last_active":"2023-06-09T04:39:41.981882+0000","last_peered":"2023-06-09T04:39:41.981882+0000","last_clean":"2023-06-09T04:39:41.981882+0000","last_became_active":"2023-06-09T04:39:40.596933+0000","last_became_peered":"2023-06-09T04:39:40.596933+0000","last_unstale":"2023-06-09T04:39:41.981882+0000","last_undegraded":"2023-06-09T04:39:41.981882+0000","last_fullsized":"2023-06-09T04:39:41.981882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:09:34.655136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982771+0000","last_change":"2023-06-09T04:39:41.000161+0000","last_active":"2023-06-09T04:39:41.982771+0000","last_peered":"2023-06-09T04:39:41.982771+0000","last_clean":"2023-06-09T04:39:41.982771+0000","last_became_active":"2023-06-09T04:39:40.999789+0000","last_became_peered":"2023-06-09T04:39:40.999789+0000","last_unstale":"2023-06-09T04:39:41.982771+0000","last_undegraded":"2023-06-09T04:39:41.982771+0000","last_fullsized":"2023-06-09T04:39:41.982771+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414775+0000","last_change":"2023-06-09T04:39:40.619981+0000","last_active":"2023-06-09T04:39:42.414775+0000","last_peered":"2023-06-09T04:39:42.414775+0000","last_clean":"2023-06-09T04:39:42.414775+0000","last_became_active":"2023-06-09T04:39:40.619566+0000","last_became_peered":"2023-06-09T04:39:40.619566+0000","last_unstale":"2023-06-09T04:39:42.414775+0000","last_undegraded":"2023-06-09T04:39:42.414775+0000","last_fullsized":"2023-06-09T04:39:42.414775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:23:23.487006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979615+0000","last_change":"2023-06-09T04:39:41.000297+0000","last_active":"2023-06-09T04:39:41.979615+0000","last_peered":"2023-06-09T04:39:41.979615+0000","last_clean":"2023-06-09T04:39:41.979615+0000","last_became_active":"2023-06-09T04:39:40.999612+0000","last_became_peered":"2023-06-09T04:39:40.999612+0000","last_unstale":"2023-06-09T04:39:41.979615+0000","last_undegraded":"2023-06-09T04:39:41.979615+0000","last_fullsized":"2023-06-09T04:39:41.979615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:19:48.372401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982023+0000","last_change":"2023-06-09T04:39:40.611518+0000","last_active":"2023-06-09T04:39:41.982023+0000","last_peered":"2023-06-09T04:39:41.982023+0000","last_clean":"2023-06-09T04:39:41.982023+0000","last_became_active":"2023-06-09T04:39:40.610734+0000","last_became_peered":"2023-06-09T04:39:40.610734+0000","last_unstale":"2023-06-09T04:39:41.982023+0000","last_undegraded":"2023-06-09T04:39:41.982023+0000","last_fullsized":"2023-06-09T04:39:41.982023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:30:44.123651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413966+0000","last_change":"2023-06-09T04:39:40.995808+0000","last_active":"2023-06-09T04:39:42.413966+0000","last_peered":"2023-06-09T04:39:42.413966+0000","last_clean":"2023-06-09T04:39:42.413966+0000","last_became_active":"2023-06-09T04:39:40.995324+0000","last_became_peered":"2023-06-09T04:39:40.995324+0000","last_unstale":"2023-06-09T04:39:42.413966+0000","last_undegraded":"2023-06-09T04:39:42.413966+0000","last_fullsized":"2023-06-09T04:39:42.413966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:34:23.314771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414946+0000","last_change":"2023-06-09T04:39:40.612040+0000","last_active":"2023-06-09T04:39:42.414946+0000","last_peered":"2023-06-09T04:39:42.414946+0000","last_clean":"2023-06-09T04:39:42.414946+0000","last_became_active":"2023-06-09T04:39:40.611172+0000","last_became_peered":"2023-06-09T04:39:40.611172+0000","last_unstale":"2023-06-09T04:39:42.414946+0000","last_undegraded":"2023-06-09T04:39:42.414946+0000","last_fullsized":"2023-06-09T04:39:42.414946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:28:38.151834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414617+0000","last_change":"2023-06-09T04:39:40.995651+0000","last_active":"2023-06-09T04:39:42.414617+0000","last_peered":"2023-06-09T04:39:42.414617+0000","last_clean":"2023-06-09T04:39:42.414617+0000","last_became_active":"2023-06-09T04:39:40.994999+0000","last_became_peered":"2023-06-09T04:39:40.994999+0000","last_unstale":"2023-06-09T04:39:42.414617+0000","last_undegraded":"2023-06-09T04:39:42.414617+0000","last_fullsized":"2023-06-09T04:39:42.414617+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:13:37.121110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416351+0000","last_change":"2023-06-09T04:39:40.617532+0000","last_active":"2023-06-09T04:39:42.416351+0000","last_peered":"2023-06-09T04:39:42.416351+0000","last_clean":"2023-06-09T04:39:42.416351+0000","last_became_active":"2023-06-09T04:39:40.615774+0000","last_became_peered":"2023-06-09T04:39:40.615774+0000","last_unstale":"2023-06-09T04:39:42.416351+0000","last_undegraded":"2023-06-09T04:39:42.416351+0000","last_fullsized":"2023-06-09T04:39:42.416351+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414139+0000","last_change":"2023-06-09T04:39:41.012348+0000","last_active":"2023-06-09T04:39:42.414139+0000","last_peered":"2023-06-09T04:39:42.414139+0000","last_clean":"2023-06-09T04:39:42.414139+0000","last_became_active":"2023-06-09T04:39:41.011938+0000","last_became_peered":"2023-06-09T04:39:41.011938+0000","last_unstale":"2023-06-09T04:39:42.414139+0000","last_undegraded":"2023-06-09T04:39:42.414139+0000","last_fullsized":"2023-06-09T04:39:42.414139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:18:48.450095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412936+0000","last_change":"2023-06-09T04:39:40.607242+0000","last_active":"2023-06-09T04:39:42.412936+0000","last_peered":"2023-06-09T04:39:42.412936+0000","last_clean":"2023-06-09T04:39:42.412936+0000","last_became_active":"2023-06-09T04:39:40.606331+0000","last_became_peered":"2023-06-09T04:39:40.606331+0000","last_unstale":"2023-06-09T04:39:42.412936+0000","last_undegraded":"2023-06-09T04:39:42.412936+0000","last_fullsized":"2023-06-09T04:39:42.412936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:07:24.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.412958+0000","last_change":"2023-06-09T04:39:40.993917+0000","last_active":"2023-06-09T04:39:42.412958+0000","last_peered":"2023-06-09T04:39:42.412958+0000","last_clean":"2023-06-09T04:39:42.412958+0000","last_became_active":"2023-06-09T04:39:40.993317+0000","last_became_peered":"2023-06-09T04:39:40.993317+0000","last_unstale":"2023-06-09T04:39:42.412958+0000","last_undegraded":"2023-06-09T04:39:42.412958+0000","last_fullsized":"2023-06-09T04:39:42.412958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:28.568155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980348+0000","last_change":"2023-06-09T04:39:40.594820+0000","last_active":"2023-06-09T04:39:41.980348+0000","last_peered":"2023-06-09T04:39:41.980348+0000","last_clean":"2023-06-09T04:39:41.980348+0000","last_became_active":"2023-06-09T04:39:40.594031+0000","last_became_peered":"2023-06-09T04:39:40.594031+0000","last_unstale":"2023-06-09T04:39:41.980348+0000","last_undegraded":"2023-06-09T04:39:41.980348+0000","last_fullsized":"2023-06-09T04:39:41.980348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:15.340144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415131+0000","last_change":"2023-06-09T04:39:40.998920+0000","last_active":"2023-06-09T04:39:42.415131+0000","last_peered":"2023-06-09T04:39:42.415131+0000","last_clean":"2023-06-09T04:39:42.415131+0000","last_became_active":"2023-06-09T04:39:40.998646+0000","last_became_peered":"2023-06-09T04:39:40.998646+0000","last_unstale":"2023-06-09T04:39:42.415131+0000","last_undegraded":"2023-06-09T04:39:42.415131+0000","last_fullsized":"2023-06-09T04:39:42.415131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:38.068463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983526+0000","last_change":"2023-06-09T04:39:40.625632+0000","last_active":"2023-06-09T04:39:41.983526+0000","last_peered":"2023-06-09T04:39:41.983526+0000","last_clean":"2023-06-09T04:39:41.983526+0000","last_became_active":"2023-06-09T04:39:40.625013+0000","last_became_peered":"2023-06-09T04:39:40.625013+0000","last_unstale":"2023-06-09T04:39:41.983526+0000","last_undegraded":"2023-06-09T04:39:41.983526+0000","last_fullsized":"2023-06-09T04:39:41.983526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:47:39.355242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414848+0000","last_change":"2023-06-09T04:39:41.010054+0000","last_active":"2023-06-09T04:39:42.414848+0000","last_peered":"2023-06-09T04:39:42.414848+0000","last_clean":"2023-06-09T04:39:42.414848+0000","last_became_active":"2023-06-09T04:39:41.009721+0000","last_became_peered":"2023-06-09T04:39:41.009721+0000","last_unstale":"2023-06-09T04:39:42.414848+0000","last_undegraded":"2023-06-09T04:39:42.414848+0000","last_fullsized":"2023-06-09T04:39:42.414848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:06.660210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414826+0000","last_change":"2023-06-09T04:39:40.616701+0000","last_active":"2023-06-09T04:39:42.414826+0000","last_peered":"2023-06-09T04:39:42.414826+0000","last_clean":"2023-06-09T04:39:42.414826+0000","last_became_active":"2023-06-09T04:39:40.615708+0000","last_became_peered":"2023-06-09T04:39:40.615708+0000","last_unstale":"2023-06-09T04:39:42.414826+0000","last_undegraded":"2023-06-09T04:39:42.414826+0000","last_fullsized":"2023-06-09T04:39:42.414826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:16:14.228577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414779+0000","last_change":"2023-06-09T04:39:40.997482+0000","last_active":"2023-06-09T04:39:42.414779+0000","last_peered":"2023-06-09T04:39:42.414779+0000","last_clean":"2023-06-09T04:39:42.414779+0000","last_became_active":"2023-06-09T04:39:40.996995+0000","last_became_peered":"2023-06-09T04:39:40.996995+0000","last_unstale":"2023-06-09T04:39:42.414779+0000","last_undegraded":"2023-06-09T04:39:42.414779+0000","last_fullsized":"2023-06-09T04:39:42.414779+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:19.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414455+0000","last_change":"2023-06-09T04:39:40.595975+0000","last_active":"2023-06-09T04:39:42.414455+0000","last_peered":"2023-06-09T04:39:42.414455+0000","last_clean":"2023-06-09T04:39:42.414455+0000","last_became_active":"2023-06-09T04:39:40.595583+0000","last_became_peered":"2023-06-09T04:39:40.595583+0000","last_unstale":"2023-06-09T04:39:42.414455+0000","last_undegraded":"2023-06-09T04:39:42.414455+0000","last_fullsized":"2023-06-09T04:39:42.414455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:17:14.690457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414084+0000","last_change":"2023-06-09T04:39:41.011755+0000","last_active":"2023-06-09T04:39:42.414084+0000","last_peered":"2023-06-09T04:39:42.414084+0000","last_clean":"2023-06-09T04:39:42.414084+0000","last_became_active":"2023-06-09T04:39:41.011362+0000","last_became_peered":"2023-06-09T04:39:41.011362+0000","last_unstale":"2023-06-09T04:39:42.414084+0000","last_undegraded":"2023-06-09T04:39:42.414084+0000","last_fullsized":"2023-06-09T04:39:42.414084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:54.909398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413062+0000","last_change":"2023-06-09T04:39:40.608570+0000","last_active":"2023-06-09T04:39:42.413062+0000","last_peered":"2023-06-09T04:39:42.413062+0000","last_clean":"2023-06-09T04:39:42.413062+0000","last_became_active":"2023-06-09T04:39:40.607567+0000","last_became_peered":"2023-06-09T04:39:40.607567+0000","last_unstale":"2023-06-09T04:39:42.413062+0000","last_undegraded":"2023-06-09T04:39:42.413062+0000","last_fullsized":"2023-06-09T04:39:42.413062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980707+0000","last_change":"2023-06-09T04:39:41.005808+0000","last_active":"2023-06-09T04:39:41.980707+0000","last_peered":"2023-06-09T04:39:41.980707+0000","last_clean":"2023-06-09T04:39:41.980707+0000","last_became_active":"2023-06-09T04:39:41.005505+0000","last_became_peered":"2023-06-09T04:39:41.005505+0000","last_unstale":"2023-06-09T04:39:41.980707+0000","last_undegraded":"2023-06-09T04:39:41.980707+0000","last_fullsized":"2023-06-09T04:39:41.980707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:23:08.643835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982312+0000","last_change":"2023-06-09T04:39:40.602174+0000","last_active":"2023-06-09T04:39:41.982312+0000","last_peered":"2023-06-09T04:39:41.982312+0000","last_clean":"2023-06-09T04:39:41.982312+0000","last_became_active":"2023-06-09T04:39:40.601339+0000","last_became_peered":"2023-06-09T04:39:40.601339+0000","last_unstale":"2023-06-09T04:39:41.982312+0000","last_undegraded":"2023-06-09T04:39:41.982312+0000","last_fullsized":"2023-06-09T04:39:41.982312+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:31:45.907935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413386+0000","last_change":"2023-06-09T04:39:41.006006+0000","last_active":"2023-06-09T04:39:42.413386+0000","last_peered":"2023-06-09T04:39:42.413386+0000","last_clean":"2023-06-09T04:39:42.413386+0000","last_became_active":"2023-06-09T04:39:41.005756+0000","last_became_peered":"2023-06-09T04:39:41.005756+0000","last_unstale":"2023-06-09T04:39:42.413386+0000","last_undegraded":"2023-06-09T04:39:42.413386+0000","last_fullsized":"2023-06-09T04:39:42.413386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:04.425873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416403+0000","last_change":"2023-06-09T04:39:40.615155+0000","last_active":"2023-06-09T04:39:42.416403+0000","last_peered":"2023-06-09T04:39:42.416403+0000","last_clean":"2023-06-09T04:39:42.416403+0000","last_became_active":"2023-06-09T04:39:40.614735+0000","last_became_peered":"2023-06-09T04:39:40.614735+0000","last_unstale":"2023-06-09T04:39:42.416403+0000","last_undegraded":"2023-06-09T04:39:42.416403+0000","last_fullsized":"2023-06-09T04:39:42.416403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:44:06.301435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980885+0000","last_change":"2023-06-09T04:39:40.993826+0000","last_active":"2023-06-09T04:39:41.980885+0000","last_peered":"2023-06-09T04:39:41.980885+0000","last_clean":"2023-06-09T04:39:41.980885+0000","last_became_active":"2023-06-09T04:39:40.992701+0000","last_became_peered":"2023-06-09T04:39:40.992701+0000","last_unstale":"2023-06-09T04:39:41.980885+0000","last_undegraded":"2023-06-09T04:39:41.980885+0000","last_fullsized":"2023-06-09T04:39:41.980885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:52.880775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.980539+0000","last_change":"2023-06-09T04:39:40.601847+0000","last_active":"2023-06-09T04:39:41.980539+0000","last_peered":"2023-06-09T04:39:41.980539+0000","last_clean":"2023-06-09T04:39:41.980539+0000","last_became_active":"2023-06-09T04:39:40.601116+0000","last_became_peered":"2023-06-09T04:39:40.601116+0000","last_unstale":"2023-06-09T04:39:41.980539+0000","last_undegraded":"2023-06-09T04:39:41.980539+0000","last_fullsized":"2023-06-09T04:39:41.980539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:16:36.582040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981457+0000","last_change":"2023-06-09T04:39:40.996654+0000","last_active":"2023-06-09T04:39:41.981457+0000","last_peered":"2023-06-09T04:39:41.981457+0000","last_clean":"2023-06-09T04:39:41.981457+0000","last_became_active":"2023-06-09T04:39:40.995096+0000","last_became_peered":"2023-06-09T04:39:40.995096+0000","last_unstale":"2023-06-09T04:39:41.981457+0000","last_undegraded":"2023-06-09T04:39:41.981457+0000","last_fullsized":"2023-06-09T04:39:41.981457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:47.503555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978689+0000","last_change":"2023-06-09T04:39:40.611511+0000","last_active":"2023-06-09T04:39:41.978689+0000","last_peered":"2023-06-09T04:39:41.978689+0000","last_clean":"2023-06-09T04:39:41.978689+0000","last_became_active":"2023-06-09T04:39:40.611148+0000","last_became_peered":"2023-06-09T04:39:40.611148+0000","last_unstale":"2023-06-09T04:39:41.978689+0000","last_undegraded":"2023-06-09T04:39:41.978689+0000","last_fullsized":"2023-06-09T04:39:41.978689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:32:13.510119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981090+0000","last_change":"2023-06-09T04:39:41.005886+0000","last_active":"2023-06-09T04:39:41.981090+0000","last_peered":"2023-06-09T04:39:41.981090+0000","last_clean":"2023-06-09T04:39:41.981090+0000","last_became_active":"2023-06-09T04:39:41.005622+0000","last_became_peered":"2023-06-09T04:39:41.005622+0000","last_unstale":"2023-06-09T04:39:41.981090+0000","last_undegraded":"2023-06-09T04:39:41.981090+0000","last_fullsized":"2023-06-09T04:39:41.981090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:49.238912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416950+0000","last_change":"2023-06-09T04:39:40.627150+0000","last_active":"2023-06-09T04:39:42.416950+0000","last_peered":"2023-06-09T04:39:42.416950+0000","last_clean":"2023-06-09T04:39:42.416950+0000","last_became_active":"2023-06-09T04:39:40.626838+0000","last_became_peered":"2023-06-09T04:39:40.626838+0000","last_unstale":"2023-06-09T04:39:42.416950+0000","last_undegraded":"2023-06-09T04:39:42.416950+0000","last_fullsized":"2023-06-09T04:39:42.416950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:27.556465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979730+0000","last_change":"2023-06-09T04:38:07.056189+0000","last_active":"2023-06-09T04:39:41.979730+0000","last_peered":"2023-06-09T04:39:41.979730+0000","last_clean":"2023-06-09T04:39:41.979730+0000","last_became_active":"2023-06-09T04:38:07.055909+0000","last_became_peered":"2023-06-09T04:38:07.055909+0000","last_unstale":"2023-06-09T04:39:41.979730+0000","last_undegraded":"2023-06-09T04:39:41.979730+0000","last_fullsized":"2023-06-09T04:39:41.979730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:08:53.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982535+0000","last_change":"2023-06-09T04:39:40.994885+0000","last_active":"2023-06-09T04:39:41.982535+0000","last_peered":"2023-06-09T04:39:41.982535+0000","last_clean":"2023-06-09T04:39:41.982535+0000","last_became_active":"2023-06-09T04:39:40.993574+0000","last_became_peered":"2023-06-09T04:39:40.993574+0000","last_unstale":"2023-06-09T04:39:41.982535+0000","last_undegraded":"2023-06-09T04:39:41.982535+0000","last_fullsized":"2023-06-09T04:39:41.982535+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:39:50.971199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979037+0000","last_change":"2023-06-09T04:39:40.615348+0000","last_active":"2023-06-09T04:39:41.979037+0000","last_peered":"2023-06-09T04:39:41.979037+0000","last_clean":"2023-06-09T04:39:41.979037+0000","last_became_active":"2023-06-09T04:39:40.614915+0000","last_became_peered":"2023-06-09T04:39:40.614915+0000","last_unstale":"2023-06-09T04:39:41.979037+0000","last_undegraded":"2023-06-09T04:39:41.979037+0000","last_fullsized":"2023-06-09T04:39:41.979037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:16:05.693293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981930+0000","last_change":"2023-06-09T04:38:07.055208+0000","last_active":"2023-06-09T04:39:41.981930+0000","last_peered":"2023-06-09T04:39:41.981930+0000","last_clean":"2023-06-09T04:39:41.981930+0000","last_became_active":"2023-06-09T04:38:07.054793+0000","last_became_peered":"2023-06-09T04:38:07.054793+0000","last_unstale":"2023-06-09T04:39:41.981930+0000","last_undegraded":"2023-06-09T04:39:41.981930+0000","last_fullsized":"2023-06-09T04:39:41.981930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:03.399471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413267+0000","last_change":"2023-06-09T04:39:41.002863+0000","last_active":"2023-06-09T04:39:42.413267+0000","last_peered":"2023-06-09T04:39:42.413267+0000","last_clean":"2023-06-09T04:39:42.413267+0000","last_became_active":"2023-06-09T04:39:41.002424+0000","last_became_peered":"2023-06-09T04:39:41.002424+0000","last_unstale":"2023-06-09T04:39:42.413267+0000","last_undegraded":"2023-06-09T04:39:42.413267+0000","last_fullsized":"2023-06-09T04:39:42.413267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:15:39.739410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414346+0000","last_change":"2023-06-09T04:39:40.614551+0000","last_active":"2023-06-09T04:39:42.414346+0000","last_peered":"2023-06-09T04:39:42.414346+0000","last_clean":"2023-06-09T04:39:42.414346+0000","last_became_active":"2023-06-09T04:39:40.613760+0000","last_became_peered":"2023-06-09T04:39:40.613760+0000","last_unstale":"2023-06-09T04:39:42.414346+0000","last_undegraded":"2023-06-09T04:39:42.414346+0000","last_fullsized":"2023-06-09T04:39:42.414346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:02.676701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979890+0000","last_change":"2023-06-09T04:38:07.004894+0000","last_active":"2023-06-09T04:39:41.979890+0000","last_peered":"2023-06-09T04:39:41.979890+0000","last_clean":"2023-06-09T04:39:41.979890+0000","last_became_active":"2023-06-09T04:38:07.004421+0000","last_became_peered":"2023-06-09T04:38:07.004421+0000","last_unstale":"2023-06-09T04:39:41.979890+0000","last_undegraded":"2023-06-09T04:39:41.979890+0000","last_fullsized":"2023-06-09T04:39:41.979890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:51:09.925082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.413319+0000","last_change":"2023-06-09T04:39:40.993661+0000","last_active":"2023-06-09T04:39:42.413319+0000","last_peered":"2023-06-09T04:39:42.413319+0000","last_clean":"2023-06-09T04:39:42.413319+0000","last_became_active":"2023-06-09T04:39:40.992879+0000","last_became_peered":"2023-06-09T04:39:40.992879+0000","last_unstale":"2023-06-09T04:39:42.413319+0000","last_undegraded":"2023-06-09T04:39:42.413319+0000","last_fullsized":"2023-06-09T04:39:42.413319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:33.682508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414078+0000","last_change":"2023-06-09T04:39:40.615594+0000","last_active":"2023-06-09T04:39:42.414078+0000","last_peered":"2023-06-09T04:39:42.414078+0000","last_clean":"2023-06-09T04:39:42.414078+0000","last_became_active":"2023-06-09T04:39:40.614956+0000","last_became_peered":"2023-06-09T04:39:40.614956+0000","last_unstale":"2023-06-09T04:39:42.414078+0000","last_undegraded":"2023-06-09T04:39:42.414078+0000","last_fullsized":"2023-06-09T04:39:42.414078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:16.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.982818+0000","last_change":"2023-06-09T04:38:07.786274+0000","last_active":"2023-06-09T04:39:41.982818+0000","last_peered":"2023-06-09T04:39:41.982818+0000","last_clean":"2023-06-09T04:39:41.982818+0000","last_became_active":"2023-06-09T04:38:07.785408+0000","last_became_peered":"2023-06-09T04:38:07.785408+0000","last_unstale":"2023-06-09T04:39:41.982818+0000","last_undegraded":"2023-06-09T04:39:41.982818+0000","last_fullsized":"2023-06-09T04:39:41.982818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:47:05.270452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979647+0000","last_change":"2023-06-09T04:39:41.005826+0000","last_active":"2023-06-09T04:39:41.979647+0000","last_peered":"2023-06-09T04:39:41.979647+0000","last_clean":"2023-06-09T04:39:41.979647+0000","last_became_active":"2023-06-09T04:39:41.005376+0000","last_became_peered":"2023-06-09T04:39:41.005376+0000","last_unstale":"2023-06-09T04:39:41.979647+0000","last_undegraded":"2023-06-09T04:39:41.979647+0000","last_fullsized":"2023-06-09T04:39:41.979647+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:29:39.223258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.737986+0000","last_change":"2023-06-09T04:39:40.623724+0000","last_active":"2023-06-09T04:39:42.737986+0000","last_peered":"2023-06-09T04:39:42.737986+0000","last_clean":"2023-06-09T04:39:42.737986+0000","last_became_active":"2023-06-09T04:39:40.622846+0000","last_became_peered":"2023-06-09T04:39:40.622846+0000","last_unstale":"2023-06-09T04:39:42.737986+0000","last_undegraded":"2023-06-09T04:39:42.737986+0000","last_fullsized":"2023-06-09T04:39:42.737986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:36.849855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979117+0000","last_change":"2023-06-09T04:38:07.787246+0000","last_active":"2023-06-09T04:39:41.979117+0000","last_peered":"2023-06-09T04:39:41.979117+0000","last_clean":"2023-06-09T04:39:41.979117+0000","last_became_active":"2023-06-09T04:38:07.786755+0000","last_became_peered":"2023-06-09T04:38:07.786755+0000","last_unstale":"2023-06-09T04:39:41.979117+0000","last_undegraded":"2023-06-09T04:39:41.979117+0000","last_fullsized":"2023-06-09T04:39:41.979117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:31.542873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.981962+0000","last_change":"2023-06-09T04:39:40.982461+0000","last_active":"2023-06-09T04:39:41.981962+0000","last_peered":"2023-06-09T04:39:41.981962+0000","last_clean":"2023-06-09T04:39:41.981962+0000","last_became_active":"2023-06-09T04:39:40.981948+0000","last_became_peered":"2023-06-09T04:39:40.981948+0000","last_unstale":"2023-06-09T04:39:41.981962+0000","last_undegraded":"2023-06-09T04:39:41.981962+0000","last_fullsized":"2023-06-09T04:39:41.981962+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:25:38.078169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.416336+0000","last_change":"2023-06-09T04:39:40.611505+0000","last_active":"2023-06-09T04:39:42.416336+0000","last_peered":"2023-06-09T04:39:42.416336+0000","last_clean":"2023-06-09T04:39:42.416336+0000","last_became_active":"2023-06-09T04:39:40.609878+0000","last_became_peered":"2023-06-09T04:39:40.609878+0000","last_unstale":"2023-06-09T04:39:42.416336+0000","last_undegraded":"2023-06-09T04:39:42.416336+0000","last_fullsized":"2023-06-09T04:39:42.416336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:56.216461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414000+0000","last_change":"2023-06-09T04:38:07.009369+0000","last_active":"2023-06-09T04:39:42.414000+0000","last_peered":"2023-06-09T04:39:42.414000+0000","last_clean":"2023-06-09T04:39:42.414000+0000","last_became_active":"2023-06-09T04:38:07.008657+0000","last_became_peered":"2023-06-09T04:38:07.008657+0000","last_unstale":"2023-06-09T04:39:42.414000+0000","last_undegraded":"2023-06-09T04:39:42.414000+0000","last_fullsized":"2023-06-09T04:39:42.414000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:40.493562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979829+0000","last_change":"2023-06-09T04:39:41.000103+0000","last_active":"2023-06-09T04:39:41.979829+0000","last_peered":"2023-06-09T04:39:41.979829+0000","last_clean":"2023-06-09T04:39:41.979829+0000","last_became_active":"2023-06-09T04:39:40.999338+0000","last_became_peered":"2023-06-09T04:39:40.999338+0000","last_unstale":"2023-06-09T04:39:41.979829+0000","last_undegraded":"2023-06-09T04:39:41.979829+0000","last_fullsized":"2023-06-09T04:39:41.979829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:23:54.257011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.414718+0000","last_change":"2023-06-09T04:39:40.612529+0000","last_active":"2023-06-09T04:39:42.414718+0000","last_peered":"2023-06-09T04:39:42.414718+0000","last_clean":"2023-06-09T04:39:42.414718+0000","last_became_active":"2023-06-09T04:39:40.611514+0000","last_became_peered":"2023-06-09T04:39:40.611514+0000","last_unstale":"2023-06-09T04:39:42.414718+0000","last_undegraded":"2023-06-09T04:39:42.414718+0000","last_fullsized":"2023-06-09T04:39:42.414718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:30:42.783826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978716+0000","last_change":"2023-06-09T04:38:07.005923+0000","last_active":"2023-06-09T04:39:41.978716+0000","last_peered":"2023-06-09T04:39:41.978716+0000","last_clean":"2023-06-09T04:39:41.978716+0000","last_became_active":"2023-06-09T04:38:07.005568+0000","last_became_peered":"2023-06-09T04:38:07.005568+0000","last_unstale":"2023-06-09T04:39:41.978716+0000","last_undegraded":"2023-06-09T04:39:41.978716+0000","last_fullsized":"2023-06-09T04:39:41.978716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:34:18.482882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.983194+0000","last_change":"2023-06-09T04:39:40.996130+0000","last_active":"2023-06-09T04:39:41.983194+0000","last_peered":"2023-06-09T04:39:41.983194+0000","last_clean":"2023-06-09T04:39:41.983194+0000","last_became_active":"2023-06-09T04:39:40.995502+0000","last_became_peered":"2023-06-09T04:39:40.995502+0000","last_unstale":"2023-06-09T04:39:41.983194+0000","last_undegraded":"2023-06-09T04:39:41.983194+0000","last_fullsized":"2023-06-09T04:39:41.983194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:40.561275+0000","last_clean_scrub_stamp":"2023-06-09T04:39:40.561275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:03:25.543583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.979759+0000","last_change":"2023-06-09T04:39:40.623024+0000","last_active":"2023-06-09T04:39:41.979759+0000","last_peered":"2023-06-09T04:39:41.979759+0000","last_clean":"2023-06-09T04:39:41.979759+0000","last_became_active":"2023-06-09T04:39:40.622717+0000","last_became_peered":"2023-06-09T04:39:40.622717+0000","last_unstale":"2023-06-09T04:39:41.979759+0000","last_undegraded":"2023-06-09T04:39:41.979759+0000","last_fullsized":"2023-06-09T04:39:41.979759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:39:39.549584+0000","last_clean_scrub_stamp":"2023-06-09T04:39:39.549584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:45:23.910127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:41.978985+0000","last_change":"2023-06-09T04:38:07.003327+0000","last_active":"2023-06-09T04:39:41.978985+0000","last_peered":"2023-06-09T04:39:41.978985+0000","last_clean":"2023-06-09T04:39:41.978985+0000","last_became_active":"2023-06-09T04:38:07.003054+0000","last_became_peered":"2023-06-09T04:38:07.003054+0000","last_unstale":"2023-06-09T04:39:41.978985+0000","last_undegraded":"2023-06-09T04:39:41.978985+0000","last_fullsized":"2023-06-09T04:39:41.978985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:05.979236+0000","last_clean_scrub_stamp":"2023-06-09T04:38:05.979236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:40:51.059901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:39:42.415547+0000","last_change":"2023-06-09T04:37:59.478232+0000","last_active":"2023-06-09T04:39:42.415547+0000","last_peered":"2023-06-09T04:39:42.415547+0000","last_clean":"2023-06-09T04:39:42.415547+0000","last_became_active":"2023-06-09T04:37:59.477705+0000","last_became_peered":"2023-06-09T04:37:59.477705+0000","last_unstale":"2023-06-09T04:39:42.415547+0000","last_undegraded":"2023-06-09T04:39:42.415547+0000","last_fullsized":"2023-06-09T04:39:42.415547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:37:58.460152+0000","last_clean_scrub_stamp":"2023-06-09T04:37:58.460152+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:42:17.779240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":479232,"data_stored":207673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.02},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.089},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.97099999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.95099999999999996}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.0660000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":1064960,"data_stored":796547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.83399999999999996}]},{"osd":4,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.03}]},{"osd":5,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.075},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.149}]},{"osd":7,"last update":"Fri Jun 9 04:39:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.995},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.052}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":475136,"data_stored":206781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.752}]},{"osd":3,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.97799999999999998}]},{"osd":6,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":18.922999999999998,"5min":18.922999999999998,"15min":18.922999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:38:59 2023","interfaces":[{"interface":"back","average":{"1min":1.786,"5min":1.786,"15min":1.786},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.608000000000001,"5min":12.608000000000001,"15min":12.608000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":11.99,"5min":11.99,"15min":11.99},"last":0.83899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":206143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68500000000000005}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.745},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.016}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":1.099},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.98399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":206725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.6539999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1470000000000002,"5min":5.1470000000000002,"15min":5.1470000000000002},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.2149999999999999,"5min":5.2149999999999999,"15min":5.2149999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.085},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.0869999999999997,"5min":6.0869999999999997,"15min":6.0869999999999997},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Jun 9 04:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.0249999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":1.0509999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":0.91300000000000003}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.1859999999999999,"5min":3.1859999999999999,"15min":3.1859999999999999},"last":0.85799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":1064960,"data_stored":796499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.002}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.96299999999999997}]},{"osd":3,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.117},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.171}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.048},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0620000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":207765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.62}]},{"osd":1,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.79400000000000004}]},{"osd":2,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jun 9 04:39:03 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.099},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Jun 9 04:38:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.28}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":471040,"data_stored":206199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.9500000000000002,"5min":3.9500000000000002,"15min":3.9500000000000002},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:38:58 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:39:49.843 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:39:49.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-09T04:39:50.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 Processor -- start 2023-06-09T04:39:50.012 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 -- start start 2023-06-09T04:39:50.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3b015c000 0x7fd3b00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.013 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3b015c3d0 0x7fd3b00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b00cb790 con 0x7fd3b015c3d0 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b00c9060 con 0x7fd3b015c000 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3b605a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00caf30 con 0x7fd3b0158730 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3b015c3d0 0x7fd3b00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3b015c3d0 0x7fd3b00b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34194/0 (socket says 172.21.15.18:34194) 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 -- 172.21.15.18:0/2813015400 learned_addr learned my addr 172.21.15.18:0/2813015400 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3aeffd640 1 --2- 172.21.15.18:0/2813015400 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.014 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3af7fe640 1 --2- 172.21.15.18:0/2813015400 >> v2:172.21.15.81:3300/0 conn(0x7fd3b015c000 0x7fd3b00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 -- 172.21.15.18:0/2813015400 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 msgr2=0x7fd3b00c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 --2- 172.21.15.18:0/2813015400 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 -- 172.21.15.18:0/2813015400 >> v2:172.21.15.81:3300/0 conn(0x7fd3b015c000 msgr2=0x7fd3b00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 --2- 172.21.15.18:0/2813015400 >> v2:172.21.15.81:3300/0 conn(0x7fd3b015c000 0x7fd3b00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.010+0000 7fd3affff640 1 -- 172.21.15.18:0/2813015400 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b00cb1d0 con 0x7fd3b015c3d0 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3affff640 1 --2- 172.21.15.18:0/2813015400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00b32d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00701e0 tx=0x7fd3a001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812d96dd2b6302ee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3ae7fc640 1 -- 172.21.15.18:0/2813015400 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00ab600 con 0x7fd3b015c3d0 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3ae7fc640 1 -- 172.21.15.18:0/2813015400 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a00a7050 con 0x7fd3b015c3d0 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3ae7fc640 1 -- 172.21.15.18:0/2813015400 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a00ab980 con 0x7fd3b015c3d0 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 -- 172.21.15.18:0/2813015400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c3d0 msgr2=0x7fd3b00b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2813015400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00b32d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00701e0 tx=0x7fd3a001c240 comp rx=0 tx=0).stop 2023-06-09T04:39:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 -- 172.21.15.18:0/2813015400 shutdown_connections 2023-06-09T04:39:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2813015400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00b32d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2813015400 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2813015400 >> v2:172.21.15.81:3300/0 conn(0x7fd3b015c000 0x7fd3b00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 -- 172.21.15.18:0/2813015400 >> 172.21.15.18:0/2813015400 conn(0x7fd3b00b1280 msgr2=0x7fd3b00b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 -- 172.21.15.18:0/2813015400 shutdown_connections 2023-06-09T04:39:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 -- 172.21.15.18:0/2813015400 wait complete. 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 Processor -- start 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 -- start start 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.014+0000 7fd3b605a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 0x7fd3b00c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00c49f0 con 0x7fd3b015c000 2023-06-09T04:39:50.020 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0162e70 con 0x7fd3b015c3d0 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00ab1e0 con 0x7fd3b0158730 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 0x7fd3b00c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 0x7fd3b00c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34208/0 (socket says 172.21.15.18:34208) 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 -- 172.21.15.18:0/2984517604 learned_addr learned my addr 172.21.15.18:0/2984517604 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3affff640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3af7fe640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 -- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 msgr2=0x7fd3b00c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 -- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b015c3d0 msgr2=0x7fd3b00c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 -- 172.21.15.18:0/2984517604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00094d0 con 0x7fd3b015c000 2023-06-09T04:39:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3aeffd640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 0x7fd3b00c3f70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd39800d800 tx=0x7fd39800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3980096a0 con 0x7fd3b015c000 2023-06-09T04:39:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398009800 con 0x7fd3b015c000 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b00ab4c0 con 0x7fd3b015c000 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398009b70 con 0x7fd3b015c000 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b00aba80 con 0x7fd3b015c000 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b0073380 con 0x7fd3b015c000 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd398009cd0 con 0x7fd3b015c000 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3a7fff640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd390066280 0x7fd390068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd398084380 con 0x7fd3b015c000 2023-06-09T04:39:50.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.018+0000 7fd3af7fe640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd390066280 0x7fd390068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.025 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.022+0000 7fd3af7fe640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd390066280 0x7fd390068730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8003b90 tx=0x7fd3a80098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.022+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd398051800 con 0x7fd3b015c000 2023-06-09T04:39:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.242+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd3b00ce8f0 con 0x7fd3b015c000 2023-06-09T04:39:50.253 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.250+0000 7fd3a7fff640 1 -- 172.21.15.18:0/2984517604 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd398054e20 con 0x7fd3b015c000 2023-06-09T04:39:50.253 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2023-06-09T04:39:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd390066280 msgr2=0x7fd390068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd390066280 0x7fd390068730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8003b90 tx=0x7fd3a80098d0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 msgr2=0x7fd3b00c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 0x7fd3b00c3f70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd39800d800 tx=0x7fd39800dcc0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.257 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 shutdown_connections 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3b015c3d0 0x7fd3b00c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b015c000 0x7fd3b00c3f70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fd390066280 0x7fd390068730 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 --2- 172.21.15.18:0/2984517604 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd3b0158730 0x7fd3b00c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 >> 172.21.15.18:0/2984517604 conn(0x7fd3b00b1280 msgr2=0x7fd3b01554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 shutdown_connections 2023-06-09T04:39:50.258 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.254+0000 7fd3b605a640 1 -- 172.21.15.18:0/2984517604 wait complete. 2023-06-09T04:39:50.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:39:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.398+0000 7fe74f6fa640 1 Processor -- start 2023-06-09T04:39:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.398+0000 7fe74f6fa640 1 -- start start 2023-06-09T04:39:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74f6fa640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe74815b770 0x7fe7480cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74f6fa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7480ca2a0 0x7fe74806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74f6fa640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480ca6f0 con 0x7fe7480cc260 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74f6fa640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74815fb70 con 0x7fe74815b770 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74f6fa640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7480cdf60 con 0x7fe7480ca2a0 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe74815b770 0x7fe7480cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe74815b770 0x7fe7480cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34214/0 (socket says 172.21.15.18:34214) 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 -- 172.21.15.18:0/1369903013 learned_addr learned my addr 172.21.15.18:0/1369903013 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74cc95640 1 --2- 172.21.15.18:0/1369903013 >> v2:172.21.15.81:3300/0 conn(0x7fe7480ca2a0 0x7fe74806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 -- 172.21.15.18:0/1369903013 >> v2:172.21.15.81:3300/0 conn(0x7fe7480ca2a0 msgr2=0x7fe74806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 --2- 172.21.15.18:0/1369903013 >> v2:172.21.15.81:3300/0 conn(0x7fe7480ca2a0 0x7fe74806ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 -- 172.21.15.18:0/1369903013 >> v1:172.21.15.81:6789/0 conn(0x7fe7480cc260 legacy=0x7fe74815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 -- 172.21.15.18:0/1369903013 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7481600a0 con 0x7fe74815b770 2023-06-09T04:39:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe74d496640 1 --2- 172.21.15.18:0/1369903013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74815b770 0x7fe7480cf4e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe7480b2810 tx=0x7fe74401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cfbf633aff016e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe73ffff640 1 -- 172.21.15.18:0/1369903013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440ab600 con 0x7fe74815b770 2023-06-09T04:39:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe73ffff640 1 -- 172.21.15.18:0/1369903013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7440a7050 con 0x7fe74815b770 2023-06-09T04:39:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.402+0000 7fe73ffff640 1 -- 172.21.15.18:0/1369903013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440ab980 con 0x7fe74815b770 2023-06-09T04:39:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/1369903013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74815b770 msgr2=0x7fe7480cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/1369903013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74815b770 0x7fe7480cf4e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe7480b2810 tx=0x7fe74401c430 comp rx=0 tx=0).stop 2023-06-09T04:39:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/1369903013 shutdown_connections 2023-06-09T04:39:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/1369903013 >> v2:172.21.15.81:3300/0 conn(0x7fe7480ca2a0 0x7fe74806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/1369903013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74815b770 0x7fe7480cf4e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/1369903013 >> 172.21.15.18:0/1369903013 conn(0x7fe74806f850 msgr2=0x7fe74806fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/1369903013 shutdown_connections 2023-06-09T04:39:50.409 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/1369903013 wait complete. 2023-06-09T04:39:50.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 Processor -- start 2023-06-09T04:39:50.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- start start 2023-06-09T04:39:50.410 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7480ca2a0 0x7fe74814e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 0x7fe7480b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74815b770 0x7fe7480af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480b4c50 con 0x7fe7480cc260 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480b59b0 con 0x7fe74815b770 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480b4e30 con 0x7fe7480ca2a0 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 0x7fe7480b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.411 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 0x7fe7480b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34220/0 (socket says 172.21.15.18:34220) 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 -- 172.21.15.18:0/2581604450 learned_addr learned my addr 172.21.15.18:0/2581604450 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74d496640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7480ca2a0 0x7fe74814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74dc97640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74815b770 0x7fe7480af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 -- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7480ca2a0 msgr2=0x7fe74814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7480ca2a0 0x7fe74814e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 -- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74815b770 msgr2=0x7fe7480af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.412 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74815b770 0x7fe7480af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 -- 172.21.15.18:0/2581604450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440094d0 con 0x7fe7480cc260 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74cc95640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 0x7fe7480b1c00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe73800d5f0 tx=0x7fe73800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380125f0 con 0x7fe7480cc260 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe738012750 con 0x7fe7480cc260 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7480b5110 con 0x7fe7480cc260 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738012ae0 con 0x7fe7480cc260 2023-06-09T04:39:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.406+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7480b56d0 con 0x7fe7480cc260 2023-06-09T04:39:50.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.410+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748073380 con 0x7fe7480cc260 2023-06-09T04:39:50.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.410+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe738012c40 con 0x7fe7480cc260 2023-06-09T04:39:50.414 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.410+0000 7fe73dffb640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe72c0662b0 0x7fe72c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:50.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.410+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe738084280 con 0x7fe7480cc260 2023-06-09T04:39:50.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.410+0000 7fe74d496640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe72c0662b0 0x7fe72c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:50.415 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.410+0000 7fe74d496640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe72c0662b0 0x7fe72c068760 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe7440ad000 tx=0x7fe7440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:50.416 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.414+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe738051650 con 0x7fe7480cc260 2023-06-09T04:39:50.605 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.602+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe74806eb20 con 0x7fe7480cc260 2023-06-09T04:39:50.606 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.602+0000 7fe73dffb640 1 -- 172.21.15.18:0/2581604450 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fe738054c70 con 0x7fe7480cc260 2023-06-09T04:39:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:39:50.607 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4982,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/286358866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":286358866},{"type":"v1","addr":"172.21.15.81:6836","nonce":286358866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/17695310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":17695310},{"type":"v1","addr":"172.21.15.18:6834","nonce":17695310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3934903071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3934903071},{"type":"v1","addr":"172.21.15.18:6835","nonce":3934903071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:39:40.957288+0000","modified":"2023-06-09T04:39:43.978585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5634":{"gid":5634,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2632765373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2632765373},{"type":"v1","addr":"172.21.15.81:6837","nonce":2632765373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:39:50.607 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 16 2023-06-09T04:39:50.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe72c0662b0 msgr2=0x7fe72c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe72c0662b0 0x7fe72c068760 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe7440ad000 tx=0x7fe7440a6000 comp rx=0 tx=0).stop 2023-06-09T04:39:50.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 msgr2=0x7fe7480b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:50.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 0x7fe7480b1c00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe73800d5f0 tx=0x7fe73800dab0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.609 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 shutdown_connections 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74815b770 0x7fe7480af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7480cc260 0x7fe7480b1c00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fe72c0662b0 0x7fe72c068760 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 --2- 172.21.15.18:0/2581604450 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe7480ca2a0 0x7fe74814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 >> 172.21.15.18:0/2581604450 conn(0x7fe74806f850 msgr2=0x7fe748150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 shutdown_connections 2023-06-09T04:39:50.610 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:50.606+0000 7fe74f6fa640 1 -- 172.21.15.18:0/2581604450 wait complete. 2023-06-09T04:39:51.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:39:40.957288+0000', 'modified': '2023-06-09T04:39:43.978585+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5634': {'gid': 5634, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2632765373', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2632765373}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2632765373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:39:51.028 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:39:51.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-09T04:39:51.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 Processor -- start 2023-06-09T04:39:51.164 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 -- start start 2023-06-09T04:39:51.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf9015b770 0x7fbf900cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf900cc970 0x7fbf9006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf900ca6f0 con 0x7fbf900ca2a0 2023-06-09T04:39:51.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9015fb70 con 0x7fbf900cc970 2023-06-09T04:39:51.166 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf95806640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900cdf60 con 0x7fbf9015b770 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbf900ca2a0 0x7fbf900cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36350/0 (socket says 172.21.15.18:36350) 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8e7fc640 1 -- 172.21.15.18:0/2194633470 learned_addr learned my addr 172.21.15.18:0/2194633470 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2194633470 >> v2:172.21.15.18:3300/0 conn(0x7fbf900cc970 0x7fbf9006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2194633470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf9015b770 0x7fbf900cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8dffb640 1 -- 172.21.15.18:0/2194633470 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225445337 0 0) 0x7fbf880014a0 con 0x7fbf900ca2a0 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8dffb640 1 -- 172.21.15.18:0/2194633470 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf70003530 con 0x7fbf900ca2a0 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2194633470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf9015b770 msgr2=0x7fbf900cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.167 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2194633470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf9015b770 0x7fbf900cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2194633470 >> v1:172.21.15.18:6789/0 conn(0x7fbf900ca2a0 legacy=0x7fbf900cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.168 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.162+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2194633470 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf901600a0 con 0x7fbf900cc970 2023-06-09T04:39:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2194633470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9006ed40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbf800097c0 tx=0x7fbf8001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf97ff8a29e890c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf8dffb640 1 -- 172.21.15.18:0/2194633470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800ab600 con 0x7fbf900cc970 2023-06-09T04:39:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf8dffb640 1 -- 172.21.15.18:0/2194633470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800a7050 con 0x7fbf900cc970 2023-06-09T04:39:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf8dffb640 1 -- 172.21.15.18:0/2194633470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800ab960 con 0x7fbf900cc970 2023-06-09T04:39:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 -- 172.21.15.18:0/2194633470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 msgr2=0x7fbf9006ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.169 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 --2- 172.21.15.18:0/2194633470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9006ed40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbf800097c0 tx=0x7fbf8001c3f0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 -- 172.21.15.18:0/2194633470 shutdown_connections 2023-06-09T04:39:51.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 --2- 172.21.15.18:0/2194633470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9006ed40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 --2- 172.21.15.18:0/2194633470 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf9015b770 0x7fbf900cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 -- 172.21.15.18:0/2194633470 >> 172.21.15.18:0/2194633470 conn(0x7fbf9006f850 msgr2=0x7fbf9006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 -- 172.21.15.18:0/2194633470 shutdown_connections 2023-06-09T04:39:51.170 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 -- 172.21.15.18:0/2194633470 wait complete. 2023-06-09T04:39:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 Processor -- start 2023-06-09T04:39:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.166+0000 7fbf95806640 1 -- start start 2023-06-09T04:39:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf900ca2a0 0x7fbf90147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.172 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf9015b770 0x7fbf9015f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b1490 con 0x7fbf900cc970 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b1770 con 0x7fbf9015b770 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b2a80 con 0x7fbf900ca2a0 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9015ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34240/0 (socket says 172.21.15.18:34240) 2023-06-09T04:39:51.173 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 -- 172.21.15.18:0/2002609729 learned_addr learned my addr 172.21.15.18:0/2002609729 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf900ca2a0 0x7fbf90147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf9015b770 0x7fbf9015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 -- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf900ca2a0 msgr2=0x7fbf90147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf900ca2a0 0x7fbf90147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 -- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf9015b770 msgr2=0x7fbf9015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf9015b770 0x7fbf9015f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 -- 172.21.15.18:0/2002609729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009420 con 0x7fbf900cc970 2023-06-09T04:39:51.174 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf9015b770 0x7fbf9015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:39:51.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9015ebd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800cbb0 tx=0x7fbf8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf87fff640 1 -- 172.21.15.18:0/2002609729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800ad40 con 0x7fbf900cc970 2023-06-09T04:39:51.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf87fff640 1 -- 172.21.15.18:0/2002609729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88012400 con 0x7fbf900cc970 2023-06-09T04:39:51.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900b2d60 con 0x7fbf900cc970 2023-06-09T04:39:51.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf87fff640 1 -- 172.21.15.18:0/2002609729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800aea0 con 0x7fbf900cc970 2023-06-09T04:39:51.175 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf900b0f90 con 0x7fbf900cc970 2023-06-09T04:39:51.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf87fff640 1 -- 172.21.15.18:0/2002609729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf880127d0 con 0x7fbf900cc970 2023-06-09T04:39:51.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf87fff640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbf74066280 0x7fbf74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf87fff640 1 -- 172.21.15.18:0/2002609729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbf88083d20 con 0x7fbf900cc970 2023-06-09T04:39:51.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.170+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbf74066280 0x7fbf74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.178 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 Processor -- start 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- start start 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbf74066280 0x7fbf74068730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009a50 tx=0x7fbf78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938150 0x55557d938520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938a60 0x55557d8ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d8eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d7b6540 con 0x55557d8ee920 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d6ef840 con 0x55557d938a60 2023-06-09T04:39:51.179 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55557d742e60 con 0x55557d938150 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d8eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d8eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34250/0 (socket says 172.21.15.18:34250) 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2367740005 learned_addr learned my addr 172.21.15.18:0/2367740005 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938150 0x55557d938520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938a60 0x55557d8ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938150 msgr2=0x55557d938520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.180 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938150 0x55557d938520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938a60 msgr2=0x55557d8ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938a60 0x55557d8ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2367740005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55557d438890 con 0x55557d8ee920 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938a60 0x55557d8ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d8eecf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbf800ae040 tx=0x7fbf80004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779389000fc25ce6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf857fa640 1 -- 172.21.15.18:0/2367740005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800042c0 con 0x55557d8ee920 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf857fa640 1 -- 172.21.15.18:0/2367740005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80004420 con 0x55557d8ee920 2023-06-09T04:39:51.181 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf857fa640 1 -- 172.21.15.18:0/2367740005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003840 con 0x55557d8ee920 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- 172.21.15.18:0/2367740005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 msgr2=0x55557d8eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d8eecf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbf800ae040 tx=0x7fbf80004740 comp rx=0 tx=0).stop 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- 172.21.15.18:0/2367740005 shutdown_connections 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d8eecf0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938a60 0x55557d8ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- 172.21.15.18:0/2367740005 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938150 0x55557d938520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.182 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- 172.21.15.18:0/2367740005 >> 172.21.15.18:0/2367740005 conn(0x55557d794370 msgr2=0x55557d8eccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- 172.21.15.18:0/2367740005 shutdown_connections 2023-06-09T04:39:51.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- 172.21.15.18:0/2367740005 wait complete. 2023-06-09T04:39:51.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- start start 2023-06-09T04:39:51.183 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 Processor -- start 2023-06-09T04:39:51.185 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d8f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d8f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d8f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d73bf00 con 0x55557d938a60 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.174+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d6f8ae0 con 0x55557d938150 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55557d6f8780 con 0x55557d8ee920 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 10 client.0 _ll_register_callbacks cb 0x55557d8da060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:39:51.186 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d8f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d8f9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34262/0 (socket says 172.21.15.18:34262) 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2330618098 learned_addr learned my addr 172.21.15.18:0/2330618098 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d8f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d8f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 msgr2=0x55557d8f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d8f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 msgr2=0x55557d8f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.187 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d8f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2330618098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf901600a0 con 0x55557d938a60 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d8f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d8f9a70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbf8001c8d0 tx=0x7fbf800046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6462a22a7d804f00 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/2330618098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003820 con 0x55557d938a60 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/2330618098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbf80003980 con 0x55557d938a60 2023-06-09T04:39:51.188 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55557d6f52d0 con 0x55557d938a60 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/2330618098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf80003b40 con 0x55557d938a60 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 10 client.5847 fetch_fsmap learned FSMap version 16 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55557d700d10 con 0x55557d938a60 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/2330618098 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55557d6f52d0 con 0x55557d938a60 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/2330618098 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbf800bb070 con 0x55557d938a60 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 10 client.5847 fetch_fsmap finished waiting for FSMap version 16 2023-06-09T04:39:51.189 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 10 client.5847 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 20 client.5847 populate_metadata read hostname 'smithi018' 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d93e770 0x55557d93eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 4 client.5847 mds_command: new command op to 5634 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 --> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55557d73a850 con 0x55557d93e770 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d93e770 0x55557d93eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d93e770 0x55557d93eb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43968e029431a026 server_cookie=479eed8d078121d2 in_seq=0 out_seq=0 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 10 client.5847 ms_handle_connect on v2:172.21.15.81:6835/2632765373 2023-06-09T04:39:51.190 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/2330618098 <== mds.0 v2:172.21.15.81:6835/2632765373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55557d73a850 con 0x55557d93e770 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.178+0000 7fbf7e7fc640 10 client.5847 handle_command_reply: tid=0 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 client.5847 shutdown 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 msgr2=0x55557d8f9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d8f9a70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbf8001c8d0 tx=0x7fbf800046d0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 shutdown_connections 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d93e770 0x55557d93eb40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d8f9a70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d8f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf7e7fc640 0 client.5847 ms_handle_reset on v2:172.21.15.81:6835/2632765373 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 --2- 172.21.15.18:0/2330618098 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d8f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 >> 172.21.15.18:0/2330618098 conn(0x55557d794370 msgr2=0x55557d8ed3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 shutdown_connections 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 1 -- 172.21.15.18:0/2330618098 wait complete. 2023-06-09T04:39:51.192 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.182+0000 7fbf98922000 20 client.5847 trim_cache size 0 max 16384 2023-06-09T04:39:51.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.194+0000 7fbf98922000 1 Processor -- start 2023-06-09T04:39:51.198 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.194+0000 7fbf98922000 1 -- start start 2023-06-09T04:39:51.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d937500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d937a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d938e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.200 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d3f9940 con 0x55557d938a60 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d6e4450 con 0x55557d938150 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55557d7042f0 con 0x55557d8ee920 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d938e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d938e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34272/0 (socket says 172.21.15.18:34272) 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2309667947 learned_addr learned my addr 172.21.15.18:0/2309667947 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d937a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d937500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 msgr2=0x55557d937500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d937500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 msgr2=0x55557d937a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d937a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 -- 172.21.15.18:0/2309667947 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55557d6e6fa0 con 0x55557d938a60 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d937500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d938e30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbf8001cc90 tx=0x7fbf800b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa31f8cee4c7ab9c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf85ffb640 1 -- 172.21.15.18:0/2309667947 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80004450 con 0x55557d938a60 2023-06-09T04:39:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf85ffb640 1 -- 172.21.15.18:0/2309667947 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800b4ac0 con 0x55557d938a60 2023-06-09T04:39:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf85ffb640 1 -- 172.21.15.18:0/2309667947 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800b4e70 con 0x55557d938a60 2023-06-09T04:39:51.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- 172.21.15.18:0/2309667947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 msgr2=0x55557d938e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d938e30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbf8001cc90 tx=0x7fbf800b4000 comp rx=0 tx=0).stop 2023-06-09T04:39:51.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- 172.21.15.18:0/2309667947 shutdown_connections 2023-06-09T04:39:51.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d938a60 0x55557d938e30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d937a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.206 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- 172.21.15.18:0/2309667947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d8ee920 0x55557d937500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- 172.21.15.18:0/2309667947 >> 172.21.15.18:0/2309667947 conn(0x55557d794370 msgr2=0x55557d8f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- 172.21.15.18:0/2309667947 shutdown_connections 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- 172.21.15.18:0/2309667947 wait complete. 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- start start 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 Processor -- start 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d995560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d995aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938a60 0x55557d93c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d70b320 con 0x55557d8ee920 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55557d73ea60 con 0x55557d938150 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55557d6d9a80 con 0x55557d938a60 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf98922000 10 client.0 _ll_register_callbacks cb 0x55557d6db2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d995560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.208 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d995560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34276/0 (socket says 172.21.15.18:34276) 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 -- 172.21.15.18:0/1862399587 learned_addr learned my addr 172.21.15.18:0/1862399587 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d995aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938a60 0x55557d93c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 -- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938a60 msgr2=0x55557d93c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938a60 0x55557d93c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 -- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 msgr2=0x55557d995aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d995aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8effd640 1 -- 172.21.15.18:0/1862399587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55557d700d10 con 0x55557d8ee920 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8f7fe640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938a60 0x55557d93c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.198+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d995aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf8effd640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d995560 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbf78011c10 tx=0x7fbf78004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d547a8fc523379c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/1862399587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78028040 con 0x55557d8ee920 2023-06-09T04:39:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/1862399587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbf78029450 con 0x55557d8ee920 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55557d6c3a80 con 0x55557d8ee920 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/1862399587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf78029610 con 0x55557d8ee920 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 10 client.5853 fetch_fsmap learned FSMap version 16 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55557d438cc0 con 0x55557d8ee920 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/1862399587 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55557d6c3a80 con 0x55557d8ee920 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/1862399587 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbf78015910 con 0x55557d8ee920 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 10 client.5853 fetch_fsmap finished waiting for FSMap version 16 2023-06-09T04:39:51.211 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 10 client.5853 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 20 client.5853 populate_metadata read hostname 'smithi018' 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d99c3c0 0x55557d99e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 4 client.5853 mds_command: new command op to 5634 tid=0[{"prefix": "status"}] 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 --> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55557d734ee0 con 0x55557d99c3c0 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d99c3c0 0x55557d99e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf8e7fc640 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d99c3c0 0x55557d99e7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bf828c4b2aab88 server_cookie=d50d1b504ac781cc in_seq=0 out_seq=0 2023-06-09T04:39:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 10 client.5853 ms_handle_connect on v2:172.21.15.81:6835/2632765373 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 1 -- 172.21.15.18:0/1862399587 <== mds.0 v2:172.21.15.81:6835/2632765373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55557d734ee0 con 0x55557d99c3c0 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 10 client.5853 handle_command_reply: tid=0 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 client.5853 shutdown 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 msgr2=0x55557d995560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d995560 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbf78011c10 tx=0x7fbf78004740 comp rx=0 tx=0).stop 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 shutdown_connections 2023-06-09T04:39:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:6835/2632765373,v1:172.21.15.81:6837/2632765373] conn(0x55557d99c3c0 0x55557d99e7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55557d938a60 0x55557d93c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55557d938150 0x55557d995aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 --2- 172.21.15.18:0/1862399587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55557d8ee920 0x55557d995560 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf7e7fc640 0 client.5853 ms_handle_reset on v2:172.21.15.81:6835/2632765373 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 >> 172.21.15.18:0/1862399587 conn(0x55557d794370 msgr2=0x55557d9364f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 shutdown_connections 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 1 -- 172.21.15.18:0/1862399587 wait complete. 2023-06-09T04:39:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf98922000 20 client.5853 trim_cache size 0 max 16384 2023-06-09T04:39:51.215 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:39:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "eb85c981-43c8-4596-9c30-77e5bafdb8a3", 2023-06-09T04:39:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2023-06-09T04:39:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 5634, 2023-06-09T04:39:51.215 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 10.243814423, 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 16, 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 41, 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 41, 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 17.537567320000001 2023-06-09T04:39:51.216 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:39:51.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbf74066280 msgr2=0x7fbf74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbf74066280 0x7fbf74068730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009a50 tx=0x7fbf78008040 comp rx=0 tx=0).stop 2023-06-09T04:39:51.217 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 msgr2=0x7fbf9015ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9015ebd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800cbb0 tx=0x7fbf8800a430 comp rx=0 tx=0).stop 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 shutdown_connections 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf9015b770 0x7fbf9015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf900cc970 0x7fbf9015ebd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7fbf74066280 0x7fbf74068730 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 --2- 172.21.15.18:0/2002609729 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf900ca2a0 0x7fbf90147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 >> 172.21.15.18:0/2002609729 conn(0x7fbf9006f850 msgr2=0x7fbf90151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 shutdown_connections 2023-06-09T04:39:51.219 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.202+0000 7fbf95806640 1 -- 172.21.15.18:0/2002609729 wait complete. 2023-06-09T04:39:51.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:39:51.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f775d8640 1 Processor -- start 2023-06-09T04:39:51.329 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f775d8640 1 -- start start 2023-06-09T04:39:51.330 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f775d8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 0x7f0f700c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f775d8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f70069350 con 0x7f0f7015f8f0 2023-06-09T04:39:51.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f775d8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f700ce8a0 con 0x7f0f70070270 2023-06-09T04:39:51.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f775d8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700695f0 con 0x7f0f700708a0 2023-06-09T04:39:51.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f75374640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0f7015f8f0 0x7f0f7006fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36352/0 (socket says 172.21.15.18:36352) 2023-06-09T04:39:51.331 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.326+0000 7f0f75374640 1 -- 172.21.15.18:0/76003698 learned_addr learned my addr 172.21.15.18:0/76003698 (peer_addr_for_me v1:172.21.15.18:0/0) 2023-06-09T04:39:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 0x7f0f700c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629994804 0 0) 0x7f0f70069350 con 0x7f0f7015f8f0 2023-06-09T04:39:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f58003530 con 0x7f0f7015f8f0 2023-06-09T04:39:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729989426 0 0) 0x7f0f58003530 con 0x7f0f7015f8f0 2023-06-09T04:39:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 msgr2=0x7f0f700c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 0x7f0f700c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 >> v1:172.21.15.81:6789/0 conn(0x7f0f70070270 legacy=0x7f0f700c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700698d0 con 0x7f0f7015f8f0 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3535453941 0 0) 0x7f0f64001680 con 0x7f0f7015f8f0 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 >> v1:172.21.15.18:6789/0 conn(0x7f0f7015f8f0 legacy=0x7f0f7006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580039b0 0x7f0f58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 0x7f0f580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f58004d10 0x7f0f58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700695f0 con 0x7f0f58004d10 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5800ba40 con 0x7f0f580039b0 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5800bbd0 con 0x7f0f700708a0 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f58004d10 0x7f0f58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75374640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580039b0 0x7f0f58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f74b73640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 0x7f0f580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 -- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 msgr2=0x7f0f580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700708a0 0x7f0f580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 -- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580039b0 msgr2=0x7f0f58003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:39:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580039b0 0x7f0f58003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 -- 172.21.15.18:0/76003698 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58003530 con 0x7f0f58004d10 2023-06-09T04:39:51.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f58004d10 0x7f0f58005180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009ab0 tx=0x7f0f6801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353809670f0326a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.338 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680a5620 con 0x7f0f58004d10 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680a5780 con 0x7f0f58004d10 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f6ffff640 1 -- 172.21.15.18:0/76003698 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680a5af0 con 0x7f0f58004d10 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f775d8640 1 -- 172.21.15.18:0/76003698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f58004d10 msgr2=0x7f0f58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f775d8640 1 --2- 172.21.15.18:0/76003698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f58004d10 0x7f0f58005180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009ab0 tx=0x7f0f6801ca30 comp rx=0 tx=0).stop 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f75b75640 1 -- 172.21.15.18:0/76003698 reap_dead start 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f775d8640 1 -- 172.21.15.18:0/76003698 shutdown_connections 2023-06-09T04:39:51.339 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f775d8640 1 -- 172.21.15.18:0/76003698 >> 172.21.15.18:0/76003698 conn(0x7f0f700b0240 msgr2=0x7f0f700cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.330+0000 7f0f775d8640 1 -- 172.21.15.18:0/76003698 shutdown_connections 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- 172.21.15.18:0/76003698 wait complete. 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 Processor -- start 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- start start 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 0x7f0f700b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f700b2fa0 0x7f0f700bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700bd6a0 0x7f0f701f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.340 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700bde90 con 0x7f0f7015d8d0 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c14f0 con 0x7f0f700b2fa0 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700b3410 con 0x7f0f700bd6a0 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 0x7f0f700b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 0x7f0f700b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34300/0 (socket says 172.21.15.18:34300) 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 -- 172.21.15.18:0/1964638522 learned_addr learned my addr 172.21.15.18:0/1964638522 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f74b73640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f700b2fa0 0x7f0f700bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.341 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75b75640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700bd6a0 0x7f0f701f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 -- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700bd6a0 msgr2=0x7f0f701f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700bd6a0 0x7f0f701f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 -- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f700b2fa0 msgr2=0x7f0f700bd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f700b2fa0 0x7f0f700bd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 -- 172.21.15.18:0/1964638522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f701f4e80 con 0x7f0f7015d8d0 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75b75640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700bd6a0 0x7f0f701f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f75374640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 0x7f0f700b2a60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e8f0 tx=0x7f0f6400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.342 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400c870 con 0x7f0f7015d8d0 2023-06-09T04:39:51.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400c9f0 con 0x7f0f7015d8d0 2023-06-09T04:39:51.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f700c1700 con 0x7f0f7015d8d0 2023-06-09T04:39:51.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400cda0 con 0x7f0f7015d8d0 2023-06-09T04:39:51.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f700c1fa0 con 0x7f0f7015d8d0 2023-06-09T04:39:51.343 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f700ca220 con 0x7f0f7015d8d0 2023-06-09T04:39:51.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.334+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f6401d460 con 0x7f0f7015d8d0 2023-06-09T04:39:51.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.338+0000 7f0f6dffb640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f5c066280 0x7f0f5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:39:51.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.338+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0f64083f50 con 0x7f0f7015d8d0 2023-06-09T04:39:51.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.338+0000 7f0f74b73640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f5c066280 0x7f0f5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:39:51.344 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.338+0000 7f0f74b73640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f5c066280 0x7f0f5c068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0f700b1730 tx=0x7f0f60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:39:51.345 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.342+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f64051290 con 0x7f0f7015d8d0 2023-06-09T04:39:51.523 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f7015f2e0 con 0x7f0f7015d8d0 2023-06-09T04:39:51.524 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f6dffb640 1 -- 172.21.15.18:0/1964638522 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f6405a030 con 0x7f0f7015d8d0 2023-06-09T04:39:51.524 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:39:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f5c066280 msgr2=0x7f0f5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.526 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f5c066280 0x7f0f5c068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0f700b1730 tx=0x7f0f60009040 comp rx=0 tx=0).stop 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 msgr2=0x7f0f700b2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 0x7f0f700b2a60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e8f0 tx=0x7f0f6400edb0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 shutdown_connections 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f0f5c066280 0x7f0f5c068730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0f700bd6a0 0x7f0f701f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f700b2fa0 0x7f0f700bd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.527 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 --2- 172.21.15.18:0/1964638522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f7015d8d0 0x7f0f700b2a60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:39:51.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 >> 172.21.15.18:0/1964638522 conn(0x7f0f700b0240 msgr2=0x7f0f700aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:39:51.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 shutdown_connections 2023-06-09T04:39:51.528 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:39:51.522+0000 7f0f775d8640 1 -- 172.21.15.18:0/1964638522 wait complete. 2023-06-09T04:39:51.541 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:39:51.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:39:51.542 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2023-06-09T04:39:51.542 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:39:51.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:51.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:39:51.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:39:51.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:39:51.544 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:39:51.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:51.544 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2023-06-09T04:39:51.550 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:39:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:39:51.550 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2023-06-09T04:39:51.551 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42398sec preferred_lft 42398sec 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:12:fb:92:ca brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:51.553 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.554 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-09T04:39:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:39:51.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:51.556 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:39:51.599 INFO:teuthology.orchestra.run.smithi018.stdout:1 2023-06-09T04:39:51.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:51.601 DEBUG:teuthology.orchestra.run.smithi018:> route 2023-06-09T04:39:51.648 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2023-06-09T04:39:51.648 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:39:51.648 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-09T04:39:51.648 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:39:51.648 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-09T04:39:51.648 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:39:51.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:51.649 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2023-06-09T04:39:51.649 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2023-06-09T04:39:51.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-09T04:39:51.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-09T04:39:51.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-09T04:39:51.650 DEBUG:teuthology.orchestra.run.smithi018:> ') 2023-06-09T04:39:51.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:51.723 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2023-06-09T04:39:51.771 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T04:39:51.771 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:39:51.772 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:39:51.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:51.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2023-06-09T04:39:51.827 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-09T04:39:51.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:39:51.828 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:51.875 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:39:51.875 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:39:51.876 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:51.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:39:51.981 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:39:51.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:39:52.035 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:39:52.036 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:39:52.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:52.037 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:39:52.087 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:39:52.088 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-09T04:39:52.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:39:52.149 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:39:52.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:39:52.201 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:39:52.202 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:39:52.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:52.203 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:39:52.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:2023-06-09T04:39:52.214+0000 7f3a03ada580 -1 init, newargv = 0x559f4de0b720 newargc=15 2023-06-09T04:39:52.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[49091]: starting ceph client 2023-06-09T04:39:52.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[49091]: starting fuse 2023-06-09T04:39:53.321 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2023-06-09T04:39:53.337 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:39:53.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:39:53.391 INFO:teuthology.orchestra.run.smithi018.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:39:53.393 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:39:53.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:53.394 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2023-06-09T04:39:53.440 INFO:teuthology.orchestra.run.smithi018.stdout:45 2023-06-09T04:39:53.440 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-09T04:39:53.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:39:53.441 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2023-06-09T04:39:53.441 DEBUG:teuthology.orchestra.run.smithi018:> import re 2023-06-09T04:39:53.441 DEBUG:teuthology.orchestra.run.smithi018:> import os 2023-06-09T04:39:53.442 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2023-06-09T04:39:53.442 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:39:53.442 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2023-06-09T04:39:53.443 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-09T04:39:53.443 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2023-06-09T04:39:53.443 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-09T04:39:53.443 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:39:53.444 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2023-06-09T04:39:53.444 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2023-06-09T04:39:53.444 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2023-06-09T04:39:53.445 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2023-06-09T04:39:53.445 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:39:53.445 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2023-06-09T04:39:53.446 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:39:53.446 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:39:53.446 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:39:53.446 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2023-06-09T04:39:53.447 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2023-06-09T04:39:53.447 DEBUG:teuthology.orchestra.run.smithi018:> return f 2023-06-09T04:39:53.447 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:39:53.448 DEBUG:teuthology.orchestra.run.smithi018:> 2023-06-09T04:39:53.448 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.0")) 2023-06-09T04:39:53.448 DEBUG:teuthology.orchestra.run.smithi018:> ' 2023-06-09T04:39:53.563 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.0.49091.asok 2023-06-09T04:39:53.745 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49091.asok 2023-06-09T04:39:53.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:53.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49091.asok status 2023-06-09T04:39:53.903 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2023-06-09T04:39:53.903 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2023-06-09T04:39:53.903 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:39:53.903 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:39:53.903 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "0", 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "49091", 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2023-06-09T04:39:53.904 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 5865, 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 5865 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:39:53.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2788163716 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:39:53.906 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2788163716 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.5865 192.168.0.1:0/2788163716", 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/2788163716", 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 16, 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 42, 2023-06-09T04:39:53.907 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:39:53.908 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2023-06-09T04:39:53.908 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2023-06-09T04:39:53.908 INFO:teuthology.orchestra.run.smithi018.stdout:} 2023-06-09T04:39:53.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:53.918 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2023-06-09T04:39:53.918 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:53.924 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2023-06-09T04:39:53.924 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:53.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:53.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:39:53.980 DEBUG:teuthology.orchestra.run.smithi018:> mktemp -d --suffix=xfstests-dev 2023-06-09T04:39:54.027 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.l3ymdFtib6xfstests-dev 2023-06-09T04:39:54.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:54.028 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.l3ymdFtib6xfstests-dev) 2023-06-09T04:39:54.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:54.093 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.l3ymdFtib6xfstests-dev) 2023-06-09T04:39:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:Cloning into '/tmp/tmp.l3ymdFtib6xfstests-dev'... 2023-06-09T04:39:54.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:54.855 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-09T04:39:54.917 DEBUG:teuthology.orchestra.run.smithi018:> mktemp -d --suffix=test 2023-06-09T04:39:54.963 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.OqgL9ZIhdQtest 2023-06-09T04:39:54.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:39:54.964 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-09T04:39:55.018 DEBUG:teuthology.orchestra.run.smithi018:> mktemp -d --suffix=scratch 2023-06-09T04:39:55.063 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.zx6HTVBdvKscratch 2023-06-09T04:39:55.063 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-06-09T04:39:55.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-06-09T04:39:55.176 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2023-06-09T04:39:55.358 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2023-06-09T04:39:55.358 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2023-06-09T04:39:55.520 INFO:teuthology.orchestra.run.smithi018.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:gawk is already the newest version (1:5.1.0-1build3). 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:gcc set to manually installed. 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-06-09T04:39:55.521 INFO:teuthology.orchestra.run.smithi018.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:make is already the newest version (4.3-4.1build1). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:make set to manually installed. 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:quota is already the newest version (4.06-1build2). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-06-09T04:39:55.522 INFO:teuthology.orchestra.run.smithi018.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:dbench is already the newest version (4.0-2build1). 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:python2 is already the newest version (2.7.18-3). 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:python2 set to manually installed. 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:39:55.523 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-06-09T04:39:55.524 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-06-09T04:39:55.524 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-06-09T04:39:55.524 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:39:55.524 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2023-06-09T04:39:55.525 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemblk1 2023-06-09T04:39:55.525 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2023-06-09T04:39:55.525 INFO:teuthology.orchestra.run.smithi018.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-06-09T04:39:55.549 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2023-06-09T04:39:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: fio libgdbm-dev libpmemblk1 sqlite3 2023-06-09T04:39:55.601 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 4 newly installed, 0 to remove and 188 not upgraded. 2023-06-09T04:39:55.601 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 4,997 kB of archives. 2023-06-09T04:39:55.601 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 9,949 kB of additional disk space will be used. 2023-06-09T04:39:55.602 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-06-09T04:39:55.659 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-06-09T04:39:55.788 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-06-09T04:39:55.789 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-06-09T04:39:56.088 INFO:teuthology.orchestra.run.smithi018.stderr:debconf: unable to initialize frontend: Dialog 2023-06-09T04:39:56.088 INFO:teuthology.orchestra.run.smithi018.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-06-09T04:39:56.088 INFO:teuthology.orchestra.run.smithi018.stderr:debconf: falling back to frontend: Readline 2023-06-09T04:39:56.101 INFO:teuthology.orchestra.run.smithi018.stderr:debconf: unable to initialize frontend: Readline 2023-06-09T04:39:56.102 INFO:teuthology.orchestra.run.smithi018.stderr:debconf: (This frontend requires a controlling tty.) 2023-06-09T04:39:56.102 INFO:teuthology.orchestra.run.smithi018.stderr:debconf: falling back to frontend: Teletype 2023-06-09T04:39:56.106 INFO:teuthology.orchestra.run.smithi018.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-06-09T04:39:56.139 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 4,997 kB in 0s (20.7 MB/s) 2023-06-09T04:39:56.310 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-06-09T04:39:56.418 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175767 files and directories currently installed.) 2023-06-09T04:39:56.424 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-06-09T04:39:56.508 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-06-09T04:39:56.845 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package fio. 2023-06-09T04:39:56.873 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-06-09T04:39:56.911 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking fio (3.28-1) ... 2023-06-09T04:39:57.416 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-06-09T04:39:57.433 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libgdbm-dev_1.23-1_amd64.deb ... 2023-06-09T04:39:57.474 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-06-09T04:39:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package sqlite3. 2023-06-09T04:39:57.815 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-06-09T04:39:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-06-09T04:39:58.136 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-06-09T04:39:58.259 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-06-09T04:39:58.385 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-06-09T04:39:58.511 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up fio (3.28-1) ... 2023-06-09T04:39:59.039 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-09T04:39:59.191 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-09T04:40:00.499 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-09T04:40:01.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo useradd -m fsgqa 2023-06-09T04:40:01.020 INFO:teuthology.orchestra.run.smithi018.stderr:useradd: user 'fsgqa' already exists 2023-06-09T04:40:01.022 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:40:01.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo groupadd fsgqa 2023-06-09T04:40:01.076 INFO:teuthology.orchestra.run.smithi018.stderr:groupadd: group 'fsgqa' already exists 2023-06-09T04:40:01.077 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:40:01.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo useradd fsgqa2 2023-06-09T04:40:01.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo useradd 123456-fsgqa 2023-06-09T04:40:01.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-09T04:40:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.990+0000 7f6d01f2b640 1 Processor -- start 2023-06-09T04:40:01.995 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.990+0000 7f6d01f2b640 1 -- start start 2023-06-09T04:40:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6d01f2b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6cfc159320 0x7f6cfc15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6d01f2b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc070270 0x7f6cfc06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6d01f2b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc15cf10 con 0x7f6cfc15d680 2023-06-09T04:40:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6d01f2b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc15a920 con 0x7f6cfc159320 2023-06-09T04:40:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6d01f2b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c81b0 con 0x7f6cfc070270 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6cfc159320 0x7f6cfc15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6cfc159320 0x7f6cfc15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39480/0 (socket says 172.21.15.18:39480) 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/259552889 learned_addr learned my addr 172.21.15.18:0/259552889 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfbfff640 1 --2- 172.21.15.18:0/259552889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc070270 0x7f6cfc06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/259552889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc070270 msgr2=0x7f6cfc06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 --2- 172.21.15.18:0/259552889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc070270 0x7f6cfc06bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/259552889 >> v1:172.21.15.81:6789/0 conn(0x7f6cfc15d680 legacy=0x7f6cfc06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/259552889 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0c8490 con 0x7f6cfc159320 2023-06-09T04:40:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfb7fe640 1 --2- 172.21.15.18:0/259552889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc159320 0x7f6cfc15a3e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009870 tx=0x7f6cec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d1ea9603b9f103 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfa7fc640 1 -- 172.21.15.18:0/259552889 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0ad640 con 0x7f6cfc159320 2023-06-09T04:40:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfa7fc640 1 -- 172.21.15.18:0/259552889 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec0ad7a0 con 0x7f6cfc159320 2023-06-09T04:40:01.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.994+0000 7f6cfa7fc640 1 -- 172.21.15.18:0/259552889 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0adb30 con 0x7f6cfc159320 2023-06-09T04:40:01.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/259552889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc159320 msgr2=0x7f6cfc15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:01.999 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/259552889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc159320 0x7f6cfc15a3e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009870 tx=0x7f6cec01c480 comp rx=0 tx=0).stop 2023-06-09T04:40:02.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/259552889 shutdown_connections 2023-06-09T04:40:02.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/259552889 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc070270 0x7f6cfc06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/259552889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc159320 0x7f6cfc15a3e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/259552889 >> 172.21.15.18:0/259552889 conn(0x7f6cfc0b0240 msgr2=0x7f6cfc0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:02.000 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/259552889 shutdown_connections 2023-06-09T04:40:02.001 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/259552889 wait complete. 2023-06-09T04:40:02.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 Processor -- start 2023-06-09T04:40:02.002 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- start start 2023-06-09T04:40:02.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 0x7f6cfc14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc159320 0x7f6cfc0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc15d680 0x7f6cfc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c7050 con 0x7f6cfc070270 2023-06-09T04:40:02.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c7260 con 0x7f6cfc15d680 2023-06-09T04:40:02.003 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c7540 con 0x7f6cfc159320 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 0x7f6cfc14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 0x7f6cfc14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39484/0 (socket says 172.21.15.18:39484) 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/1591333030 learned_addr learned my addr 172.21.15.18:0/1591333030 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfbfff640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc15d680 0x7f6cfc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfaffd640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc159320 0x7f6cfc0c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc159320 msgr2=0x7f6cfc0c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.004 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc159320 0x7f6cfc0c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc15d680 msgr2=0x7f6cfc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc15d680 0x7f6cfc0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 -- 172.21.15.18:0/1591333030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0094d0 con 0x7f6cfc070270 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6cfb7fe640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 0x7f6cfc14c880 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b0040 tx=0x7f6cec019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0b6830 con 0x7f6cfc070270 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec0a6040 con 0x7f6cfc070270 2023-06-09T04:40:02.005 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc0b2020 con 0x7f6cfc070270 2023-06-09T04:40:02.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0b6bf0 con 0x7f6cfc070270 2023-06-09T04:40:02.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:01.998+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc0c7820 con 0x7f6cfc070270 2023-06-09T04:40:02.006 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.002+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc0b2540 con 0x7f6cfc070270 2023-06-09T04:40:02.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.002+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6cec0b4070 con 0x7f6cfc070270 2023-06-09T04:40:02.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.002+0000 7f6ce3fff640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6ce8066280 0x7f6ce8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.002+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f6cec11e860 con 0x7f6cfc070270 2023-06-09T04:40:02.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.002+0000 7f6cfaffd640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6ce8066280 0x7f6ce8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.007 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.002+0000 7f6cfaffd640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6ce8066280 0x7f6ce8068730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc15be40 tx=0x7f6cf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:02.008 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.006+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6cfc0b2540 con 0x7f6cfc070270 2023-06-09T04:40:02.220 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.218+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6cfc0b2540 con 0x7f6cfc070270 2023-06-09T04:40:02.221 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.218+0000 7f6ce3fff640 1 -- 172.21.15.18:0/1591333030 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f6cec0b2510 con 0x7f6cfc070270 2023-06-09T04:40:02.221 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:40:02.221 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":1,"fsid":"eb85c981-43c8-4596-9c30-77e5bafdb8a3","modified":"2023-06-09T04:37:13.826381Z","created":"2023-06-09T04:37:13.826381Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3301","nonce":0},{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-09T04:40:02.222 INFO:teuthology.orchestra.run.smithi018.stderr:dumped monmap epoch 1 2023-06-09T04:40:02.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6ce8066280 msgr2=0x7f6ce8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.223 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6ce8066280 0x7f6ce8068730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc15be40 tx=0x7f6cf0009040 comp rx=0 tx=0).stop 2023-06-09T04:40:02.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 msgr2=0x7f6cfc14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 0x7f6cfc14c880 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b0040 tx=0x7f6cec019220 comp rx=0 tx=0).stop 2023-06-09T04:40:02.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 shutdown_connections 2023-06-09T04:40:02.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc15d680 0x7f6cfc0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f6ce8066280 0x7f6ce8068730 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.224 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cfc159320 0x7f6cfc0c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 --2- 172.21.15.18:0/1591333030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc070270 0x7f6cfc14c880 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 >> 172.21.15.18:0/1591333030 conn(0x7f6cfc0b0240 msgr2=0x7f6cfc064f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:02.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 shutdown_connections 2023-06-09T04:40:02.225 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.222+0000 7f6d01f2b640 1 -- 172.21.15.18:0/1591333030 wait complete. 2023-06-09T04:40:02.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-06-09T04:40:02.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 Processor -- start 2023-06-09T04:40:02.368 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 -- start start 2023-06-09T04:40:02.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f728415a3e0 0x7f728406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72840700a0 0x7f728406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728415cf10 con 0x7f7284159320 2023-06-09T04:40:02.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7284070520 con 0x7f72840700a0 2023-06-09T04:40:02.369 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7289f3e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728415dd90 con 0x7f728415a3e0 2023-06-09T04:40:02.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72840700a0 0x7f728406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72840700a0 0x7f728406bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39496/0 (socket says 172.21.15.18:39496) 2023-06-09T04:40:02.370 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 -- 172.21.15.18:0/1809242679 learned_addr learned my addr 172.21.15.18:0/1809242679 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:40:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7282ffd640 1 --2- 172.21.15.18:0/1809242679 >> v2:172.21.15.81:3300/0 conn(0x7f728415a3e0 0x7f728406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 -- 172.21.15.18:0/1809242679 >> v2:172.21.15.81:3300/0 conn(0x7f728415a3e0 msgr2=0x7f728406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 --2- 172.21.15.18:0/1809242679 >> v2:172.21.15.81:3300/0 conn(0x7f728415a3e0 0x7f728406fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 -- 172.21.15.18:0/1809242679 >> v1:172.21.15.81:6789/0 conn(0x7f7284159320 legacy=0x7f728415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7283fff640 1 -- 172.21.15.18:0/1809242679 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840c81b0 con 0x7f72840700a0 2023-06-09T04:40:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.366+0000 7f7282ffd640 1 --2- 172.21.15.18:0/1809242679 >> v2:172.21.15.81:3300/0 conn(0x7f728415a3e0 0x7f728406fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:40:02.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7283fff640 1 --2- 172.21.15.18:0/1809242679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72840700a0 0x7f728406bcb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f72840cd7d0 tx=0x7f727c01c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d687a8336e4c65ee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:02.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f72827fc640 1 -- 172.21.15.18:0/1809242679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0ab600 con 0x7f72840700a0 2023-06-09T04:40:02.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f72827fc640 1 -- 172.21.15.18:0/1809242679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c0a7050 con 0x7f72840700a0 2023-06-09T04:40:02.372 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f72827fc640 1 -- 172.21.15.18:0/1809242679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0ab980 con 0x7f72840700a0 2023-06-09T04:40:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- 172.21.15.18:0/1809242679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72840700a0 msgr2=0x7f728406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 --2- 172.21.15.18:0/1809242679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72840700a0 0x7f728406bcb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f72840cd7d0 tx=0x7f727c01c140 comp rx=0 tx=0).stop 2023-06-09T04:40:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- 172.21.15.18:0/1809242679 shutdown_connections 2023-06-09T04:40:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 --2- 172.21.15.18:0/1809242679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72840700a0 0x7f728406bcb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 --2- 172.21.15.18:0/1809242679 >> v2:172.21.15.81:3300/0 conn(0x7f728415a3e0 0x7f728406fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- 172.21.15.18:0/1809242679 >> 172.21.15.18:0/1809242679 conn(0x7f72840b0240 msgr2=0x7f72840cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- 172.21.15.18:0/1809242679 shutdown_connections 2023-06-09T04:40:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- 172.21.15.18:0/1809242679 wait complete. 2023-06-09T04:40:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 Processor -- start 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- start start 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72840700a0 0x7f72840c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7284159320 0x7f72840c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 0x7f72840c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72840c60f0 con 0x7f728415a3e0 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72840c54e0 con 0x7f7284159320 2023-06-09T04:40:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.370+0000 7f7289f3e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72840c57c0 con 0x7f72840700a0 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 0x7f72840c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 0x7f72840c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39502/0 (socket says 172.21.15.18:39502) 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 -- 172.21.15.18:0/4096354069 learned_addr learned my addr 172.21.15.18:0/4096354069 (peer_addr_for_me v2:172.21.15.18:0/0) 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7282ffd640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7284159320 0x7f72840c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f72837fe640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72840700a0 0x7f72840c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 -- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72840700a0 msgr2=0x7f72840c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72840700a0 0x7f72840c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 -- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7284159320 msgr2=0x7f72840c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7284159320 0x7f72840c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 -- 172.21.15.18:0/4096354069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0094d0 con 0x7f728415a3e0 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7282ffd640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7284159320 0x7f72840c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7283fff640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 0x7f72840c62d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ae040 tx=0x7f727c01a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b6620 con 0x7f728415a3e0 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c0b67a0 con 0x7f728415a3e0 2023-06-09T04:40:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0b6b50 con 0x7f728415a3e0 2023-06-09T04:40:02.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72840c5aa0 con 0x7f728415a3e0 2023-06-09T04:40:02.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72840c3d30 con 0x7f728415a3e0 2023-06-09T04:40:02.379 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72840ce690 con 0x7f728415a3e0 2023-06-09T04:40:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f727c0b2040 con 0x7f728415a3e0 2023-06-09T04:40:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f727bfff640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7268066280 0x7f7268068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f727c11e340 con 0x7f728415a3e0 2023-06-09T04:40:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f72837fe640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7268066280 0x7f7268068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.374+0000 7f72837fe640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7268066280 0x7f7268068730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f726c004450 tx=0x7f726c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.378+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f727c0eb680 con 0x7f728415a3e0 2023-06-09T04:40:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.590+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f728415da70 con 0x7f728415a3e0 2023-06-09T04:40:02.594 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.590+0000 7f727bfff640 1 -- 172.21.15.18:0/4096354069 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f727c0eeca0 con 0x7f728415a3e0 2023-06-09T04:40:02.594 INFO:teuthology.orchestra.run.smithi018.stdout:[client.admin] 2023-06-09T04:40:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB6rIJkHz1wAxAAuYD1NseB+bkY0hl2seVayg== 2023-06-09T04:40:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow *" 2023-06-09T04:40:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: caps mgr = "allow *" 2023-06-09T04:40:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow *" 2023-06-09T04:40:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow *" 2023-06-09T04:40:02.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7268066280 msgr2=0x7f7268068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7268066280 0x7f7268068730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f726c004450 tx=0x7f726c009040 comp rx=0 tx=0).stop 2023-06-09T04:40:02.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 msgr2=0x7f72840c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:02.598 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 0x7f72840c62d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ae040 tx=0x7f727c01a980 comp rx=0 tx=0).stop 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 shutdown_connections 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f728415a3e0 0x7f72840c62d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7284159320 0x7f72840c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:6832/468192741,v1:172.21.15.81:6833/468192741] conn(0x7f7268066280 0x7f7268068730 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 --2- 172.21.15.18:0/4096354069 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f72840700a0 0x7f72840c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 >> 172.21.15.18:0/4096354069 conn(0x7f72840b0240 msgr2=0x7f7284159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 shutdown_connections 2023-06-09T04:40:02.600 INFO:teuthology.orchestra.run.smithi018.stderr:2023-06-09T04:40:02.594+0000 7f7289f3e640 1 -- 172.21.15.18:0/4096354069 wait complete. 2023-06-09T04:40:02.615 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2023-06-09T04:40:02.619 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.mLUxJiBiRS 2023-06-09T04:40:02.620 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:40:02.620 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/tmp/tmp.mLUxJiBiRS 2023-06-09T04:40:02.666 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:40:02.667 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/tmp/tmp.l3ymdFtib6xfstests-dev/local.config 2023-06-09T04:40:02.718 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.OqgL9ZIhdQtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.zx6HTVBdvKscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.18:6789 -k /tmp/tmp.mLUxJiBiRS --client_mountpoint /test" 2023-06-09T04:40:02.719 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2023-06-09T04:40:02.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/tmp/tmp.l3ymdFtib6xfstests-dev/ceph.exclude 2023-06-09T04:40:02.775 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo make) 2023-06-09T04:40:02.836 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize -cfi 2023-06-09T04:40:03.098 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-09T04:40:03.099 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file './config.guess' 2023-06-09T04:40:03.103 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file './config.sub' 2023-06-09T04:40:03.118 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file './install-sh' 2023-06-09T04:40:03.125 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file './ltmain.sh' 2023-06-09T04:40:03.155 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-09T04:40:03.156 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-09T04:40:03.167 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-09T04:40:03.173 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-09T04:40:03.179 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-09T04:40:03.185 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-09T04:40:03.191 INFO:teuthology.orchestra.run.smithi018.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-09T04:40:03.192 INFO:teuthology.orchestra.run.smithi018.stdout:cp include/install-sh . 2023-06-09T04:40:03.193 INFO:teuthology.orchestra.run.smithi018.stdout:aclocal -I m4 2023-06-09T04:40:04.373 INFO:teuthology.orchestra.run.smithi018.stdout:autoheader 2023-06-09T04:40:04.754 INFO:teuthology.orchestra.run.smithi018.stdout:autoconf 2023-06-09T04:40:05.184 INFO:teuthology.orchestra.run.smithi018.stdout:./configure \ 2023-06-09T04:40:05.184 INFO:teuthology.orchestra.run.smithi018.stdout: --libexecdir=/usr/lib \ 2023-06-09T04:40:05.184 INFO:teuthology.orchestra.run.smithi018.stdout: --exec_prefix=/var/lib 2023-06-09T04:40:05.604 INFO:teuthology.orchestra.run.smithi018.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-09T04:40:05.605 INFO:teuthology.orchestra.run.smithi018.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-09T04:40:05.654 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to print strings... printf 2023-06-09T04:40:05.655 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gcc... gcc 2023-06-09T04:40:05.861 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether the C compiler works... yes 2023-06-09T04:40:05.861 INFO:teuthology.orchestra.run.smithi018.stdout:checking for C compiler default output file name... a.out 2023-06-09T04:40:05.900 INFO:teuthology.orchestra.run.smithi018.stdout:checking for suffix of executables... 2023-06-09T04:40:05.967 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether we are cross compiling... no 2023-06-09T04:40:05.986 INFO:teuthology.orchestra.run.smithi018.stdout:checking for suffix of object files... o 2023-06-09T04:40:06.002 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether the compiler supports GNU C... yes 2023-06-09T04:40:06.019 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether gcc accepts -g... yes 2023-06-09T04:40:06.154 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gcc option to enable C11 features... none needed 2023-06-09T04:40:06.159 INFO:teuthology.orchestra.run.smithi018.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-06-09T04:40:06.162 INFO:teuthology.orchestra.run.smithi018.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-06-09T04:40:06.164 INFO:teuthology.orchestra.run.smithi018.stdout:checking for egrep... /usr/bin/grep -E 2023-06-09T04:40:06.166 INFO:teuthology.orchestra.run.smithi018.stdout:checking for fgrep... /usr/bin/grep -F 2023-06-09T04:40:06.171 INFO:teuthology.orchestra.run.smithi018.stdout:checking for ld used by gcc... /usr/bin/ld 2023-06-09T04:40:06.173 INFO:teuthology.orchestra.run.smithi018.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-06-09T04:40:06.180 INFO:teuthology.orchestra.run.smithi018.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-06-09T04:40:06.204 INFO:teuthology.orchestra.run.smithi018.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-06-09T04:40:06.204 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether ln -s works... yes 2023-06-09T04:40:06.215 INFO:teuthology.orchestra.run.smithi018.stdout:checking the maximum length of command line arguments... 1572864 2023-06-09T04:40:06.218 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-09T04:40:06.219 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-09T04:40:06.219 INFO:teuthology.orchestra.run.smithi018.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-06-09T04:40:06.219 INFO:teuthology.orchestra.run.smithi018.stdout:checking for objdump... objdump 2023-06-09T04:40:06.220 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to recognize dependent libraries... pass_all 2023-06-09T04:40:06.220 INFO:teuthology.orchestra.run.smithi018.stdout:checking for dlltool... no 2023-06-09T04:40:06.221 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-09T04:40:06.221 INFO:teuthology.orchestra.run.smithi018.stdout:checking for ar... ar 2023-06-09T04:40:06.251 INFO:teuthology.orchestra.run.smithi018.stdout:checking for archiver @FILE support... @ 2023-06-09T04:40:06.251 INFO:teuthology.orchestra.run.smithi018.stdout:checking for strip... strip 2023-06-09T04:40:06.252 INFO:teuthology.orchestra.run.smithi018.stdout:checking for ranlib... ranlib 2023-06-09T04:40:06.252 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gawk... gawk 2023-06-09T04:40:06.319 INFO:teuthology.orchestra.run.smithi018.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-06-09T04:40:06.321 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sysroot... no 2023-06-09T04:40:06.325 INFO:teuthology.orchestra.run.smithi018.stdout:checking for a working dd... /usr/bin/dd 2023-06-09T04:40:06.329 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-06-09T04:40:06.343 INFO:teuthology.orchestra.run.smithi018.stdout:checking for mt... mt 2023-06-09T04:40:06.356 INFO:teuthology.orchestra.run.smithi018.stdout:checking if mt is a manifest tool... no 2023-06-09T04:40:06.377 INFO:teuthology.orchestra.run.smithi018.stdout:checking for stdio.h... yes 2023-06-09T04:40:06.418 INFO:teuthology.orchestra.run.smithi018.stdout:checking for stdlib.h... yes 2023-06-09T04:40:06.454 INFO:teuthology.orchestra.run.smithi018.stdout:checking for string.h... yes 2023-06-09T04:40:06.494 INFO:teuthology.orchestra.run.smithi018.stdout:checking for inttypes.h... yes 2023-06-09T04:40:06.527 INFO:teuthology.orchestra.run.smithi018.stdout:checking for stdint.h... yes 2023-06-09T04:40:06.558 INFO:teuthology.orchestra.run.smithi018.stdout:checking for strings.h... yes 2023-06-09T04:40:06.588 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/stat.h... yes 2023-06-09T04:40:06.614 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/types.h... yes 2023-06-09T04:40:06.647 INFO:teuthology.orchestra.run.smithi018.stdout:checking for unistd.h... yes 2023-06-09T04:40:06.680 INFO:teuthology.orchestra.run.smithi018.stdout:checking for dlfcn.h... yes 2023-06-09T04:40:06.684 INFO:teuthology.orchestra.run.smithi018.stdout:checking for objdir... .libs 2023-06-09T04:40:06.765 INFO:teuthology.orchestra.run.smithi018.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-09T04:40:06.765 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-09T04:40:06.783 INFO:teuthology.orchestra.run.smithi018.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-09T04:40:07.061 INFO:teuthology.orchestra.run.smithi018.stdout:checking if gcc static flag -static works... yes 2023-06-09T04:40:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:checking if gcc supports -c -o file.o... yes 2023-06-09T04:40:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-09T04:40:07.101 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-09T04:40:07.130 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether -lc should be explicitly linked in... no 2023-06-09T04:40:07.223 INFO:teuthology.orchestra.run.smithi018.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-09T04:40:07.223 INFO:teuthology.orchestra.run.smithi018.stdout:checking how to hardcode library paths into programs... immediate 2023-06-09T04:40:07.229 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether stripping libraries is possible... yes 2023-06-09T04:40:07.229 INFO:teuthology.orchestra.run.smithi018.stdout:checking if libtool supports shared libraries... yes 2023-06-09T04:40:07.229 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether to build shared libraries... yes 2023-06-09T04:40:07.229 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether to build static libraries... yes 2023-06-09T04:40:07.238 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gcc... (cached) gcc 2023-06-09T04:40:07.264 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-06-09T04:40:07.265 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-09T04:40:07.265 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-06-09T04:40:07.265 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gmake... /usr/bin/gmake 2023-06-09T04:40:07.266 INFO:teuthology.orchestra.run.smithi018.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-06-09T04:40:07.266 INFO:teuthology.orchestra.run.smithi018.stdout:checking for tar... /bin/tar 2023-06-09T04:40:07.266 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gzip... /bin/gzip 2023-06-09T04:40:07.277 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether gcc -MM is supported... yes 2023-06-09T04:40:07.278 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sort... /bin/sort 2023-06-09T04:40:07.278 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether ln -s works... yes 2023-06-09T04:40:07.279 INFO:teuthology.orchestra.run.smithi018.stdout:checking for rpm... no 2023-06-09T04:40:07.312 INFO:teuthology.orchestra.run.smithi018.stdout:checking for assert.h... yes 2023-06-09T04:40:07.345 INFO:teuthology.orchestra.run.smithi018.stdout:checking for bstring.h... no 2023-06-09T04:40:07.380 INFO:teuthology.orchestra.run.smithi018.stdout:checking for libgen.h... yes 2023-06-09T04:40:07.451 INFO:teuthology.orchestra.run.smithi018.stdout:checking for dirent.h... yes 2023-06-09T04:40:07.533 INFO:teuthology.orchestra.run.smithi018.stdout:checking for errno.h... yes 2023-06-09T04:40:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:checking for malloc.h... yes 2023-06-09T04:40:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:checking for uuid.h... no 2023-06-09T04:40:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:checking for uuid/uuid.h... yes 2023-06-09T04:40:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/uuid.h... no 2023-06-09T04:40:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/file.h... yes 2023-06-09T04:40:07.768 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/fcntl.h... yes 2023-06-09T04:40:07.807 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/syssgi.h... no 2023-06-09T04:40:07.867 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/param.h... yes 2023-06-09T04:40:07.867 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/stat.h... (cached) yes 2023-06-09T04:40:07.902 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/statvfs.h... yes 2023-06-09T04:40:07.933 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/time.h... yes 2023-06-09T04:40:07.975 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/ioctl.h... yes 2023-06-09T04:40:08.010 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/wait.h... yes 2023-06-09T04:40:08.011 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/types.h... (cached) yes 2023-06-09T04:40:08.011 INFO:teuthology.orchestra.run.smithi018.stdout:checking for strings.h... (cached) yes 2023-06-09T04:40:08.045 INFO:teuthology.orchestra.run.smithi018.stdout:checking for err.h... yes 2023-06-09T04:40:08.086 INFO:teuthology.orchestra.run.smithi018.stdout:checking for linux/falloc.h... yes 2023-06-09T04:40:08.130 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-09T04:40:08.171 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-09T04:40:08.210 INFO:teuthology.orchestra.run.smithi018.stdout:checking for xfs/platform_defs.h... no 2023-06-09T04:40:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:checking for btrfs/ioctl.h... no 2023-06-09T04:40:08.288 INFO:teuthology.orchestra.run.smithi018.stdout:checking for cifs/ioctl.h... no 2023-06-09T04:40:08.326 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/mman.h... yes 2023-06-09T04:40:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:checking for xfs/xfs_log_format.h... no 2023-06-09T04:40:08.385 INFO:teuthology.orchestra.run.smithi018.stdout:checking for uuid_compare... no 2023-06-09T04:40:08.421 INFO:teuthology.orchestra.run.smithi018.stdout:checking for uuid_compare in -luuid... yes 2023-06-09T04:40:08.539 INFO:teuthology.orchestra.run.smithi018.stdout:checking for xfs/xfs.h... yes 2023-06-09T04:40:08.558 INFO:teuthology.orchestra.run.smithi018.stdout:checking for xfs/libxfs.h... no 2023-06-09T04:40:08.594 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-06-09T04:40:08.614 INFO:teuthology.orchestra.run.smithi018.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-09T04:40:08.658 INFO:teuthology.orchestra.run.smithi018.stdout:checking for xfs/xqm.h... yes 2023-06-09T04:40:08.723 INFO:teuthology.orchestra.run.smithi018.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-09T04:40:08.757 INFO:teuthology.orchestra.run.smithi018.stdout:checking for xfs/handle.h... yes 2023-06-09T04:40:08.796 INFO:teuthology.orchestra.run.smithi018.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-09T04:40:08.840 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/acl.h... yes 2023-06-09T04:40:08.882 INFO:teuthology.orchestra.run.smithi018.stdout:checking for acl/libacl.h... yes 2023-06-09T04:40:08.919 INFO:teuthology.orchestra.run.smithi018.stdout:checking for acl_init in -lacl... yes 2023-06-09T04:40:08.954 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gdbm-ndbm.h... no 2023-06-09T04:40:08.986 INFO:teuthology.orchestra.run.smithi018.stdout:checking for gdbm/ndbm.h... no 2023-06-09T04:40:09.018 INFO:teuthology.orchestra.run.smithi018.stdout:checking for ndbm.h... no 2023-06-09T04:40:09.052 INFO:teuthology.orchestra.run.smithi018.stdout:checking for libaio.h... yes 2023-06-09T04:40:09.084 INFO:teuthology.orchestra.run.smithi018.stdout:checking for liburing.h... no 2023-06-09T04:40:09.116 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/capability.h... no 2023-06-09T04:40:09.149 INFO:teuthology.orchestra.run.smithi018.stdout:checking for linux/fiemap.h... yes 2023-06-09T04:40:09.193 INFO:teuthology.orchestra.run.smithi018.stdout:checking for fallocate... yes 2023-06-09T04:40:09.237 INFO:teuthology.orchestra.run.smithi018.stdout:checking for open_by_handle_at... yes 2023-06-09T04:40:09.270 INFO:teuthology.orchestra.run.smithi018.stdout:checking for sys/prctl.h... yes 2023-06-09T04:40:09.303 INFO:teuthology.orchestra.run.smithi018.stdout:checking for linux/fs.h... yes 2023-06-09T04:40:09.340 INFO:teuthology.orchestra.run.smithi018.stdout:checking for btrfsutil.h... no 2023-06-09T04:40:09.386 INFO:teuthology.orchestra.run.smithi018.stdout:checking for copy_file_range... yes 2023-06-09T04:40:09.428 INFO:teuthology.orchestra.run.smithi018.stdout:checking for SEEK_DATA... yes 2023-06-09T04:40:09.494 INFO:teuthology.orchestra.run.smithi018.stdout:checking for BMV_OF_SHARED... yes 2023-06-09T04:40:09.535 INFO:teuthology.orchestra.run.smithi018.stdout:checking for nftw... yes 2023-06-09T04:40:09.577 INFO:teuthology.orchestra.run.smithi018.stdout:checking for RLIMIT_NOFILE... yes 2023-06-09T04:40:09.604 INFO:teuthology.orchestra.run.smithi018.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-09T04:40:09.642 INFO:teuthology.orchestra.run.smithi018.stdout:checking for renameat2... yes 2023-06-09T04:40:09.677 INFO:teuthology.orchestra.run.smithi018.stdout:checking for reallocarray... yes 2023-06-09T04:40:09.708 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct mount_attr... yes 2023-06-09T04:40:09.761 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-09T04:40:09.795 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-09T04:40:09.830 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-09T04:40:09.864 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-09T04:40:09.899 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-09T04:40:09.934 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-09T04:40:09.969 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-09T04:40:10.010 INFO:teuthology.orchestra.run.smithi018.stdout:checking for linux/btrfs.h... yes 2023-06-09T04:40:10.044 INFO:teuthology.orchestra.run.smithi018.stdout:checking for linux/btrfs_tree.h... yes 2023-06-09T04:40:10.065 INFO:teuthology.orchestra.run.smithi018.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-06-09T04:40:10.084 INFO:teuthology.orchestra.run.smithi018.stdout:configure: creating ./config.status 2023-06-09T04:40:10.522 INFO:teuthology.orchestra.run.smithi018.stdout:config.status: creating include/builddefs 2023-06-09T04:40:10.537 INFO:teuthology.orchestra.run.smithi018.stdout:config.status: creating include/config.h 2023-06-09T04:40:10.549 INFO:teuthology.orchestra.run.smithi018.stdout:config.status: executing libtool commands 2023-06-09T04:40:10.594 INFO:teuthology.orchestra.run.smithi018.stdout:Building include 2023-06-09T04:40:10.597 INFO:teuthology.orchestra.run.smithi018.stdout:Building lib 2023-06-09T04:40:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: [LTDEP] 2023-06-09T04:40:10.744 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dataascii.lo 2023-06-09T04:40:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] databin.lo 2023-06-09T04:40:11.022 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] datapid.lo 2023-06-09T04:40:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] file_lock.lo 2023-06-09T04:40:11.294 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] forker.lo 2023-06-09T04:40:11.463 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] pattern.lo 2023-06-09T04:40:11.576 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] open_flags.lo 2023-06-09T04:40:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] random_range.lo 2023-06-09T04:40:11.986 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] string_to_tokens.lo 2023-06-09T04:40:12.093 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] str_to_bytes.lo 2023-06-09T04:40:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] tlibio.lo 2023-06-09T04:40:12.531 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] write_log.lo 2023-06-09T04:40:12.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:12.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:12.602 INFO:teuthology.orchestra.run.smithi018.stderr:write_log.c: In function 'wlog_record_write': 2023-06-09T04:40:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:12.603 INFO:teuthology.orchestra.run.smithi018.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-06-09T04:40:12.603 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:12.603 INFO:teuthology.orchestra.run.smithi018.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:12.603 INFO:teuthology.orchestra.run.smithi018.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-06-09T04:40:12.603 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:12.803 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] random.lo 2023-06-09T04:40:12.901 INFO:teuthology.orchestra.run.smithi018.stdout: [LD] 2023-06-09T04:40:12.976 INFO:teuthology.orchestra.run.smithi018.stdout:Building ltp 2023-06-09T04:40:12.980 INFO:teuthology.orchestra.run.smithi018.stdout: [DEP] 2023-06-09T04:40:13.165 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] doio 2023-06-09T04:40:13.887 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fsstress 2023-06-09T04:40:15.372 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fsx 2023-06-09T04:40:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] growfiles 2023-06-09T04:40:16.695 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] iogen 2023-06-09T04:40:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:iogen.c: In function 'main': 2023-06-09T04:40:16.839 INFO:teuthology.orchestra.run.smithi018.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:16.839 INFO:teuthology.orchestra.run.smithi018.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-06-09T04:40:16.840 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:iogen.c: In function 'parse_cmdline': 2023-06-09T04:40:16.842 INFO:teuthology.orchestra.run.smithi018.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:16.842 INFO:teuthology.orchestra.run.smithi018.stderr: 1535 | getcwd(fptr->f_path, 2023-06-09T04:40:16.842 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:16.842 INFO:teuthology.orchestra.run.smithi018.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-06-09T04:40:16.842 INFO:teuthology.orchestra.run.smithi018.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:17.140 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-stress 2023-06-09T04:40:17.258 INFO:teuthology.orchestra.run.smithi018.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-06-09T04:40:17.259 INFO:teuthology.orchestra.run.smithi018.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:17.259 INFO:teuthology.orchestra.run.smithi018.stderr: 1013 | ftruncate(fd, total_ram); 2023-06-09T04:40:17.259 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:17.598 INFO:teuthology.orchestra.run.smithi018.stdout:Building src 2023-06-09T04:40:17.607 INFO:teuthology.orchestra.run.smithi018.stdout: [DEP] 2023-06-09T04:40:19.688 INFO:teuthology.orchestra.run.smithi018.stdout: [DEP] 2023-06-09T04:40:19.723 INFO:teuthology.orchestra.run.smithi018.stdout: [DEP] 2023-06-09T04:40:19.733 INFO:teuthology.orchestra.run.smithi018.stdout: [DEP] 2023-06-09T04:40:20.001 INFO:teuthology.orchestra.run.smithi018.stdout: [DEP] 2023-06-09T04:40:20.032 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dirstress 2023-06-09T04:40:20.298 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fill 2023-06-09T04:40:20.447 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fill2 2023-06-09T04:40:20.676 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] getpagesize 2023-06-09T04:40:20.812 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] holes 2023-06-09T04:40:21.014 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] lstat64 2023-06-09T04:40:21.196 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] nametest 2023-06-09T04:40:21.315 INFO:teuthology.orchestra.run.smithi018.stderr:nametest.c: In function 'main': 2023-06-09T04:40:21.315 INFO:teuthology.orchestra.run.smithi018.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:21.315 INFO:teuthology.orchestra.run.smithi018.stderr: 236 | write(1, "\n", 1); 2023-06-09T04:40:21.315 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:21.315 INFO:teuthology.orchestra.run.smithi018.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:21.315 INFO:teuthology.orchestra.run.smithi018.stderr: 238 | write(1, ".", 1); 2023-06-09T04:40:21.316 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:21.316 INFO:teuthology.orchestra.run.smithi018.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:21.316 INFO:teuthology.orchestra.run.smithi018.stderr: 288 | write(1, ".", 1); 2023-06-09T04:40:21.316 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:21.442 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] permname 2023-06-09T04:40:21.649 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] randholes 2023-06-09T04:40:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] runas 2023-06-09T04:40:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] truncfile 2023-06-09T04:40:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] usemem 2023-06-09T04:40:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] mmapcat 2023-06-09T04:40:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:mmapcat.c: In function 'main': 2023-06-09T04:40:22.525 INFO:teuthology.orchestra.run.smithi018.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:22.525 INFO:teuthology.orchestra.run.smithi018.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-06-09T04:40:22.525 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] append_reader 2023-06-09T04:40:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] append_writer 2023-06-09T04:40:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dirperf 2023-06-09T04:40:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] metaperf 2023-06-09T04:40:23.197 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c: In function 'crfiles': 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: 166 | write(fd, buf, fsize); 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c: In function 't_linkun': 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: 454 | link("a", *fnp); 2023-06-09T04:40:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~ 2023-06-09T04:40:23.199 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c: In function 't_chown': 2023-06-09T04:40:23.199 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: 404 | chown(*fnp, 2, -1); 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: 406 | chown(*fnp, 1, -1); 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c: In function 'i_chown': 2023-06-09T04:40:23.200 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: 291 | chown(*fnp, 1, -1); 2023-06-09T04:40:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:23.201 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c: In function 'main': 2023-06-09T04:40:23.201 INFO:teuthology.orchestra.run.smithi018.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: 152 | chdir(".."); 2023-06-09T04:40:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~ 2023-06-09T04:40:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] devzero 2023-06-09T04:40:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] feature 2023-06-09T04:40:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] alloc 2023-06-09T04:40:23.909 INFO:teuthology.orchestra.run.smithi018.stderr:alloc.c: In function 'main': 2023-06-09T04:40:23.909 INFO:teuthology.orchestra.run.smithi018.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:23.910 INFO:teuthology.orchestra.run.smithi018.stderr: 247 | mkstemp(tmpfile); 2023-06-09T04:40:23.910 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:24.009 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fault 2023-06-09T04:40:24.176 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fstest 2023-06-09T04:40:24.440 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_access_root 2023-06-09T04:40:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:t_access_root.c: In function 'main': 2023-06-09T04:40:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:24.552 INFO:teuthology.orchestra.run.smithi018.stderr: 55 | system(cmd); 2023-06-09T04:40:24.552 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~ 2023-06-09T04:40:24.597 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] godown 2023-06-09T04:40:24.765 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] resvtest 2023-06-09T04:40:24.961 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] writemod 2023-06-09T04:40:25.114 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] writev_on_pagefault 2023-06-09T04:40:25.285 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] makeextents 2023-06-09T04:40:25.460 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] itrash 2023-06-09T04:40:25.611 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] rename 2023-06-09T04:40:25.738 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] multi_open_unlink 2023-06-09T04:40:25.895 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] unwritten_sync 2023-06-09T04:40:26.075 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] genhashnames 2023-06-09T04:40:26.265 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_holes 2023-06-09T04:40:26.403 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_writev 2023-06-09T04:40:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_truncate_cmtime 2023-06-09T04:40:26.723 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dirhash_collide 2023-06-09T04:40:26.918 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_rename_overwrite 2023-06-09T04:40:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] holetest 2023-06-09T04:40:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:holetest.c: In function 'pt_write_marker': 2023-06-09T04:40:27.173 INFO:teuthology.orchestra.run.smithi018.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:27.173 INFO:teuthology.orchestra.run.smithi018.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-06-09T04:40:27.173 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:27.292 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_truncate_self 2023-06-09T04:40:27.439 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] af_unix 2023-06-09T04:40:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_stale_pmd 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi018.stderr: 42 | ftruncate(fd, 0); 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi018.stderr: 43 | ftruncate(fd, MiB(4)); 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi018.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:27.739 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_cow_race 2023-06-09T04:40:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_cow_race.c: In function 'main': 2023-06-09T04:40:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:27.860 INFO:teuthology.orchestra.run.smithi018.stderr: 61 | ftruncate(fd, 0); 2023-06-09T04:40:27.861 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:27.861 INFO:teuthology.orchestra.run.smithi018.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:27.861 INFO:teuthology.orchestra.run.smithi018.stderr: 62 | ftruncate(fd, MiB(2)); 2023-06-09T04:40:27.861 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:27.907 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_fallocate 2023-06-09T04:40:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fsync-err 2023-06-09T04:40:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_write_ro 2023-06-09T04:40:28.388 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-09T04:40:28.497 INFO:teuthology.orchestra.run.smithi018.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-06-09T04:40:28.497 INFO:teuthology.orchestra.run.smithi018.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:28.497 INFO:teuthology.orchestra.run.smithi018.stderr: 61 | ftruncate(fd, 0); 2023-06-09T04:40:28.497 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:28.540 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-09T04:40:28.680 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_ofd_locks 2023-06-09T04:40:28.879 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_collision 2023-06-09T04:40:29.083 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] mmap-write-concurrent 2023-06-09T04:40:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_get_file_time 2023-06-09T04:40:29.401 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_create_short_dirs 2023-06-09T04:40:29.566 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_create_long_dirs 2023-06-09T04:40:29.719 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_enospc 2023-06-09T04:40:29.923 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_writev_overlap 2023-06-09T04:40:30.104 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] checkpoint_journal 2023-06-09T04:40:30.263 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] mmap-rw-fault 2023-06-09T04:40:30.453 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] allocstale 2023-06-09T04:40:30.617 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_cow_memory_failure 2023-06-09T04:40:30.782 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fake-dump-rootino 2023-06-09T04:40:30.935 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dio-buf-fault 2023-06-09T04:40:31.073 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] xfsctl 2023-06-09T04:40:31.267 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] bstat 2023-06-09T04:40:31.487 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mtab 2023-06-09T04:40:31.601 INFO:teuthology.orchestra.run.smithi018.stderr:t_mtab.c: In function 'update_mtab': 2023-06-09T04:40:31.602 INFO:teuthology.orchestra.run.smithi018.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:31.602 INFO:teuthology.orchestra.run.smithi018.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-06-09T04:40:31.602 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:31.685 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] getdevicesize 2023-06-09T04:40:31.830 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] preallo_rw_pattern_reader 2023-06-09T04:40:31.960 INFO:teuthology.orchestra.run.smithi018.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-06-09T04:40:31.960 INFO:teuthology.orchestra.run.smithi018.stderr:iopat.c: In function 'main': 2023-06-09T04:40:31.960 INFO:teuthology.orchestra.run.smithi018.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:31.960 INFO:teuthology.orchestra.run.smithi018.stderr: 38 | read(fd, &x, 1048576); 2023-06-09T04:40:31.960 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:31.998 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] preallo_rw_pattern_writer 2023-06-09T04:40:32.111 INFO:teuthology.orchestra.run.smithi018.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-06-09T04:40:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:iopat.c: In function 'main': 2023-06-09T04:40:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:32.112 INFO:teuthology.orchestra.run.smithi018.stderr: 34 | write(fd, &x, 1048576); 2023-06-09T04:40:32.112 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] ftrunc 2023-06-09T04:40:32.292 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] trunc 2023-06-09T04:40:32.455 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fs_perms 2023-06-09T04:40:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c: In function 'main': 2023-06-09T04:40:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:32.572 INFO:teuthology.orchestra.run.smithi018.stderr: 54 | system("rm -f test.file"); 2023-06-09T04:40:32.572 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:32.572 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c: In function 'testsetup': 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr: 67 | system("cp testx.file test.file"); 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c: In function 'testfperm': 2023-06-09T04:40:32.573 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:32.574 INFO:teuthology.orchestra.run.smithi018.stderr: 123 | seteuid(0); 2023-06-09T04:40:32.574 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~ 2023-06-09T04:40:32.574 INFO:teuthology.orchestra.run.smithi018.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:32.574 INFO:teuthology.orchestra.run.smithi018.stderr: 124 | setegid(0); 2023-06-09T04:40:32.574 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~ 2023-06-09T04:40:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] testx 2023-06-09T04:40:32.739 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] looptest 2023-06-09T04:40:32.931 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] locktest 2023-06-09T04:40:33.268 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] unwritten_mmap 2023-06-09T04:40:33.422 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] bulkstat_unlink_test 2023-06-09T04:40:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test.c: In function 'main': 2023-06-09T04:40:33.537 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:33.538 INFO:teuthology.orchestra.run.smithi018.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-06-09T04:40:33.538 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:33.538 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:33.538 INFO:teuthology.orchestra.run.smithi018.stderr: 178 | system(fname); 2023-06-09T04:40:33.538 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~ 2023-06-09T04:40:33.625 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] deduperace 2023-06-09T04:40:33.829 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] bulkstat_unlink_test_modified 2023-06-09T04:40:33.961 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-06-09T04:40:33.961 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:33.961 INFO:teuthology.orchestra.run.smithi018.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-06-09T04:40:33.961 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:33.961 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:33.962 INFO:teuthology.orchestra.run.smithi018.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-06-09T04:40:33.962 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:33.962 INFO:teuthology.orchestra.run.smithi018.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:33.962 INFO:teuthology.orchestra.run.smithi018.stderr: 185 | system(fname); 2023-06-09T04:40:33.962 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~ 2023-06-09T04:40:34.043 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_dir_offset 2023-06-09T04:40:34.184 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_futimens 2023-06-09T04:40:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_immutable 2023-06-09T04:40:34.433 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c: In function 'create_test_area': 2023-06-09T04:40:34.433 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.433 INFO:teuthology.orchestra.run.smithi018.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:40:34.433 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.433 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.434 INFO:teuthology.orchestra.run.smithi018.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:40:34.434 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.436 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c: In function 'remove_test_area': 2023-06-09T04:40:34.436 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.436 INFO:teuthology.orchestra.run.smithi018.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:40:34.436 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.436 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.436 INFO:teuthology.orchestra.run.smithi018.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T04:40:34.437 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.438 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c: In function 'check_test_area': 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.439 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.440 INFO:teuthology.orchestra.run.smithi018.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:40:34.440 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.440 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.440 INFO:teuthology.orchestra.run.smithi018.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:40:34.440 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.442 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.442 INFO:teuthology.orchestra.run.smithi018.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:40:34.443 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.443 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.443 INFO:teuthology.orchestra.run.smithi018.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T04:40:34.443 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.443 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.443 INFO:teuthology.orchestra.run.smithi018.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T04:40:34.444 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c: In function 'test_immutable': 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-06-09T04:40:34.445 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr: 408 | chown(path, 0, 0); 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.446 INFO:teuthology.orchestra.run.smithi018.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr: 553 | chown(path, 0, 0); 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.447 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.448 INFO:teuthology.orchestra.run.smithi018.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr: 653 | chown(path, 0, 0); 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.449 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr: 705 | chown(path, 0, 0); 2023-06-09T04:40:34.450 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c: In function 'test_append': 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr: 1051 | chown(path, 0, 0); 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.452 INFO:teuthology.orchestra.run.smithi018.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-06-09T04:40:34.453 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.454 INFO:teuthology.orchestra.run.smithi018.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T04:40:34.454 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.454 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr: 1516 | chown(path, 0, 0); 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-06-09T04:40:34.455 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.456 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-06-09T04:40:34.457 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr: 1618 | chown(path, 0, 0); 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr: 1644 | chown(path, 0, 0); 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:40:34.459 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.460 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.460 INFO:teuthology.orchestra.run.smithi018.stderr: 1692 | chown(path, 0, 0); 2023-06-09T04:40:34.460 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:40:34.460 INFO:teuthology.orchestra.run.smithi018.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:34.460 INFO:teuthology.orchestra.run.smithi018.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T04:40:34.460 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.035 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] stale_handle 2023-06-09T04:40:35.164 INFO:teuthology.orchestra.run.smithi018.stderr:stale_handle.c: In function 'main': 2023-06-09T04:40:35.165 INFO:teuthology.orchestra.run.smithi018.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.165 INFO:teuthology.orchestra.run.smithi018.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-06-09T04:40:35.165 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.220 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] pwrite_mmap_blocked 2023-06-09T04:40:35.376 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_dir_offset2 2023-06-09T04:40:35.580 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] seek_sanity_test 2023-06-09T04:40:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c: In function 'test18': 2023-06-09T04:40:35.714 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.714 INFO:teuthology.orchestra.run.smithi018.stderr: 460 | ftruncate(fd, 0); 2023-06-09T04:40:35.714 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-06-09T04:40:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.717 INFO:teuthology.orchestra.run.smithi018.stderr: 1207 | ftruncate(fd, 0); 2023-06-09T04:40:35.717 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.717 INFO:teuthology.orchestra.run.smithi018.stderr: 1256 | ftruncate(fd, 0); 2023-06-09T04:40:35.717 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-06-09T04:40:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.718 INFO:teuthology.orchestra.run.smithi018.stderr: 88 | ftruncate(fd, 0); 2023-06-09T04:40:35.718 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.718 INFO:teuthology.orchestra.run.smithi018.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr: 98 | ftruncate(fd, 0); 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-06-09T04:40:35.719 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:36.173 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] seek_copy_test 2023-06-09T04:40:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_readdir_1 2023-06-09T04:40:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:t_readdir_1.c: In function 'main': 2023-06-09T04:40:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:36.478 INFO:teuthology.orchestra.run.smithi018.stderr: 30 | read(fd, buf, 100); 2023-06-09T04:40:36.478 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:36.509 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_readdir_2 2023-06-09T04:40:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fsync-tester 2023-06-09T04:40:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:fsync-tester.c: In function 'main': 2023-06-09T04:40:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:36.770 INFO:teuthology.orchestra.run.smithi018.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-06-09T04:40:36.771 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:36.771 INFO:teuthology.orchestra.run.smithi018.stderr: 541 | system("reboot -fn"); 2023-06-09T04:40:36.771 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-06-09T04:40:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:36.772 INFO:teuthology.orchestra.run.smithi018.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-06-09T04:40:36.772 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:36.928 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] nsexec 2023-06-09T04:40:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] cloner 2023-06-09T04:40:37.288 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] renameat2 2023-06-09T04:40:37.451 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_getcwd 2023-06-09T04:40:37.561 INFO:teuthology.orchestra.run.smithi018.stderr:t_getcwd.c: In function 'test_getcwd': 2023-06-09T04:40:37.561 INFO:teuthology.orchestra.run.smithi018.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:37.561 INFO:teuthology.orchestra.run.smithi018.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-06-09T04:40:37.561 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] e4compact 2023-06-09T04:40:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] test-nextquota 2023-06-09T04:40:38.012 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] punch-alternating 2023-06-09T04:40:38.187 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-09T04:40:38.354 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] listxattr 2023-06-09T04:40:38.489 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dio-interleaved 2023-06-09T04:40:38.652 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_dir_type 2023-06-09T04:40:38.802 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] dio-invalidate-cache 2023-06-09T04:40:38.903 INFO:teuthology.orchestra.run.smithi018.stderr:dio-invalidate-cache.c: In function 'main': 2023-06-09T04:40:38.903 INFO:teuthology.orchestra.run.smithi018.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:38.903 INFO:teuthology.orchestra.run.smithi018.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-06-09T04:40:38.904 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] stat_test 2023-06-09T04:40:39.318 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_encrypted_d_revalidate 2023-06-09T04:40:39.488 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] attr_replace_test 2023-06-09T04:40:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] swapon 2023-06-09T04:40:39.842 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] mkswap 2023-06-09T04:40:39.988 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_attr_corruption 2023-06-09T04:40:40.140 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_open_tmpfiles 2023-06-09T04:40:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fscrypt-crypt-util 2023-06-09T04:40:41.003 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] bulkstat_null_ocount 2023-06-09T04:40:41.154 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] splice-test 2023-06-09T04:40:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] chprojid_fail 2023-06-09T04:40:41.493 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] detached_mounts_propagation 2023-06-09T04:40:41.675 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] ext4_resize 2023-06-09T04:40:41.823 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_readdir_3 2023-06-09T04:40:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] splice2pipe 2023-06-09T04:40:42.124 INFO:teuthology.orchestra.run.smithi018.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-06-09T04:40:42.124 INFO:teuthology.orchestra.run.smithi018.stderr:splice2pipe.c:56:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:42.125 INFO:teuthology.orchestra.run.smithi018.stderr: 56 | write(p[1], buffer, n); 2023-06-09T04:40:42.125 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:splice2pipe.c:64:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:42.125 INFO:teuthology.orchestra.run.smithi018.stderr: 64 | read(p[0], buffer, n); 2023-06-09T04:40:42.125 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:42.174 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] uuid_ioctl 2023-06-09T04:40:42.329 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fiemap-tester 2023-06-09T04:40:42.622 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_stripealign 2023-06-09T04:40:42.781 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] open_by_handle 2023-06-09T04:40:42.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:42.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:43.045 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] t_mmap_dio 2023-06-09T04:40:43.204 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] xfsfind 2023-06-09T04:40:43.395 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] fssum 2023-06-09T04:40:43.869 INFO:teuthology.orchestra.run.smithi018.stdout:Building log-writes 2023-06-09T04:40:43.876 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] replay-log 2023-06-09T04:40:44.233 INFO:teuthology.orchestra.run.smithi018.stdout:Building perf 2023-06-09T04:40:44.237 INFO:teuthology.orchestra.run.smithi018.stdout:Building aio-dio-regress 2023-06-09T04:40:44.244 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aiocp 2023-06-09T04:40:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-09T04:40:44.682 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-append-write-read-race 2023-06-09T04:40:44.869 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-cow-race 2023-06-09T04:40:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-cycle-write 2023-06-09T04:40:45.151 INFO:teuthology.orchestra.run.smithi018.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-06-09T04:40:45.151 INFO:teuthology.orchestra.run.smithi018.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:45.151 INFO:teuthology.orchestra.run.smithi018.stderr: 83 | ftruncate(fd, buf_size); 2023-06-09T04:40:45.151 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-eof-race 2023-06-09T04:40:45.460 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-extend-stat 2023-06-09T04:40:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-fcntl-race 2023-06-09T04:40:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-hole-filling-race 2023-06-09T04:40:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-invalidate-failure 2023-06-09T04:40:46.141 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-invalidate-readahead 2023-06-09T04:40:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aiodio_sparse2 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi018.stderr: 111 | ftruncate(fd, filesize); 2023-06-09T04:40:46.442 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi018.stderr: 274 | ftruncate(fd, size); 2023-06-09T04:40:46.443 INFO:teuthology.orchestra.run.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-06-09T04:40:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-subblock-eof-read 2023-06-09T04:40:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-dio-write-verify 2023-06-09T04:40:46.929 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-09T04:40:47.074 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-09T04:40:47.210 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] aio-last-ref-held-by-io 2023-06-09T04:40:47.384 INFO:teuthology.orchestra.run.smithi018.stdout:Building vfs 2023-06-09T04:40:47.391 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] vfstest 2023-06-09T04:40:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: [CC] mount-idmapped 2023-06-09T04:40:50.075 INFO:teuthology.orchestra.run.smithi018.stdout:Building m4 2023-06-09T04:40:50.080 INFO:teuthology.orchestra.run.smithi018.stdout:Building common 2023-06-09T04:40:50.084 INFO:teuthology.orchestra.run.smithi018.stdout:Building tests 2023-06-09T04:40:50.090 INFO:teuthology.orchestra.run.smithi018.stdout:Building btrfs 2023-06-09T04:40:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/btrfs/group.list 2023-06-09T04:40:50.159 INFO:teuthology.orchestra.run.smithi018.stdout:Building ceph 2023-06-09T04:40:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ceph/group.list 2023-06-09T04:40:50.179 INFO:teuthology.orchestra.run.smithi018.stdout:Building cifs 2023-06-09T04:40:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/cifs/group.list 2023-06-09T04:40:50.196 INFO:teuthology.orchestra.run.smithi018.stdout:Building ext4 2023-06-09T04:40:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ext4/group.list 2023-06-09T04:40:50.241 INFO:teuthology.orchestra.run.smithi018.stdout:Building f2fs 2023-06-09T04:40:50.246 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/f2fs/group.list 2023-06-09T04:40:50.263 INFO:teuthology.orchestra.run.smithi018.stdout:Building generic 2023-06-09T04:40:50.270 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/generic/group.list 2023-06-09T04:40:50.375 INFO:teuthology.orchestra.run.smithi018.stdout:Building nfs 2023-06-09T04:40:50.381 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/nfs/group.list 2023-06-09T04:40:50.396 INFO:teuthology.orchestra.run.smithi018.stdout:Building ocfs2 2023-06-09T04:40:50.401 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ocfs2/group.list 2023-06-09T04:40:50.415 INFO:teuthology.orchestra.run.smithi018.stdout:Building overlay 2023-06-09T04:40:50.421 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/overlay/group.list 2023-06-09T04:40:50.462 INFO:teuthology.orchestra.run.smithi018.stdout:Building perf 2023-06-09T04:40:50.467 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/perf/group.list 2023-06-09T04:40:50.479 INFO:teuthology.orchestra.run.smithi018.stdout:Building selftest 2023-06-09T04:40:50.484 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/selftest/group.list 2023-06-09T04:40:50.496 INFO:teuthology.orchestra.run.smithi018.stdout:Building shared 2023-06-09T04:40:50.501 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/shared/group.list 2023-06-09T04:40:50.519 INFO:teuthology.orchestra.run.smithi018.stdout:Building tmpfs 2023-06-09T04:40:50.524 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/tmpfs/group.list 2023-06-09T04:40:50.539 INFO:teuthology.orchestra.run.smithi018.stdout:Building udf 2023-06-09T04:40:50.544 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/udf/group.list 2023-06-09T04:40:50.555 INFO:teuthology.orchestra.run.smithi018.stdout:Building xfs 2023-06-09T04:40:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/xfs/group.list 2023-06-09T04:40:50.679 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo make install) 2023-06-09T04:40:50.705 INFO:teuthology.orchestra.run.smithi018.stdout:Building include 2023-06-09T04:40:50.709 INFO:teuthology.orchestra.run.smithi018.stdout:Building lib 2023-06-09T04:40:50.713 INFO:teuthology.orchestra.run.smithi018.stdout:Building ltp 2023-06-09T04:40:50.718 INFO:teuthology.orchestra.run.smithi018.stdout:Building src 2023-06-09T04:40:50.757 INFO:teuthology.orchestra.run.smithi018.stdout:Building log-writes 2023-06-09T04:40:50.762 INFO:teuthology.orchestra.run.smithi018.stdout:Building perf 2023-06-09T04:40:50.767 INFO:teuthology.orchestra.run.smithi018.stdout:Building aio-dio-regress 2023-06-09T04:40:50.772 INFO:teuthology.orchestra.run.smithi018.stdout:Building vfs 2023-06-09T04:40:50.776 INFO:teuthology.orchestra.run.smithi018.stdout:Building m4 2023-06-09T04:40:50.780 INFO:teuthology.orchestra.run.smithi018.stdout:Building common 2023-06-09T04:40:50.784 INFO:teuthology.orchestra.run.smithi018.stdout:Building tests 2023-06-09T04:40:50.790 INFO:teuthology.orchestra.run.smithi018.stdout:Building btrfs 2023-06-09T04:40:50.797 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/btrfs/group.list 2023-06-09T04:40:50.858 INFO:teuthology.orchestra.run.smithi018.stdout:Building ceph 2023-06-09T04:40:50.863 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ceph/group.list 2023-06-09T04:40:50.879 INFO:teuthology.orchestra.run.smithi018.stdout:Building cifs 2023-06-09T04:40:50.885 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/cifs/group.list 2023-06-09T04:40:50.898 INFO:teuthology.orchestra.run.smithi018.stdout:Building ext4 2023-06-09T04:40:50.904 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ext4/group.list 2023-06-09T04:40:50.943 INFO:teuthology.orchestra.run.smithi018.stdout:Building f2fs 2023-06-09T04:40:50.949 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/f2fs/group.list 2023-06-09T04:40:50.967 INFO:teuthology.orchestra.run.smithi018.stdout:Building generic 2023-06-09T04:40:50.975 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/generic/group.list 2023-06-09T04:40:51.083 INFO:teuthology.orchestra.run.smithi018.stdout:Building nfs 2023-06-09T04:40:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/nfs/group.list 2023-06-09T04:40:51.102 INFO:teuthology.orchestra.run.smithi018.stdout:Building ocfs2 2023-06-09T04:40:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ocfs2/group.list 2023-06-09T04:40:51.123 INFO:teuthology.orchestra.run.smithi018.stdout:Building overlay 2023-06-09T04:40:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/overlay/group.list 2023-06-09T04:40:51.167 INFO:teuthology.orchestra.run.smithi018.stdout:Building perf 2023-06-09T04:40:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/perf/group.list 2023-06-09T04:40:51.185 INFO:teuthology.orchestra.run.smithi018.stdout:Building selftest 2023-06-09T04:40:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/selftest/group.list 2023-06-09T04:40:51.203 INFO:teuthology.orchestra.run.smithi018.stdout:Building shared 2023-06-09T04:40:51.209 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/shared/group.list 2023-06-09T04:40:51.227 INFO:teuthology.orchestra.run.smithi018.stdout:Building tmpfs 2023-06-09T04:40:51.232 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/tmpfs/group.list 2023-06-09T04:40:51.246 INFO:teuthology.orchestra.run.smithi018.stdout:Building udf 2023-06-09T04:40:51.252 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/udf/group.list 2023-06-09T04:40:51.264 INFO:teuthology.orchestra.run.smithi018.stdout:Building xfs 2023-06-09T04:40:51.271 INFO:teuthology.orchestra.run.smithi018.stdout: [GROUP] /tmp/tmp.l3ymdFtib6xfstests-dev/tests/xfs/group.list 2023-06-09T04:40:51.375 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-09T04:40:51.377 INFO:teuthology.orchestra.run.smithi018.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:40:51.377 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-09T04:40:51.380 INFO:teuthology.orchestra.run.smithi018.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:40:51.380 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-09T04:40:51.385 INFO:teuthology.orchestra.run.smithi018.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-09T04:40:51.394 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-09T04:40:51.478 INFO:teuthology.orchestra.run.smithi018.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-09T04:40:51.488 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-09T04:40:51.509 INFO:teuthology.orchestra.run.smithi018.stdout:Building log-writes 2023-06-09T04:40:51.514 INFO:teuthology.orchestra.run.smithi018.stdout:Building perf 2023-06-09T04:40:51.518 INFO:teuthology.orchestra.run.smithi018.stdout:Building aio-dio-regress 2023-06-09T04:40:51.523 INFO:teuthology.orchestra.run.smithi018.stdout:Building vfs 2023-06-09T04:40:51.527 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake -C log-writes install 2023-06-09T04:40:51.530 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-09T04:40:51.540 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-09T04:40:51.550 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake -C perf install 2023-06-09T04:40:51.552 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-09T04:40:51.563 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-09T04:40:51.587 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-09T04:40:51.590 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:40:51.600 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:40:51.658 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake -C vfs install 2023-06-09T04:40:51.661 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-09T04:40:51.673 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-09T04:40:51.689 INFO:teuthology.orchestra.run.smithi018.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-09T04:40:51.701 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-09T04:40:53.392 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-09T04:40:53.508 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-09T04:40:53.539 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-09T04:40:53.541 INFO:teuthology.orchestra.run.smithi018.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:40:53.542 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-09T04:40:53.544 INFO:teuthology.orchestra.run.smithi018.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-09T04:40:53.555 INFO:teuthology.orchestra.run.smithi018.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-09T04:40:53.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-09T04:40:53.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/btrfs/ install 2023-06-09T04:40:53.708 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:53.719 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:54.650 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:54.663 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 290.out 291.out 299.out /var/lib/xfstests/tests/btrfs 2023-06-09T04:40:55.689 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ceph/ install 2023-06-09T04:40:55.692 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-09T04:40:55.705 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-09T04:40:55.731 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-09T04:40:55.744 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-06-09T04:40:55.770 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/cifs/ install 2023-06-09T04:40:55.774 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-09T04:40:55.787 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-09T04:40:55.799 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-09T04:40:55.812 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-09T04:40:55.824 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ext4/ install 2023-06-09T04:40:55.827 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-09T04:40:55.839 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-09T04:40:56.082 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-09T04:40:56.095 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-06-09T04:40:56.346 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/f2fs/ install 2023-06-09T04:40:56.349 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:56.361 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:56.377 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:56.390 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-09T04:40:56.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/generic/ install 2023-06-09T04:40:56.412 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-09T04:40:56.424 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-09T04:40:58.937 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-09T04:40:58.950 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out /var/lib/xfstests/tests/generic 2023-06-09T04:41:01.509 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/nfs/ install 2023-06-09T04:41:01.512 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-09T04:41:01.525 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-09T04:41:01.537 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-09T04:41:01.550 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-09T04:41:01.562 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/ocfs2/ install 2023-06-09T04:41:01.566 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:01.577 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:01.589 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:01.601 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:01.613 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/overlay/ install 2023-06-09T04:41:01.616 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-09T04:41:01.629 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-09T04:41:01.962 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-09T04:41:01.976 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-06-09T04:41:02.317 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/perf/ install 2023-06-09T04:41:02.320 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-09T04:41:02.333 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-09T04:41:02.345 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-09T04:41:02.357 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-09T04:41:02.369 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/selftest/ install 2023-06-09T04:41:02.372 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-09T04:41:02.385 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-09T04:41:02.413 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-09T04:41:02.425 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-06-09T04:41:02.452 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/shared/ install 2023-06-09T04:41:02.455 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-09T04:41:02.467 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-09T04:41:02.485 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-09T04:41:02.496 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-06-09T04:41:02.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/tmpfs/ install 2023-06-09T04:41:02.517 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:02.528 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:02.552 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:02.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/udf/ install 2023-06-09T04:41:02.566 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-09T04:41:02.578 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-09T04:41:02.590 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-09T04:41:02.601 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-09T04:41:02.613 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.l3ymdFtib6xfstests-dev/tests/xfs/ install 2023-06-09T04:41:02.619 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-09T04:41:02.630 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-09T04:41:04.984 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-09T04:41:04.997 INFO:teuthology.orchestra.run.smithi018.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-06-09T04:41:07.453 INFO:teuthology.orchestra.run.smithi018.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-09T04:41:07.465 INFO:teuthology.orchestra.run.smithi018.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-09T04:41:07.478 INFO:teuthology.orchestra.run.smithi018.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-09T04:41:07.491 INFO:teuthology.orchestra.run.smithi018.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-09T04:41:07.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:07.506 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec ls tests/generic) 2023-06-09T04:41:07.553 INFO:teuthology.orchestra.run.smithi018.stdout:001 2023-06-09T04:41:07.553 INFO:teuthology.orchestra.run.smithi018.stdout:001.out 2023-06-09T04:41:07.553 INFO:teuthology.orchestra.run.smithi018.stdout:002 2023-06-09T04:41:07.553 INFO:teuthology.orchestra.run.smithi018.stdout:002.out 2023-06-09T04:41:07.553 INFO:teuthology.orchestra.run.smithi018.stdout:003 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:003.out 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:004 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:004.out 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:005 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:005.out 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:006 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:006.out 2023-06-09T04:41:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:007 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:007.out 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:008 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:008.out 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:009 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:009.out 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:010 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:010.out 2023-06-09T04:41:07.555 INFO:teuthology.orchestra.run.smithi018.stdout:011 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:011.out 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:012 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:012.out 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:013 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:013.out 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:014 2023-06-09T04:41:07.556 INFO:teuthology.orchestra.run.smithi018.stdout:014.out 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:015 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:015.out 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:016 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:016.out 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:017 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:017.out 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:018 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi018.stdout:018.out 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:019 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:019.out 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:020 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:020.out 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:021 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:021.out 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:022 2023-06-09T04:41:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:022.out 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:023 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:023.out 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:024 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:024.out 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:025 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:025.out 2023-06-09T04:41:07.559 INFO:teuthology.orchestra.run.smithi018.stdout:026 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:026.out 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:027 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:027.out 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:028 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:028.out 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:029 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:029.out 2023-06-09T04:41:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:030 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:030.out 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:031 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:031.out 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:032 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:032.out 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:033 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:033.out 2023-06-09T04:41:07.561 INFO:teuthology.orchestra.run.smithi018.stdout:034 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:034.out 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:035 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:035.cfg 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:035.out.default 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:035.out.nfs 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:036 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:036.out 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run.smithi018.stdout:037 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:037.out 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:038 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:038.out 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:039 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:039.out 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:040 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:040.out 2023-06-09T04:41:07.563 INFO:teuthology.orchestra.run.smithi018.stdout:041 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:041.out 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:042 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:042.out 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:043 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:043.out 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:044 2023-06-09T04:41:07.564 INFO:teuthology.orchestra.run.smithi018.stdout:044.out 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:045 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:045.out 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:046 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:046.out 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:047 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:047.out 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:048 2023-06-09T04:41:07.565 INFO:teuthology.orchestra.run.smithi018.stdout:048.out 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:049 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:049.out 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:050 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:050.cfg 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:050.out.default 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:050.out.nojournal 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:050.out.xfsquota 2023-06-09T04:41:07.566 INFO:teuthology.orchestra.run.smithi018.stdout:051 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:051.out 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:052 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:052.out 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:053 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:053.out 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:054 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:054.out 2023-06-09T04:41:07.567 INFO:teuthology.orchestra.run.smithi018.stdout:055 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:055.out 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:056 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:056.out 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:057 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:057.out 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:058 2023-06-09T04:41:07.568 INFO:teuthology.orchestra.run.smithi018.stdout:058.out 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:059 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:059.out 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:060 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:060.out 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:061 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:061.out 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:062 2023-06-09T04:41:07.569 INFO:teuthology.orchestra.run.smithi018.stdout:062.out 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:063 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:063.out 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:064 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:064.out 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:065 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:065.out 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:066 2023-06-09T04:41:07.570 INFO:teuthology.orchestra.run.smithi018.stdout:066.out 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:067 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:067.out 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:068 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:068.out 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:069 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:069.out 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:070 2023-06-09T04:41:07.571 INFO:teuthology.orchestra.run.smithi018.stdout:070.out 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:071 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:071.out 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:072 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:072.out 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:073 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:073.out 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:074 2023-06-09T04:41:07.572 INFO:teuthology.orchestra.run.smithi018.stdout:074.out 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:075 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:075.out 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:076 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:076.out 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:077 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:077.out 2023-06-09T04:41:07.573 INFO:teuthology.orchestra.run.smithi018.stdout:078 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:078.out 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:079 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:079.out 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:080 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:080.out 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:081 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:081.out 2023-06-09T04:41:07.574 INFO:teuthology.orchestra.run.smithi018.stdout:082 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:082.out 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:083 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:083.out 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:084 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:084.out 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:085 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:085.out 2023-06-09T04:41:07.575 INFO:teuthology.orchestra.run.smithi018.stdout:086 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:086.out 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:087 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:087.out 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:088 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:088.out 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:089 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:089.out 2023-06-09T04:41:07.576 INFO:teuthology.orchestra.run.smithi018.stdout:090 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:090.out 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:091 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:091.out 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:092 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:092.out 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:093 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:093.out 2023-06-09T04:41:07.577 INFO:teuthology.orchestra.run.smithi018.stdout:094 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:094.out 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:095 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:095.out 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:096 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:096.out 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:097 2023-06-09T04:41:07.578 INFO:teuthology.orchestra.run.smithi018.stdout:097.out 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:098 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:098.out 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:099 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:099.out 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:100 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:100.out 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:101 2023-06-09T04:41:07.579 INFO:teuthology.orchestra.run.smithi018.stdout:101.out 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:102 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:102.out 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:103 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:103.out 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:104 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:104.out 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:105 2023-06-09T04:41:07.580 INFO:teuthology.orchestra.run.smithi018.stdout:105.out 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:106 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:106.out 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:107 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:107.out 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:108 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:108.out 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:109 2023-06-09T04:41:07.581 INFO:teuthology.orchestra.run.smithi018.stdout:109.out 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:110 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:110.out 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:111 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:111.out 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:112 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:112.out 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:113 2023-06-09T04:41:07.582 INFO:teuthology.orchestra.run.smithi018.stdout:113.out 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:114 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:114.out 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:115 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:115.out 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:116 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:116.out 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:117 2023-06-09T04:41:07.583 INFO:teuthology.orchestra.run.smithi018.stdout:117.out 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:118 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:118.out 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:119 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:119.out 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:120 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:120.out 2023-06-09T04:41:07.584 INFO:teuthology.orchestra.run.smithi018.stdout:121 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:121.out 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:122 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:122.out 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:123 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:123.out 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:124 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:124.out 2023-06-09T04:41:07.585 INFO:teuthology.orchestra.run.smithi018.stdout:125 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:125.out 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:126 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:126.out 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:127 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:127.out 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:128 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:128.out 2023-06-09T04:41:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:129 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:129.out 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:130 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:130.out 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:131 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:131.out 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:132 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:132.out 2023-06-09T04:41:07.587 INFO:teuthology.orchestra.run.smithi018.stdout:133 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:133.out 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:134 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:134.out 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:135 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:135.out 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:136 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:136.out 2023-06-09T04:41:07.588 INFO:teuthology.orchestra.run.smithi018.stdout:137 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:137.out 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:138 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:138.out 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:139 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:139.out 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:140 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:140.out 2023-06-09T04:41:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:141 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:141.out 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:142 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:142.out 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:143 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:143.out 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:144 2023-06-09T04:41:07.590 INFO:teuthology.orchestra.run.smithi018.stdout:144.out 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:145 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:145.out 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:146 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:146.out 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:147 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:147.out 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:148 2023-06-09T04:41:07.591 INFO:teuthology.orchestra.run.smithi018.stdout:148.out 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:149 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:149.out 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:150 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:150.out 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:151 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:151.out 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:152 2023-06-09T04:41:07.592 INFO:teuthology.orchestra.run.smithi018.stdout:152.out 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:153 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:153.out 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:154 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:154.out 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:155 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:155.out 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:156 2023-06-09T04:41:07.593 INFO:teuthology.orchestra.run.smithi018.stdout:156.out 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:157 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:157.out 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:158 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:158.out 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:159 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:159.out 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:160 2023-06-09T04:41:07.594 INFO:teuthology.orchestra.run.smithi018.stdout:160.out 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:161 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:161.out 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:162 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:162.out 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:163 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:163.out 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:164 2023-06-09T04:41:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:164.out 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:165 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:165.out 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:166 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:166.out 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:167 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:167.out 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:168 2023-06-09T04:41:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:168.out 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:169 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:169.out 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:170 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:170.out 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:171 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:171.out 2023-06-09T04:41:07.597 INFO:teuthology.orchestra.run.smithi018.stdout:172 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:172.out 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:173 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:173.out 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:174 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:174.out 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:175 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:175.out 2023-06-09T04:41:07.598 INFO:teuthology.orchestra.run.smithi018.stdout:176 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:176.out 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:177 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:177.out 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:178 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:178.out 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:179 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:179.out 2023-06-09T04:41:07.599 INFO:teuthology.orchestra.run.smithi018.stdout:180 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:180.out 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:181 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:181.out 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:182 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:182.out 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:183 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:183.out 2023-06-09T04:41:07.600 INFO:teuthology.orchestra.run.smithi018.stdout:184 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:184.out 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:185 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:185.out 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:186 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:186.out 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:187 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:187.out 2023-06-09T04:41:07.601 INFO:teuthology.orchestra.run.smithi018.stdout:188 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:188.out 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:189 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:189.out 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:190 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:190.out 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:191 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:191.out 2023-06-09T04:41:07.602 INFO:teuthology.orchestra.run.smithi018.stdout:192 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:192.out 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:193 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:193.out 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:194 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:194.out 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:195 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:195.out 2023-06-09T04:41:07.603 INFO:teuthology.orchestra.run.smithi018.stdout:196 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:196.out 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:197 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:197.out 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:198 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:198.out 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:199 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:199.out 2023-06-09T04:41:07.604 INFO:teuthology.orchestra.run.smithi018.stdout:200 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:200.out 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:201 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:201.out 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:202 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:202.out 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:203 2023-06-09T04:41:07.605 INFO:teuthology.orchestra.run.smithi018.stdout:203.out 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:204 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:204.out 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:205 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:205.out 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:206 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:206.out 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:207 2023-06-09T04:41:07.606 INFO:teuthology.orchestra.run.smithi018.stdout:207.out 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:208 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:208.out 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:209 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:209.out 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:210 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:210.out 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:211 2023-06-09T04:41:07.607 INFO:teuthology.orchestra.run.smithi018.stdout:211.out 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:212 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:212.out 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:213 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:213.out 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:214 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:214.out 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:215 2023-06-09T04:41:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:215.out 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:216 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:216.out 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:217 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:217.out 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:218 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:218.out 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:219 2023-06-09T04:41:07.609 INFO:teuthology.orchestra.run.smithi018.stdout:219.out 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:220 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:220.out 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:221 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:221.out 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:222 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:222.out 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:223 2023-06-09T04:41:07.610 INFO:teuthology.orchestra.run.smithi018.stdout:223.out 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:224 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:224.out 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:225 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:225.out 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:226 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:226.out 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:227 2023-06-09T04:41:07.611 INFO:teuthology.orchestra.run.smithi018.stdout:227.out 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:228 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:228.out 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:229 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:229.out 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:230 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:230.out 2023-06-09T04:41:07.612 INFO:teuthology.orchestra.run.smithi018.stdout:231 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:231.out 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:232 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:232.out 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:233 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:233.out 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:234 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:234.out 2023-06-09T04:41:07.613 INFO:teuthology.orchestra.run.smithi018.stdout:235 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:235.out 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:236 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:236.out 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:237 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:237.out 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:238 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:238.out 2023-06-09T04:41:07.614 INFO:teuthology.orchestra.run.smithi018.stdout:239 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:239.out 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:240 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:240.out 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:241 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:241.out 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:242 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:242.out 2023-06-09T04:41:07.615 INFO:teuthology.orchestra.run.smithi018.stdout:243 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:243.out 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:244 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:244.out 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:245 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:245.out 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:246 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:246.out 2023-06-09T04:41:07.616 INFO:teuthology.orchestra.run.smithi018.stdout:247 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:247.out 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:248 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:248.out 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:249 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:249.out 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:250 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:250.out 2023-06-09T04:41:07.617 INFO:teuthology.orchestra.run.smithi018.stdout:251 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:251.out 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:252 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:252.out 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:253 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:253.out 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:254 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:254.out 2023-06-09T04:41:07.618 INFO:teuthology.orchestra.run.smithi018.stdout:255 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:255.out 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:256 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:256.out 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:257 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:257.out 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:258 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:258.out 2023-06-09T04:41:07.619 INFO:teuthology.orchestra.run.smithi018.stdout:259 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:259.out 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:260 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:260.out 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:261 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:261.out 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:262 2023-06-09T04:41:07.620 INFO:teuthology.orchestra.run.smithi018.stdout:262.out 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:263 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:263.out 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:264 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:264.out 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:265 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:265.out 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:266 2023-06-09T04:41:07.621 INFO:teuthology.orchestra.run.smithi018.stdout:266.out 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:267 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:267.out 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:268 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:268.out 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:269 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:269.out 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:270 2023-06-09T04:41:07.622 INFO:teuthology.orchestra.run.smithi018.stdout:270.out 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:271 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:271.out 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:272 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:272.out 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:273 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:273.out 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:274 2023-06-09T04:41:07.623 INFO:teuthology.orchestra.run.smithi018.stdout:274.out 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:275 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:275.out 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:276 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:276.out 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:277 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:277.out 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:278 2023-06-09T04:41:07.624 INFO:teuthology.orchestra.run.smithi018.stdout:278.out 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:279 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:279.out 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:280 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:280.out 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:281 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:281.out 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:282 2023-06-09T04:41:07.625 INFO:teuthology.orchestra.run.smithi018.stdout:282.out 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:283 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:283.out 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:284 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:284.out 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:285 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:285.out 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:286 2023-06-09T04:41:07.626 INFO:teuthology.orchestra.run.smithi018.stdout:286.out 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:287 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:287.out 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:288 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:288.out 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:289 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:289.out 2023-06-09T04:41:07.627 INFO:teuthology.orchestra.run.smithi018.stdout:290 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:290.out 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:291 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:291.out 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:292 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:292.out 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:293 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:293.out 2023-06-09T04:41:07.628 INFO:teuthology.orchestra.run.smithi018.stdout:294 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:294.out 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:295 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:295.out 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:296 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:296.out 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:297 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:297.out 2023-06-09T04:41:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:298 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:298.out 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:299 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:299.out 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:300 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:300.out 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:301 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:301.out 2023-06-09T04:41:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:302 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:302.out 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:303 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:303.out 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:304 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:304.out 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:305 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:305.out 2023-06-09T04:41:07.631 INFO:teuthology.orchestra.run.smithi018.stdout:306 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:306.out 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:307 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:307.out 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:308 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:308.out 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:309 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:309.out 2023-06-09T04:41:07.632 INFO:teuthology.orchestra.run.smithi018.stdout:310 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:310.out 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:311 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:311.out 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:312 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:312.out 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:313 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:313.out 2023-06-09T04:41:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:314 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:314.out 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:315 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:315.out 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:316 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:316.out 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:317 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:317.out 2023-06-09T04:41:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:318 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:318.out 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:319 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:319.out 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:320 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:320.out 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:321 2023-06-09T04:41:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:321.out 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:322 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:322.out 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:323 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:323.out 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:324 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:324.out 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:325 2023-06-09T04:41:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:325.out 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:326 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:326.out 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:327 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:327.out 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:328 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:328.out 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:329 2023-06-09T04:41:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:329.out 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:330 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:330.out 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:331 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:331.out 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:332 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:332.out 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:333 2023-06-09T04:41:07.638 INFO:teuthology.orchestra.run.smithi018.stdout:333.out 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:334 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:334.out 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:335 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:335.out 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:336 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:336.out 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:337 2023-06-09T04:41:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:337.out 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:338 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:338.out 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:339 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:339.out 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:340 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:340.out 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:341 2023-06-09T04:41:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:341.out 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:342 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:342.out 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:343 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:343.out 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:344 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:344.out 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:345 2023-06-09T04:41:07.641 INFO:teuthology.orchestra.run.smithi018.stdout:345.out 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:346 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:346.out 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:347 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:347.out 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:348 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:348.out 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:349 2023-06-09T04:41:07.642 INFO:teuthology.orchestra.run.smithi018.stdout:349.out 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:350 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:350.out 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:351 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:351.out 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:352 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:352.out 2023-06-09T04:41:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:353 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:353.out 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:354 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:354.out 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:355 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:355.out 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:356 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:356.out 2023-06-09T04:41:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:357 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:357.out 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:358 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:358.out 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:359 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:359.out 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:360 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:360.out 2023-06-09T04:41:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:361 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:361.out 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:362 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:362.out 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:363 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:363.out 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:364 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:364.out 2023-06-09T04:41:07.646 INFO:teuthology.orchestra.run.smithi018.stdout:365 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:365.out 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:366 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:366.out 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:367 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:367.out 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:368 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:368.out 2023-06-09T04:41:07.647 INFO:teuthology.orchestra.run.smithi018.stdout:369 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:369.out 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:370 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:370.out 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:371 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:371.out 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:372 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:372.out 2023-06-09T04:41:07.648 INFO:teuthology.orchestra.run.smithi018.stdout:373 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:373.out 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:374 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:374.out 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:375 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:375.out 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:376 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:376.out 2023-06-09T04:41:07.649 INFO:teuthology.orchestra.run.smithi018.stdout:377 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:377.out 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:378 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:378.out 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:379 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:379.out 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:380 2023-06-09T04:41:07.650 INFO:teuthology.orchestra.run.smithi018.stdout:380.out 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:381 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:381.out 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:382 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:382.out 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:383 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:383.out 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:384 2023-06-09T04:41:07.651 INFO:teuthology.orchestra.run.smithi018.stdout:384.out 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:385 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:385.out 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:386 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:386.out 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:387 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:387.out 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:388 2023-06-09T04:41:07.652 INFO:teuthology.orchestra.run.smithi018.stdout:388.out 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:389 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:389.out 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:390 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:390.out 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:391 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:391.out 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:392 2023-06-09T04:41:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:392.out 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:393 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:393.out 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:394 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:394.out 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:395 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:395.out 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:396 2023-06-09T04:41:07.654 INFO:teuthology.orchestra.run.smithi018.stdout:396.out 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:397 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:397.out 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:398 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:398.out 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:399 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:399.out 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:400 2023-06-09T04:41:07.655 INFO:teuthology.orchestra.run.smithi018.stdout:400.out 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:401 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:401.out 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:402 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:402.out 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:403 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:403.out 2023-06-09T04:41:07.656 INFO:teuthology.orchestra.run.smithi018.stdout:404 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:404.out 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:405 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:405.out 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:406 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:406.out 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:407 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:407.out 2023-06-09T04:41:07.657 INFO:teuthology.orchestra.run.smithi018.stdout:408 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:408.out 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:409 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:409.out 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:410 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:410.out 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:411 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:411.out 2023-06-09T04:41:07.658 INFO:teuthology.orchestra.run.smithi018.stdout:412 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:412.out 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:413 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:413.out 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:414 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:414.out 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:415 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:415.out 2023-06-09T04:41:07.659 INFO:teuthology.orchestra.run.smithi018.stdout:416 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:416.out 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:417 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:417.out 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:418 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:418.out 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:419 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:419.out 2023-06-09T04:41:07.660 INFO:teuthology.orchestra.run.smithi018.stdout:420 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:420.out 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:421 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:421.out 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:422 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:422.out 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:423 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:423.out 2023-06-09T04:41:07.661 INFO:teuthology.orchestra.run.smithi018.stdout:424 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:424.out 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:425 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:425.out 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:426 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:426.out 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:427 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:427.out 2023-06-09T04:41:07.662 INFO:teuthology.orchestra.run.smithi018.stdout:428 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:428.out 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:429 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:429.out 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:430 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:430.out 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:431 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:431.out 2023-06-09T04:41:07.663 INFO:teuthology.orchestra.run.smithi018.stdout:432 2023-06-09T04:41:07.664 INFO:teuthology.orchestra.run.smithi018.stdout:432.out 2023-06-09T04:41:07.664 INFO:teuthology.orchestra.run.smithi018.stdout:433 2023-06-09T04:41:07.664 INFO:teuthology.orchestra.run.smithi018.stdout:433.out 2023-06-09T04:41:07.664 INFO:teuthology.orchestra.run.smithi018.stdout:434 2023-06-09T04:41:07.664 INFO:teuthology.orchestra.run.smithi018.stdout:434.out 2023-06-09T04:41:07.664 INFO:teuthology.orchestra.run.smithi018.stdout:435 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:435.out 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:436 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:436.out 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:437 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:437.out 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:438 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:438.out 2023-06-09T04:41:07.665 INFO:teuthology.orchestra.run.smithi018.stdout:439 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:439.out 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:440 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:440.out 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:441 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:441.out 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:442 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:442.out 2023-06-09T04:41:07.666 INFO:teuthology.orchestra.run.smithi018.stdout:443 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:443.out 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:444 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:444.out 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:445 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:445.out 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:446 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:446.out 2023-06-09T04:41:07.667 INFO:teuthology.orchestra.run.smithi018.stdout:447 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:447.out 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:448 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:448.out 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:449 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:449.out 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:450 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:450.out 2023-06-09T04:41:07.668 INFO:teuthology.orchestra.run.smithi018.stdout:451 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:451.out 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:452 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:452.out 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:453 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:453.out 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:454 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:454.out 2023-06-09T04:41:07.669 INFO:teuthology.orchestra.run.smithi018.stdout:455 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:455.out 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:456 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:456.out 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:457 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:457.out 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:458 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:458.out 2023-06-09T04:41:07.670 INFO:teuthology.orchestra.run.smithi018.stdout:459 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:459.out 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:460 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:460.out 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:461 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:461.out 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:462 2023-06-09T04:41:07.671 INFO:teuthology.orchestra.run.smithi018.stdout:462.out 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:463 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:463.out 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:464 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:464.out 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:465 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:465.out 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:466 2023-06-09T04:41:07.672 INFO:teuthology.orchestra.run.smithi018.stdout:466.out 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:467 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:467.out 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:468 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:468.out 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:469 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:469.out 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:470 2023-06-09T04:41:07.673 INFO:teuthology.orchestra.run.smithi018.stdout:470.out 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:471 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:471.out 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:472 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:472.out 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:473 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:473.out 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:474 2023-06-09T04:41:07.674 INFO:teuthology.orchestra.run.smithi018.stdout:474.out 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:475 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:475.out 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:476 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:476.out 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:477 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:477.out 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:478 2023-06-09T04:41:07.675 INFO:teuthology.orchestra.run.smithi018.stdout:478.out 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:479 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:479.out 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:480 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:480.out 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:481 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:481.out 2023-06-09T04:41:07.676 INFO:teuthology.orchestra.run.smithi018.stdout:482 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:482.out 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:483 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:483.out 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:484 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:484.out 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:485 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:485.out 2023-06-09T04:41:07.677 INFO:teuthology.orchestra.run.smithi018.stdout:486 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:486.out 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:487 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:487.out 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:488 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:488.out 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:489 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:489.out 2023-06-09T04:41:07.678 INFO:teuthology.orchestra.run.smithi018.stdout:490 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:490.out 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:491 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:491.out 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:492 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:492.out 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:493 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:493.out 2023-06-09T04:41:07.679 INFO:teuthology.orchestra.run.smithi018.stdout:494 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:494.out 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:495 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:495.out 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:496 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:496.out 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:497 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:497.out 2023-06-09T04:41:07.680 INFO:teuthology.orchestra.run.smithi018.stdout:498 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:498.out 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:499 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:499.out 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:500 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:500.out 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:501 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:501.out 2023-06-09T04:41:07.681 INFO:teuthology.orchestra.run.smithi018.stdout:502 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:502.out 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:503 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:503.out 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:504 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:504.out 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:505 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:505.out 2023-06-09T04:41:07.682 INFO:teuthology.orchestra.run.smithi018.stdout:506 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:506.out 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:507 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:507.out 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:508 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:508.out 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:509 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:509.out 2023-06-09T04:41:07.683 INFO:teuthology.orchestra.run.smithi018.stdout:510 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:510.out 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:511 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:511.out 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:512 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:512.out 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:513 2023-06-09T04:41:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:513.out 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:514 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:514.out 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:515 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:515.out 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:516 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:516.out 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:517 2023-06-09T04:41:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:517.out 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:518 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:518.out 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:519 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:519.out 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:520 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:520.out 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:521 2023-06-09T04:41:07.686 INFO:teuthology.orchestra.run.smithi018.stdout:521.out 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:522 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:522.out 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:523 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:523.out 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:524 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:524.out 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:525 2023-06-09T04:41:07.687 INFO:teuthology.orchestra.run.smithi018.stdout:525.out 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:526 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:526.out 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:527 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:527.out 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:528 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:528.out 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:529 2023-06-09T04:41:07.688 INFO:teuthology.orchestra.run.smithi018.stdout:529.out 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:530 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:530.out 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:531 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:531.out 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:532 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:532.out 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:533 2023-06-09T04:41:07.689 INFO:teuthology.orchestra.run.smithi018.stdout:533.out 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:534 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:534.out 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:535 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:535.out 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:536 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:536.out 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:537 2023-06-09T04:41:07.690 INFO:teuthology.orchestra.run.smithi018.stdout:537.out 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:538 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:538.out 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:539 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:539.out 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:540 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:540.out 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:541 2023-06-09T04:41:07.691 INFO:teuthology.orchestra.run.smithi018.stdout:541.out 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:542 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:542.out 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:543 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:543.out 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:544 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:544.out 2023-06-09T04:41:07.692 INFO:teuthology.orchestra.run.smithi018.stdout:545 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:545.out 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:546 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:546.out 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:547 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:547.out 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:548 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:548.out 2023-06-09T04:41:07.693 INFO:teuthology.orchestra.run.smithi018.stdout:549 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:549.out 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:550 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:550.out 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:551 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:551.out 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:552 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:552.out 2023-06-09T04:41:07.694 INFO:teuthology.orchestra.run.smithi018.stdout:553 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:553.out 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:554 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:554.out 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:555 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:555.out 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:556 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:556.out 2023-06-09T04:41:07.695 INFO:teuthology.orchestra.run.smithi018.stdout:557 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:557.out 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:558 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:558.out 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:559 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:559.out 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:560 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:560.out 2023-06-09T04:41:07.696 INFO:teuthology.orchestra.run.smithi018.stdout:561 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:561.out 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:562 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:562.out 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:563 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:563.out 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:564 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:564.out 2023-06-09T04:41:07.697 INFO:teuthology.orchestra.run.smithi018.stdout:565 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:565.out 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:566 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:566.out 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:567 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:567.out 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:568 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:568.out 2023-06-09T04:41:07.698 INFO:teuthology.orchestra.run.smithi018.stdout:569 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:569.out 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:570 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:570.out 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:571 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:571.out 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:572 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:572.out 2023-06-09T04:41:07.699 INFO:teuthology.orchestra.run.smithi018.stdout:573 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:573.out 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:574 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:574.out 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:575 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:575.out 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:576 2023-06-09T04:41:07.700 INFO:teuthology.orchestra.run.smithi018.stdout:576.out 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:577 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:577.out 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:578 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:578.out 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:579 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:579.out 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:580 2023-06-09T04:41:07.701 INFO:teuthology.orchestra.run.smithi018.stdout:580.out 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:581 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:581.out 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:582 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:582.out 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:583 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:583.out 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:584 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:584.out 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:585 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:585.out 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:586 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:586.out 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:587 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:587.out 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:588 2023-06-09T04:41:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:588.out 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:589 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:589.out 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:590 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:590.out 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:591 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:591.out 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:592 2023-06-09T04:41:07.704 INFO:teuthology.orchestra.run.smithi018.stdout:592.out 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:593 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:593.out 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:594 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:594.out 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:595 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:595.out 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:596 2023-06-09T04:41:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:596.out 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:597 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:597.out 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:598 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:598.out 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:599 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:599.out 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:600 2023-06-09T04:41:07.706 INFO:teuthology.orchestra.run.smithi018.stdout:600.out 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:601 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:601.out 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:602 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:602.out 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:603 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:603.out 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:604 2023-06-09T04:41:07.707 INFO:teuthology.orchestra.run.smithi018.stdout:604.out 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:605 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:605.out 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:606 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:606.out 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:607 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:607.out 2023-06-09T04:41:07.708 INFO:teuthology.orchestra.run.smithi018.stdout:608 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:608.out 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:609 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:609.out 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:610 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:610.out 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:611 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:611.out 2023-06-09T04:41:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:612 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:612.out 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:613 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:613.out 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:614 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:614.out 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:615 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:615.out 2023-06-09T04:41:07.710 INFO:teuthology.orchestra.run.smithi018.stdout:616 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:616.out 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:617 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:617.out 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:618 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:618.out 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:619 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:619.out 2023-06-09T04:41:07.711 INFO:teuthology.orchestra.run.smithi018.stdout:620 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:620.out 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:621 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:621.out 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:622 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:622.out 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:623 2023-06-09T04:41:07.712 INFO:teuthology.orchestra.run.smithi018.stdout:623.out 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:624 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:624.out 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:625 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:625.out 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:626 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:626.out 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:627 2023-06-09T04:41:07.713 INFO:teuthology.orchestra.run.smithi018.stdout:627.out 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:628 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:628.out 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:629 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:629.out 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:630 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:630.out 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:631 2023-06-09T04:41:07.714 INFO:teuthology.orchestra.run.smithi018.stdout:631.out 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:632 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:632.out 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:633 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:633.out 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:634 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:634.out 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:635 2023-06-09T04:41:07.715 INFO:teuthology.orchestra.run.smithi018.stdout:635.out 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:636 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:636.out 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:637 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:637.out 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:638 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:638.out 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:639 2023-06-09T04:41:07.716 INFO:teuthology.orchestra.run.smithi018.stdout:639.out 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:640 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:640.out 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:641 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:641.out 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:642 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:642.out 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:643 2023-06-09T04:41:07.717 INFO:teuthology.orchestra.run.smithi018.stdout:643.out 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:644 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:644.out 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:645 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:645.out 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:646 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:646.out 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:647 2023-06-09T04:41:07.718 INFO:teuthology.orchestra.run.smithi018.stdout:647.out 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:648 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:648.out 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:649 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:649.out 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:650 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:650.out 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:651 2023-06-09T04:41:07.719 INFO:teuthology.orchestra.run.smithi018.stdout:651.out 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:652 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:652.out 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:653 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:653.out 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:654 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:654.out 2023-06-09T04:41:07.720 INFO:teuthology.orchestra.run.smithi018.stdout:655 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:655.out 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:656 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:656.out 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:657 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:657.out 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:658 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:658.out 2023-06-09T04:41:07.721 INFO:teuthology.orchestra.run.smithi018.stdout:659 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:659.out 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:660 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:660.out 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:661 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:661.out 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:662 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:662.out 2023-06-09T04:41:07.722 INFO:teuthology.orchestra.run.smithi018.stdout:663 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:663.out 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:664 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:664.out 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:665 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:665.out 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:666 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:666.out 2023-06-09T04:41:07.723 INFO:teuthology.orchestra.run.smithi018.stdout:667 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:667.out 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:668 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:668.out 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:669 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:669.out 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:670 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:670.out 2023-06-09T04:41:07.724 INFO:teuthology.orchestra.run.smithi018.stdout:671 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:671.out 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:672 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:672.out 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:673 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:673.out 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:674 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:674.out 2023-06-09T04:41:07.725 INFO:teuthology.orchestra.run.smithi018.stdout:675 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:675.out 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:676 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:676.out 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:677 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:677.out 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:678 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:678.out 2023-06-09T04:41:07.726 INFO:teuthology.orchestra.run.smithi018.stdout:679 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:679.out 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:680 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:680.out 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:681 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:681.out 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:682 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:682.out 2023-06-09T04:41:07.727 INFO:teuthology.orchestra.run.smithi018.stdout:683 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:683.out 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:684 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:684.out 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:685 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:685.out 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:686 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:686.out 2023-06-09T04:41:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:687 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:687.out 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:688 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:688.out 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:689 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:689.out 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:690 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:690.out 2023-06-09T04:41:07.729 INFO:teuthology.orchestra.run.smithi018.stdout:691 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:691.out 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:692 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:692.out 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:693 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:693.out 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:694 2023-06-09T04:41:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:694.out 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:695 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:695.out 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:696 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:696.out 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:697 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:697.out 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:698 2023-06-09T04:41:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:698.out 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:699 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:699.out 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:700 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:700.out 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:701 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:701.out 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:702 2023-06-09T04:41:07.732 INFO:teuthology.orchestra.run.smithi018.stdout:702.out 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:703 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:703.out 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:704 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:704.out 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:705 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:705.out 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:706 2023-06-09T04:41:07.733 INFO:teuthology.orchestra.run.smithi018.stdout:706.out 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:707 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:707.out 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:708 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:708.out 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:709 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:709.out 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:710 2023-06-09T04:41:07.734 INFO:teuthology.orchestra.run.smithi018.stdout:710.out 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:711 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:711.out 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:712 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:712.out 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:713 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:713.out 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:714 2023-06-09T04:41:07.735 INFO:teuthology.orchestra.run.smithi018.stdout:714.out 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:715 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:715.out 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:716 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:716.out 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:717 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:717.out 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:718 2023-06-09T04:41:07.736 INFO:teuthology.orchestra.run.smithi018.stdout:718.out 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:719 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:719.out 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:720 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:720.out 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:721 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:721.out 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:722 2023-06-09T04:41:07.737 INFO:teuthology.orchestra.run.smithi018.stdout:722.out 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:723 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:723.out 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:724 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:724.out 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:725 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:725.out 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:726 2023-06-09T04:41:07.738 INFO:teuthology.orchestra.run.smithi018.stdout:726.out 2023-06-09T04:41:07.739 INFO:teuthology.orchestra.run.smithi018.stdout:727 2023-06-09T04:41:07.739 INFO:teuthology.orchestra.run.smithi018.stdout:727.out 2023-06-09T04:41:07.739 INFO:teuthology.orchestra.run.smithi018.stdout:group.list 2023-06-09T04:41:07.739 INFO:teuthology.orchestra.run.smithi018.stdout:Makefile 2023-06-09T04:41:07.740 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-09T04:41:08.037 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:08.042 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:41:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:10.345 INFO:teuthology.orchestra.run.smithi018.stdout:generic/001 2s 2023-06-09T04:41:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/001 2023-06-09T04:41:10.352 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:41:10.356 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:10.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[49091]: fuse finished with error 0 and tester_r 0 2023-06-09T04:41:10.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:10.368 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-09T04:41:10.588 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:10.592 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:41:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:11.272 INFO:teuthology.orchestra.run.smithi018.stdout:generic/002 1s 2023-06-09T04:41:11.279 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/002 2023-06-09T04:41:11.279 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:41:11.282 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:11.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:11.292 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-09T04:41:11.529 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:11.533 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:41:11.533 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:11.656 INFO:teuthology.orchestra.run.smithi018.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:41:11.660 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/003 2023-06-09T04:41:11.660 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/003 2023-06-09T04:41:11.660 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:41:11.663 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:11.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:11.671 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-09T04:41:11.862 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:11.866 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:41:11.866 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:11.980 INFO:teuthology.orchestra.run.smithi018.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-09T04:41:11.984 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/004 2023-06-09T04:41:11.984 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/004 2023-06-09T04:41:11.984 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:41:11.986 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:11.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:11.994 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-09T04:41:12.171 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:12.174 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:41:12.175 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:12.873 INFO:teuthology.orchestra.run.smithi018.stdout:generic/005 0s 2023-06-09T04:41:12.879 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/005 2023-06-09T04:41:12.879 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:41:12.882 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:12.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:12.891 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-09T04:41:12.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:12.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:13.131 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:41:13.135 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:41:13.135 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:41:43.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:43.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:13.174 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:13.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:27.565 INFO:teuthology.orchestra.run.smithi018.stdout:generic/006 74s 2023-06-09T04:42:27.572 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/006 2023-06-09T04:42:27.573 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:42:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:42:27.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:42:27.588 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-09T04:42:27.818 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:42:27.823 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:42:27.823 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:42:43.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:43.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:13.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:13.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:43.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:43.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:13.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:13.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:43.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:43.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:13.858 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:13.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:19.091 INFO:teuthology.orchestra.run.smithi018.stdout:generic/007 172s 2023-06-09T04:45:19.098 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/007 2023-06-09T04:45:19.098 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:45:19.101 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:19.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:45:19.112 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-09T04:45:19.349 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:45:19.354 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:45:19.354 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:20.492 INFO:teuthology.orchestra.run.smithi018.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:45:20.497 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/008 2023-06-09T04:45:20.498 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/008 2023-06-09T04:45:20.498 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:45:20.500 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:20.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:45:20.511 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-09T04:45:20.716 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:45:20.721 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:45:20.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:22.489 INFO:teuthology.orchestra.run.smithi018.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:45:22.496 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/009 2023-06-09T04:45:22.496 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/009 2023-06-09T04:45:22.496 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:45:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:22.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:45:22.513 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-09T04:45:22.740 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:45:22.745 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:45:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:22.908 INFO:teuthology.orchestra.run.smithi018.stdout:generic/010 [not run] /tmp/tmp.l3ymdFtib6xfstests-dev/src/dbtest not built 2023-06-09T04:45:22.912 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/010 2023-06-09T04:45:22.912 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/010 2023-06-09T04:45:22.912 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:45:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:22.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:45:22.927 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-09T04:45:23.144 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:45:23.149 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:45:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:45:44.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:44.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:14.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:14.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:26.011 INFO:teuthology.orchestra.run.smithi018.stdout:generic/011 63s 2023-06-09T04:46:26.018 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/011 2023-06-09T04:46:26.018 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:46:26.022 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:46:26.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:26.035 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-09T04:46:26.281 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:46:26.285 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:46:26.285 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:46:27.349 INFO:teuthology.orchestra.run.smithi018.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:46:27.353 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/012 2023-06-09T04:46:27.353 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/012 2023-06-09T04:46:27.353 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:46:27.355 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:46:27.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:27.366 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-09T04:46:27.590 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:46:27.594 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:46:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:46:44.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:44.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:14.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:14.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:45.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:45.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:11.012 INFO:teuthology.orchestra.run.smithi018.stdout:generic/013 104s 2023-06-09T04:48:11.018 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/013 2023-06-09T04:48:11.019 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:48:11.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:48:11.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:11.040 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-09T04:48:11.344 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:48:11.349 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:48:11.350 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:48:15.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:15.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:45.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:45.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:45.370 INFO:tasks.ceph.mds.d.smithi081.stderr:2023-06-09T04:48:45.370+0000 7f622c395640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43190) UID: 0 2023-06-09T04:48:45.372 INFO:tasks.ceph.mds.b.smithi081.stderr:2023-06-09T04:48:45.370+0000 7f0432806640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43190) UID: 0 2023-06-09T04:52:44.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:44.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:14.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:14.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:30.947 INFO:teuthology.orchestra.run.smithi018.stdout:generic/014 319s 2023-06-09T04:53:30.954 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/014 2023-06-09T04:53:30.954 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:30.956 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:30.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:30.969 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-09T04:53:31.211 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:31.216 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:31.216 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:31.388 INFO:teuthology.orchestra.run.smithi018.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:53:31.392 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/015 2023-06-09T04:53:31.392 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/015 2023-06-09T04:53:31.392 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:31.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:31.406 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-09T04:53:31.675 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:31.679 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:31.679 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:33.114 INFO:teuthology.orchestra.run.smithi018.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:53:33.119 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/016 2023-06-09T04:53:33.119 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/016 2023-06-09T04:53:33.119 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:33.123 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:33.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:33.138 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-09T04:53:33.644 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:33.648 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:33.648 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:33.807 INFO:teuthology.orchestra.run.smithi018.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:53:33.811 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/017 2023-06-09T04:53:33.811 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/017 2023-06-09T04:53:33.811 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:33.813 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:33.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:33.829 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-09T04:53:34.087 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:34.091 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:34.091 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:34.251 INFO:teuthology.orchestra.run.smithi018.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:53:34.256 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/018 2023-06-09T04:53:34.256 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/018 2023-06-09T04:53:34.257 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:34.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:34.275 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-09T04:53:34.555 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:34.559 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:34.559 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:34.715 INFO:teuthology.orchestra.run.smithi018.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:53:34.719 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/019 2023-06-09T04:53:34.719 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/019 2023-06-09T04:53:34.719 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:34.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:34.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:34.732 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-09T04:53:35.008 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:35.013 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:35.013 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:44.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:44.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:51.553 INFO:teuthology.orchestra.run.smithi018.stdout:generic/020 - output mismatch (see /tmp/tmp.l3ymdFtib6xfstests-dev/results//generic/020.out.bad) 2023-06-09T04:53:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: --- tests/generic/020.out 2023-06-09 04:39:54.742473196 +0000 2023-06-09T04:53:51.555 INFO:teuthology.orchestra.run.smithi018.stdout: +++ /tmp/tmp.l3ymdFtib6xfstests-dev/results//generic/020.out.bad 2023-06-09 04:53:51.549848652 +0000 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: @@ -39,27 +39,6 @@ 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: user.snrub="fish2\012" 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: *** add lots of attributes 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: -*** check 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: - *** MAX_ATTRS attribute(s) 2023-06-09T04:53:51.556 INFO:teuthology.orchestra.run.smithi018.stdout: -*** remove lots of attributes 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: - *** print attributes 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: -# file: 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: -user.snrub="fish2\012" 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: - 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: -*** really long value 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: -0000000 00 2023-06-09T04:53:51.557 INFO:teuthology.orchestra.run.smithi018.stdout: -* 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -ATTRSIZE 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -*** set/get/remove really long names (expect failure) 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -attr_set: Invalid argument 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -attr_get: Invalid argument 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -attr_remove: Invalid argument 2023-06-09T04:53:51.558 INFO:teuthology.orchestra.run.smithi018.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: -*** check final 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: - *** print attributes 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: -# file: 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: -user.snrub="fish2\012" 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: - 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: -*** delete 2023-06-09T04:53:51.559 INFO:teuthology.orchestra.run.smithi018.stdout: +attr_set: No space left on device 2023-06-09T04:53:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: +Could not set "attribute_2335" for /tmp/tmp.OqgL9ZIhdQtest/attribute_90438 2023-06-09T04:53:51.560 INFO:teuthology.orchestra.run.smithi018.stdout: +!!! failed to add "attribute_2335" 2023-06-09T04:53:51.560 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/020 2023-06-09T04:53:51.560 INFO:teuthology.orchestra.run.smithi018.stdout:Failures: generic/020 2023-06-09T04:53:51.560 INFO:teuthology.orchestra.run.smithi018.stdout:Failed 1 of 1 tests 2023-06-09T04:53:51.562 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:51.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:53:51.574 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-06-09T04:53:51.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-06-09T04:53:51.575 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-09T04:53:52.124 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:52.129 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:53.525 INFO:teuthology.orchestra.run.smithi018.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:53:53.529 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/021 2023-06-09T04:53:53.529 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/021 2023-06-09T04:53:53.530 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:53.531 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:53.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:53.544 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-09T04:53:54.012 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:54.016 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:55.441 INFO:teuthology.orchestra.run.smithi018.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:53:55.446 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/022 2023-06-09T04:53:55.446 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/022 2023-06-09T04:53:55.446 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:53:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:53:55.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:55.461 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-09T04:53:55.952 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:53:55.960 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:53:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:54:15.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:15.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:45.374 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:45.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:14.099 INFO:teuthology.orchestra.run.smithi018.stdout:generic/023 79s 2023-06-09T04:55:14.106 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/023 2023-06-09T04:55:14.107 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:14.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:14.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:14.122 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-09T04:55:14.612 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:14.617 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:55:14.762 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/024 2023-06-09T04:55:14.763 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/024 2023-06-09T04:55:14.763 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:14.765 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:14.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:14.773 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-09T04:55:15.228 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:15.232 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:15.382 INFO:teuthology.orchestra.run.smithi018.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:55:15.386 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/025 2023-06-09T04:55:15.386 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/025 2023-06-09T04:55:15.386 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:15.388 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:15.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:15.396 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-09T04:55:15.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:15.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:15.835 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:15.839 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:15.839 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:15.989 INFO:teuthology.orchestra.run.smithi018.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-06-09T04:55:15.992 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/026 2023-06-09T04:55:15.992 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/026 2023-06-09T04:55:15.993 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:16.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:16.002 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-09T04:55:16.184 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:16.188 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:16.293 INFO:teuthology.orchestra.run.smithi018.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:16.296 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/027 2023-06-09T04:55:16.297 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/027 2023-06-09T04:55:16.297 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:16.299 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:16.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:16.307 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-09T04:55:16.484 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:16.489 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:16.489 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:21.619 INFO:teuthology.orchestra.run.smithi018.stdout:generic/028 5s 2023-06-09T04:55:21.625 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/028 2023-06-09T04:55:21.626 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:21.629 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:21.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:21.638 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-09T04:55:21.827 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:21.831 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:21.936 INFO:teuthology.orchestra.run.smithi018.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:21.940 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/029 2023-06-09T04:55:21.940 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/029 2023-06-09T04:55:21.940 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:21.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:21.951 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-09T04:55:22.145 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:22.149 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:22.261 INFO:teuthology.orchestra.run.smithi018.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:22.265 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/030 2023-06-09T04:55:22.265 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/030 2023-06-09T04:55:22.265 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:22.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:22.276 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-09T04:55:22.467 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:22.471 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:22.579 INFO:teuthology.orchestra.run.smithi018.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:22.582 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/031 2023-06-09T04:55:22.582 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/031 2023-06-09T04:55:22.583 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:22.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:22.593 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-09T04:55:22.780 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:22.784 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:22.912 INFO:teuthology.orchestra.run.smithi018.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:22.916 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/032 2023-06-09T04:55:22.916 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/032 2023-06-09T04:55:22.916 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:22.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:22.927 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-09T04:55:23.097 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:23.100 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:23.201 INFO:teuthology.orchestra.run.smithi018.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:23.205 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/033 2023-06-09T04:55:23.205 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/033 2023-06-09T04:55:23.205 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:23.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:23.215 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-09T04:55:23.387 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:23.391 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:23.506 INFO:teuthology.orchestra.run.smithi018.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:23.510 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/034 2023-06-09T04:55:23.510 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/034 2023-06-09T04:55:23.510 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:23.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:23.520 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-09T04:55:23.695 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:23.699 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:23.898 INFO:teuthology.orchestra.run.smithi018.stdout:generic/035 0s 2023-06-09T04:55:23.903 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/035 2023-06-09T04:55:23.904 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:23.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:23.914 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-09T04:55:24.399 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:24.403 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:24.404 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:34.761 INFO:teuthology.orchestra.run.smithi018.stdout:generic/036 10s 2023-06-09T04:55:34.768 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/036 2023-06-09T04:55:34.768 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:34.771 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:34.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:34.782 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-09T04:55:35.253 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:35.254 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:35.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:35.360 INFO:teuthology.orchestra.run.smithi018.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:35.363 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/037 2023-06-09T04:55:35.363 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/037 2023-06-09T04:55:35.364 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:35.366 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:35.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:35.374 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-09T04:55:35.544 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:35.547 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:35.548 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:35.656 INFO:teuthology.orchestra.run.smithi018.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:35.660 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/038 2023-06-09T04:55:35.660 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/038 2023-06-09T04:55:35.660 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:35.663 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:35.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:35.671 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-09T04:55:35.877 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:35.882 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:35.882 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:36.067 INFO:teuthology.orchestra.run.smithi018.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:36.071 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/039 2023-06-09T04:55:36.071 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/039 2023-06-09T04:55:36.072 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:36.074 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:36.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:36.083 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-09T04:55:36.290 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:36.294 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:36.295 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:36.430 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/040 2023-06-09T04:55:36.431 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/040 2023-06-09T04:55:36.431 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:36.434 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:36.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:36.442 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-09T04:55:36.632 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:36.636 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:36.770 INFO:teuthology.orchestra.run.smithi018.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:36.774 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/041 2023-06-09T04:55:36.774 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/041 2023-06-09T04:55:36.774 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:36.777 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:36.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:36.785 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-09T04:55:36.984 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:36.990 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:36.990 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:37.098 INFO:teuthology.orchestra.run.smithi018.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:37.102 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/042 2023-06-09T04:55:37.102 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/042 2023-06-09T04:55:37.102 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:37.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:37.113 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-09T04:55:37.315 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:37.319 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:37.319 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:37.455 INFO:teuthology.orchestra.run.smithi018.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:37.459 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/043 2023-06-09T04:55:37.460 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/043 2023-06-09T04:55:37.460 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:37.462 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:37.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:37.471 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-09T04:55:37.653 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:37.657 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:37.766 INFO:teuthology.orchestra.run.smithi018.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:37.769 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/044 2023-06-09T04:55:37.769 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/044 2023-06-09T04:55:37.770 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:37.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:37.780 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-09T04:55:37.964 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:37.968 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:37.968 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.073 INFO:teuthology.orchestra.run.smithi018.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:38.077 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/045 2023-06-09T04:55:38.077 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/045 2023-06-09T04:55:38.077 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:38.079 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:38.087 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-09T04:55:38.270 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:38.274 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:38.274 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.379 INFO:teuthology.orchestra.run.smithi018.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:38.383 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/046 2023-06-09T04:55:38.383 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/046 2023-06-09T04:55:38.383 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:38.386 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:38.394 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-09T04:55:38.581 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:38.585 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.691 INFO:teuthology.orchestra.run.smithi018.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:38.694 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/047 2023-06-09T04:55:38.694 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/047 2023-06-09T04:55:38.695 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:38.697 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:38.704 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-09T04:55:38.891 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:38.895 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:38.896 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:38.998 INFO:teuthology.orchestra.run.smithi018.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:39.002 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/048 2023-06-09T04:55:39.002 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/048 2023-06-09T04:55:39.002 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:39.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:39.012 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-09T04:55:39.201 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:39.205 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:39.205 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:39.310 INFO:teuthology.orchestra.run.smithi018.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:39.314 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/049 2023-06-09T04:55:39.314 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/049 2023-06-09T04:55:39.314 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:39.316 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:39.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:39.324 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-09T04:55:39.516 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:39.519 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:39.520 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:39.691 INFO:teuthology.orchestra.run.smithi018.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:39.694 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/050 2023-06-09T04:55:39.695 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/050 2023-06-09T04:55:39.695 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:39.697 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:39.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:39.705 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-09T04:55:39.886 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:39.890 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:39.994 INFO:teuthology.orchestra.run.smithi018.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:39.997 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/051 2023-06-09T04:55:39.998 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/051 2023-06-09T04:55:39.998 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:40.000 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:40.008 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-09T04:55:40.196 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:40.200 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.308 INFO:teuthology.orchestra.run.smithi018.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:40.311 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/052 2023-06-09T04:55:40.312 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/052 2023-06-09T04:55:40.312 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:40.314 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:40.323 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-09T04:55:40.505 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:40.510 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:40.510 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.614 INFO:teuthology.orchestra.run.smithi018.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:40.618 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/053 2023-06-09T04:55:40.618 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/053 2023-06-09T04:55:40.618 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:40.620 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:40.628 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-09T04:55:40.801 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:40.805 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:40.915 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/054 2023-06-09T04:55:40.915 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/054 2023-06-09T04:55:40.915 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:40.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:40.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:40.926 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-09T04:55:41.104 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:41.108 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:41.108 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:41.215 INFO:teuthology.orchestra.run.smithi018.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:41.219 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/055 2023-06-09T04:55:41.219 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/055 2023-06-09T04:55:41.219 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:41.221 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:41.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:41.229 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-09T04:55:41.408 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:41.412 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:41.412 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:41.535 INFO:teuthology.orchestra.run.smithi018.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:41.539 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/056 2023-06-09T04:55:41.539 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/056 2023-06-09T04:55:41.539 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:41.541 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:41.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:41.550 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-09T04:55:41.745 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:41.749 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:41.750 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:41.879 INFO:teuthology.orchestra.run.smithi018.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:41.883 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/057 2023-06-09T04:55:41.883 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/057 2023-06-09T04:55:41.883 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:41.885 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:41.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:41.893 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-09T04:55:42.069 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:42.073 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:43.606 INFO:teuthology.orchestra.run.smithi018.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:55:43.611 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/058 2023-06-09T04:55:43.611 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/058 2023-06-09T04:55:43.612 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:43.615 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:43.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:43.627 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-09T04:55:44.099 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:44.103 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:44.103 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:44.233 INFO:teuthology.orchestra.run.smithi018.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:44.238 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/059 2023-06-09T04:55:44.238 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/059 2023-06-09T04:55:44.238 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:44.241 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:44.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:44.250 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-09T04:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:45.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:45.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:46.239 INFO:teuthology.orchestra.run.smithi018.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:55:46.244 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/060 2023-06-09T04:55:46.244 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/060 2023-06-09T04:55:46.244 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:46.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:46.259 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-09T04:55:46.739 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:46.743 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:48.376 INFO:teuthology.orchestra.run.smithi018.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:55:48.382 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/061 2023-06-09T04:55:48.382 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/061 2023-06-09T04:55:48.382 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:48.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:48.398 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-09T04:55:48.874 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:48.940 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:48.940 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:49.045 INFO:teuthology.orchestra.run.smithi018.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:49.049 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/062 2023-06-09T04:55:49.049 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/062 2023-06-09T04:55:49.049 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:49.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:49.062 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-09T04:55:49.258 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:49.262 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:49.263 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:51.155 INFO:teuthology.orchestra.run.smithi018.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:55:51.160 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/063 2023-06-09T04:55:51.160 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/063 2023-06-09T04:55:51.160 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:51.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:51.174 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-09T04:55:51.647 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:51.652 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:51.652 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:51.768 INFO:teuthology.orchestra.run.smithi018.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:51.773 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/064 2023-06-09T04:55:51.773 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/064 2023-06-09T04:55:51.773 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:51.775 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:51.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:51.784 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-09T04:55:51.982 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:51.986 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:51.987 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:52.107 INFO:teuthology.orchestra.run.smithi018.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:52.111 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/065 2023-06-09T04:55:52.111 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/065 2023-06-09T04:55:52.111 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:52.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:52.122 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-09T04:55:52.304 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:52.308 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:52.308 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:52.456 INFO:teuthology.orchestra.run.smithi018.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:52.459 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/066 2023-06-09T04:55:52.459 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/066 2023-06-09T04:55:52.459 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:52.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:52.470 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-09T04:55:52.660 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:52.664 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:52.807 INFO:teuthology.orchestra.run.smithi018.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:52.811 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/067 2023-06-09T04:55:52.811 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/067 2023-06-09T04:55:52.811 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:52.813 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:52.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:52.821 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-09T04:55:53.011 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:53.015 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:53.015 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:53.143 INFO:teuthology.orchestra.run.smithi018.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:53.146 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/068 2023-06-09T04:55:53.147 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/068 2023-06-09T04:55:53.147 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:53.149 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:53.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:53.157 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-09T04:55:53.345 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:53.349 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:53.492 INFO:teuthology.orchestra.run.smithi018.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:55:53.495 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/069 2023-06-09T04:55:53.496 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/069 2023-06-09T04:55:53.496 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:55:53.498 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:55:53.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:53.507 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-09T04:55:53.704 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:55:53.708 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:55:53.708 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:56:15.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:15.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:45.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:45.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:15.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:15.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:46.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:46.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:53.188 INFO:teuthology.orchestra.run.smithi018.stdout:generic/070 120s 2023-06-09T04:57:53.194 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/070 2023-06-09T04:57:53.194 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:57:53.197 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:53.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:53.210 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-09T04:57:53.726 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:57:53.731 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:57:53.732 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:53.897 INFO:teuthology.orchestra.run.smithi018.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:57:53.908 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/071 2023-06-09T04:57:53.908 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/071 2023-06-09T04:57:53.908 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:57:53.910 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:53.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:53.928 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-09T04:57:54.248 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:57:54.253 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:57:54.253 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:55.627 INFO:teuthology.orchestra.run.smithi018.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:57:55.631 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/072 2023-06-09T04:57:55.631 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/072 2023-06-09T04:57:55.631 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:57:55.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:55.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:55.646 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-09T04:57:55.904 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:57:55.909 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:57:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:56.080 INFO:teuthology.orchestra.run.smithi018.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T04:57:56.084 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/073 2023-06-09T04:57:56.084 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/073 2023-06-09T04:57:56.084 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T04:57:56.086 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:57:56.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:56.097 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-09T04:57:56.383 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T04:57:56.388 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T04:57:56.388 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T04:58:16.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:16.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:46.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:46.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:16.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:16.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:46.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:46.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:17.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:17.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:47.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:47.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:17.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:17.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:47.633 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:47.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:17.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:17.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:47.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:02:47.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:17.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:17.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:48.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:03:48.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:18.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:18.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:48.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:48.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:19.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:19.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:49.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:49.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:19.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:19.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:49.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:49.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:19.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:19.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:50.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:50.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:50.345 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T05:07:50.344+0000 7fa2963ea640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43799) UID: 0 2023-06-09T05:07:50.345 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T05:07:50.344+0000 7f80d1e27640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43799) UID: 0 2023-06-09T05:07:50.345 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T05:07:50.344+0000 7f176b244640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43799) UID: 0 2023-06-09T05:07:50.348 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T05:07:50.344+0000 7f0e98723640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43799) UID: 0 2023-06-09T05:07:50.486 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T05:07:50.480+0000 7fafd4374640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119836) UID: 0 2023-06-09T05:07:50.486 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T05:07:50.480+0000 7fc30b708640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119836) UID: 0 2023-06-09T05:07:50.487 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T05:07:50.480+0000 7f67f4d33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119836) UID: 0 2023-06-09T05:07:50.487 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T05:07:50.480+0000 7f79c64f6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119836) UID: 0 2023-06-09T05:13:29.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:29.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:29.494 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T05:13:29.488+0000 7fc30b708640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120788) UID: 0 2023-06-09T05:13:29.495 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T05:13:29.488+0000 7f79c64f6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120788) UID: 0 2023-06-09T05:13:29.495 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T05:13:29.488+0000 7fafd4374640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120788) UID: 0 2023-06-09T05:13:29.495 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T05:13:29.488+0000 7f67f4d33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120788) UID: 0 2023-06-09T05:13:29.534 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T05:13:29.532+0000 7f80d1e27640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43840) UID: 0 2023-06-09T05:13:29.535 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T05:13:29.532+0000 7f0e98723640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43840) UID: 0 2023-06-09T05:13:29.535 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T05:13:29.532+0000 7f176b244640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43840) UID: 0 2023-06-09T05:13:29.535 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T05:13:29.532+0000 7fa2963ea640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43840) UID: 0 2023-06-09T05:28:03.649 INFO:teuthology.orchestra.run.smithi018.stdout:generic/074 1807s 2023-06-09T05:28:03.918 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/074 2023-06-09T05:28:03.918 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:28:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:28:03.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:28:03.938 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-09T05:28:05.226 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:28:05.232 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:28:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:26.221 INFO:teuthology.orchestra.run.smithi018.stdout:generic/075 81s 2023-06-09T05:29:26.226 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/075 2023-06-09T05:29:26.226 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:26.229 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:26.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:26.238 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-09T05:29:26.754 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:26.758 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:26.758 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:26.867 INFO:teuthology.orchestra.run.smithi018.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:26.871 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/076 2023-06-09T05:29:26.871 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/076 2023-06-09T05:29:26.871 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:26.872 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:26.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:26.882 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-09T05:29:27.062 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:27.065 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:32.599 INFO:teuthology.orchestra.run.smithi018.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:32.605 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/077 2023-06-09T05:29:32.605 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/077 2023-06-09T05:29:32.605 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:32.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:32.624 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-09T05:29:32.861 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:32.865 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:32.865 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:33.025 INFO:teuthology.orchestra.run.smithi018.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-09T05:29:33.029 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/078 2023-06-09T05:29:33.029 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/078 2023-06-09T05:29:33.029 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:33.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:33.041 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-09T05:29:33.552 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:33.556 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:33.556 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:33.833 INFO:teuthology.orchestra.run.smithi018.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-09T05:29:33.838 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/079 2023-06-09T05:29:33.838 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/079 2023-06-09T05:29:33.838 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:33.841 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:33.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:33.852 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-09T05:29:34.049 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:34.053 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:34.053 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:36.456 INFO:teuthology.orchestra.run.smithi018.stdout:generic/080 2s 2023-06-09T05:29:36.462 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/080 2023-06-09T05:29:36.462 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:36.465 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:36.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:36.476 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-09T05:29:36.658 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:36.662 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:36.776 INFO:teuthology.orchestra.run.smithi018.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:36.779 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/081 2023-06-09T05:29:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/081 2023-06-09T05:29:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:36.782 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:36.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:36.790 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-09T05:29:37.058 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:37.062 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:37.063 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:37.215 INFO:teuthology.orchestra.run.smithi018.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:37.218 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/082 2023-06-09T05:29:37.219 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/082 2023-06-09T05:29:37.219 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:37.221 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:37.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:37.229 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-09T05:29:37.417 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:37.421 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:37.422 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/083 2023-06-09T05:29:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/083 2023-06-09T05:29:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:37.536 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:37.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:37.544 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-09T05:29:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:37.734 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:37.836 INFO:teuthology.orchestra.run.smithi018.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:37.840 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/084 2023-06-09T05:29:37.840 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/084 2023-06-09T05:29:37.841 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:37.843 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:37.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:37.851 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-09T05:29:38.020 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:38.024 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:38.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:38.208 INFO:teuthology.orchestra.run.smithi018.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-06-09T05:29:38.212 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/085 2023-06-09T05:29:38.212 INFO:teuthology.orchestra.run.smithi018.stdout:Not run: generic/085 2023-06-09T05:29:38.212 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:38.215 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:38.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:38.224 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-09T05:29:38.413 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:38.417 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:38.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:44.756 INFO:teuthology.orchestra.run.smithi018.stdout:generic/086 6s 2023-06-09T05:29:45.097 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/086 2023-06-09T05:29:45.098 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:45.103 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:45.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:45.196 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-09T05:29:48.078 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:48.082 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:48.733 INFO:teuthology.orchestra.run.smithi018.stdout:generic/087 0s 2023-06-09T05:29:48.739 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/087 2023-06-09T05:29:48.739 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:48.741 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:48.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:48.751 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-09T05:29:49.244 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:49.248 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:49.248 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:49.459 INFO:teuthology.orchestra.run.smithi018.stdout:generic/088 0s 2023-06-09T05:29:49.464 INFO:teuthology.orchestra.run.smithi018.stdout:Ran: generic/088 2023-06-09T05:29:49.464 INFO:teuthology.orchestra.run.smithi018.stdout:Passed all 1 tests 2023-06-09T05:29:49.466 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:29:49.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:29:49.475 DEBUG:teuthology.orchestra.run.smithi018:> (cd /tmp/tmp.l3ymdFtib6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-09T05:29:50.019 INFO:teuthology.orchestra.run.smithi018.stdout:FSTYP -- ceph-fuse 2023-06-09T05:29:50.022 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM -- Linux/x86_64 smithi018 5.15.0-73-generic #80-Ubuntu SMP Mon May 15 15:18:26 UTC 2023 2023-06-09T05:29:50.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-06-09T05:30:21.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:21.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:21.881 INFO:tasks.ceph.osd.0.smithi018.stderr:2023-06-09T05:30:21.877+0000 7fafd4374640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130671) UID: 0 2023-06-09T05:30:21.881 INFO:tasks.ceph.osd.1.smithi018.stderr:2023-06-09T05:30:21.877+0000 7fc30b708640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130671) UID: 0 2023-06-09T05:30:21.881 INFO:tasks.ceph.osd.2.smithi018.stderr:2023-06-09T05:30:21.877+0000 7f67f4d33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130671) UID: 0 2023-06-09T05:30:21.882 INFO:tasks.ceph.osd.3.smithi018.stderr:2023-06-09T05:30:21.877+0000 7f79c64f6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130671) UID: 0 2023-06-09T05:30:22.935 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T05:30:22.933+0000 7fa2963ea640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44418) UID: 0 2023-06-09T05:30:22.935 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T05:30:22.933+0000 7f80d1e27640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44418) UID: 0 2023-06-09T05:30:22.936 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T05:30:22.933+0000 7f0e98723640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44418) UID: 0 2023-06-09T05:30:22.936 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T05:30:22.933+0000 7f176b244640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44418) UID: 0 2023-06-09T05:33:59.016 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:59.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:29.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:29.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:59.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:59.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:29.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:29.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:59.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:59.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:29.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:29.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:59.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:59.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:29.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:29.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:59.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:59.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:29.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:29.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:59.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:59.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:30.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:30.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:00.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:00.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:30.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:30.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:00.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:00.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:30.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:30.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:00.501 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:00.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:30.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:30.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:00.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:00.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:30.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:30.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:01.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:01.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:31.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:31.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:01.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:01.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:31.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:31.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:01.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:01.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:31.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:31.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:01.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:01.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:31.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:31.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:01.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:01.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:31.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:31.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:02.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:02.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:32.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:32.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:02.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:02.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:32.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:32.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:02.472 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:02.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:32.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:32.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:02.667 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:02.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:32.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:52:32.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:02.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:02.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:33.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:53:33.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:03.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:03.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:33.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:33.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:03.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:03.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:33.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:33.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:03.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:03.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:33.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:33.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:03.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:03.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:33.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:57:33.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:04.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:04.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:34.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:58:34.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:04.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:04.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:34.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:34.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:04.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:04.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:34.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:00:34.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:04.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:04.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:34.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:01:34.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:04.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:04.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:34.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:34.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:05.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:05.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:35.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:35.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:05.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:05.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:35.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:35.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:05.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:05.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:35.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:05:35.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:05.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:05.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:35.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:06:35.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:05.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:05.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:35.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:35.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:05.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:05.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:36.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:36.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:06.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:06.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:36.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:09:36.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:06.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:06.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:36.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:10:36.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:06.419 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:06.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:36.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:36.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:06.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:06.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:36.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:36.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:06.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:06.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:36.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:36.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:06.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:06.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:37.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:37.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:07.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:07.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:37.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:37.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:07.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:07.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:37.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:37.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:07.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:07.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:37.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:37.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:07.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:07.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:37.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:37.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:07.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:07.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:38.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:38.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:08.059 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:08.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:38.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:38.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:08.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:08.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:38.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:38.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:08.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:08.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:38.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:38.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:08.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:08.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:38.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:38.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:08.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:08.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:38.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:38.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:08.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:08.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:39.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:39.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:09.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:09.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:39.244 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:39.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:09.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:09.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:39.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:39.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:09.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:09.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:39.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:28:39.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:09.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:09.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:39.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:29:39.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:10.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:10.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:40.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:30:40.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:10.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:10.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:40.656 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:40.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:10.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:10.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:40.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:32:40.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:10.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:10.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:41.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:33:41.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:11.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:11.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:41.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:41.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:11.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:11.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:41.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:41.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:11.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:11.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:41.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:41.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:11.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:11.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:41.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:41.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:11.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:11.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:41.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:41.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:12.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:12.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:42.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:42.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:12.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:12.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:42.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:40:42.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:12.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:12.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:42.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:41:42.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:12.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:12.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:42.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:42:42.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:12.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:12.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:42.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:42.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:12.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:12.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:42.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:42.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:13.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:13.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:43.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:43.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:13.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:13.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:43.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:43.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:13.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:13.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:43.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:47:43.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:13.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:13.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:43.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:48:43.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:14.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:14.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:44.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:49:44.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:14.206 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:14.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:44.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:44.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:14.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:14.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:44.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:44.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:14.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:14.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:44.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:52:44.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:14.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:14.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:44.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:44.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:14.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:14.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:44.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:54:44.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:15.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:15.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:45.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:55:45.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:15.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:15.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:45.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:56:45.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:15.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:15.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:45.492 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:57:45.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:15.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:15.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:45.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:45.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:15.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:15.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:45.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:45.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:15.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:15.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:46.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:46.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:16.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:16.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:46.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:46.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:16.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:16.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:46.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:46.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:16.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:16.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:46.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:46.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:16.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:16.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:46.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:46.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:16.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:16.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:46.927 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:46.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:17.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:17.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:47.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:47.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:17.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:17.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:47.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:47.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:17.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:17.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:47.818 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:47.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:17.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:17.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:48.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:48.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:18.154 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:18.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:48.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:48.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:18.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:18.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:48.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:11:48.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:18.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:18.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:48.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:48.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:18.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:18.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:48.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:48.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:18.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:18.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:48.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:48.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:18.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:18.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:49.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:49.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:19.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:19.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:49.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:49.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:19.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:19.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:49.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:49.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:19.478 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:19.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:49.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:49.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:19.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:19.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:49.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:49.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:19.902 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:19.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:49.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:49.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:20.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:20.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:50.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:50.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:20.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:20.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:50.308 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:50.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:20.362 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:20.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:50.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:50.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:20.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:20.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:50.667 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:50.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:20.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:20.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:50.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:50.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:20.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:20.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:50.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:50.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:21.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:21.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:51.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:51.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:21.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:21.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:51.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:51.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:21.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:21.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:51.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:51.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:21.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:21.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:51.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:51.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:21.798 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:21.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:51.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:51.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:22.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:22.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:52.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:52.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:22.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:22.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:52.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:52.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:22.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:22.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:52.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:52.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:22.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:22.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:52.858 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:52.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:22.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:22.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:53.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:53.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:23.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:23.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:53.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:53.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:23.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:23.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:53.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:53.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:23.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:23.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:53.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:53.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:23.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:23.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:53.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:53.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:23.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:23.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:53.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:53.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:24.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:24.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:54.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:54.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:24.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:24.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:54.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:54.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:24.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:24.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:54.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:54.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:24.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:24.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:54.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:54.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:24.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:24.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:54.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:54.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:24.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:24.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:55.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:55.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:25.081 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:25.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:55.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:55.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:25.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:25.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:55.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:55.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:25.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:25.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:55.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:55.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:25.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:25.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:55.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:55.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:25.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:25.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:55.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:55.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:25.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:25.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:55.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:55.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:25.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:25.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:56.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:56.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:26.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:26.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:56.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:56.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:26.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:26.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:56.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:56.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:26.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:26.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:56.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:56.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:26.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:26.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:56.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:56.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:27.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:27.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:57.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:57.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:27.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:27.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:57.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:57.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:27.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:27.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:57.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:57.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:27.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:27.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:57.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:57.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:28.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:28.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:58.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:58.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:28.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:28.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:58.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:58.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:28.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:28.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:58.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:58.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:28.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:28.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:58.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:58.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:28.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:28.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:58.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:58.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:29.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:29.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:59.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:59.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:29.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:29.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:59.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:59.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:29.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:29.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:59.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:59.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:29.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:29.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:59.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:59.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:29.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:29.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:59.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:59.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:30.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:30.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:00.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:00.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:30.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:30.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:00.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:00.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:30.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:30.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:00.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:00.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:30.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:30.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:00.599 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:00.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:30.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:30.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:00.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:00.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:31.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:31.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:01.117 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:01.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:31.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:31.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:01.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:01.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:31.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:31.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:01.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:01.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:31.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:31.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:01.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:01.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:31.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:31.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:01.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:01.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:31.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:31.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:02.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:02.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:32.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:32.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:02.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:02.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:32.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:32.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:02.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:02.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:32.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:32.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:02.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:02.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:32.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:32.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:03.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:03.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:33.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:33.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:03.159 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:03.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:33.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:33.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:03.429 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:03.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:03.452 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-06-09T08:30:03.447+0000 7f176b244640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45613) UID: 0 2023-06-09T08:30:03.453 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-06-09T08:30:03.447+0000 7fa2963ea640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45613) UID: 0 2023-06-09T08:30:03.453 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-06-09T08:30:03.447+0000 7f80d1e27640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45613) UID: 0 2023-06-09T08:30:03.453 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-06-09T08:30:03.447+0000 7f0e98723640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45613) UID: 0 2023-06-09T08:32:32.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:32.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:02.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:02.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:32.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:32.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:02.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:02.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:33.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:33.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:03.154 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:03.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:33.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:33.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:03.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:03.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:33.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:33.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:03.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:03.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:33.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:33.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:04.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:04.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:34.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:34.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:04.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:04.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:34.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:34.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:04.374 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:04.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:34.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:34.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:04.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:04.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:34.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:34.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:04.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:04.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:34.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:34.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:04.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:04.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:34.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:34.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:05.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:05.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:35.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:35.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:05.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:05.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:35.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:35.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:05.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:05.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:35.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:35.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:05.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:05.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:35.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:35.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:05.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:05.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:36.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:36.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:06.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:06.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:36.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:36.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:06.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:06.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:36.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:36.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:06.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:06.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:36.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:36.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:06.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:06.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:37.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:37.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:07.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:07.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:37.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:37.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:07.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:07.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:37.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:37.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:07.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:07.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:37.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:37.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:07.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:07.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:37.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:37.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:07.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:07.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:37.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:37.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:08.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:08.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:38.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:38.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:08.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:08.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:38.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:38.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:08.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:08.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:38.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:38.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:08.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:08.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:38.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:38.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:08.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:08.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:38.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:38.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:08.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:08.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:38.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:38.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:09.097 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:09.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:39.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:39.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:09.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:09.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:39.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:39.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:09.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:09.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:39.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:39.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:09.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:09.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:39.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:39.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:09.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:09.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:39.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:39.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:10.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:10.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:40.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:40.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:10.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:10.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:40.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:40.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:10.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:10.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:40.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:40.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:10.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:10.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:40.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:40.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:10.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:10.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:41.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:41.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:11.127 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:11.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:41.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:41.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:11.297 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:11.300 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:41.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:41.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:11.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:11.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:41.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:41.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:11.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:11.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:41.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:41.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:11.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:11.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:41.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:41.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:12.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:12.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:42.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:42.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:12.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:12.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:42.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:42.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:12.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:12.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:42.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:42.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:12.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:12.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:43.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:43.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:13.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:13.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:43.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:43.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:13.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:13.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:43.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:43.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:13.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:13.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:43.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:43.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:13.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:13.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:43.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:43.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:13.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:13.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:43.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:43.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:14.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:14.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:44.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:44.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:14.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:14.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:44.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:44.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:14.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:14.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:44.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:44.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:14.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:14.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:44.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:44.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:14.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:14.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:44.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:44.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:14.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:14.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:45.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:45.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:15.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:15.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:45.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:45.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:15.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:15.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:45.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:45.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:15.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:15.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:45.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:45.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:16.081 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:16.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:46.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:46.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:16.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:16.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:46.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:46.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:16.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:16.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:46.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:46.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:16.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:16.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:46.856 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:46.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:16.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:16.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:47.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:47.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:17.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:17.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:47.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:47.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:17.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:17.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:47.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:47.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:17.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:17.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:47.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:47.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:17.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:17.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:47.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:47.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:17.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:17.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:48.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:48.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:18.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:18.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:48.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:48.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:18.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:18.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:48.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:48.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:18.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:18.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:48.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:48.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:18.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:18.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:48.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:48.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:19.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:19.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:49.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:49.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:19.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:19.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:49.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:49.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:19.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:19.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:49.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:49.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:19.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:19.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:49.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:49.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:19.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:19.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:49.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:49.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:19.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:19.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:49.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:49.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:20.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:20.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:50.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:50.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:20.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:20.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:50.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:50.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:20.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:20.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:50.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:50.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:20.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:20.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:50.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:50.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:20.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:20.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:50.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:50.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:20.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:20.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:50.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:50.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:20.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:20.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:51.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:51.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:21.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:21.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:51.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:51.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:21.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:21.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:51.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:51.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:21.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:21.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:51.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:51.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:21.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:21.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:51.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:51.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:22.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:22.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:52.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:52.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:22.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:22.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:52.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:52.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:22.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:22.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:52.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:52.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:22.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:22.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:52.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:52.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:22.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:22.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:53.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:53.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:23.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:23.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:53.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:53.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:23.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:23.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:53.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:53.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:23.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:23.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:53.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:53.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:23.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:23.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:53.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:53.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:23.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:23.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:53.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:53.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:24.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:24.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:54.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:54.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:24.221 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:24.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:54.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:54.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:24.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:24.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:54.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:54.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:24.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:24.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:54.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:54.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:24.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:24.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:54.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:54.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:25.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:25.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:55.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:55.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:25.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:25.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:55.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:55.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:25.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:25.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:55.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:55.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:25.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:25.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:55.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:55.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:25.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:25.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:55.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:55.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:25.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:25.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:55.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:55.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:25.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:25.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:56.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:56.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:26.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:26.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:56.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:56.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:26.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:26.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:56.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:56.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:26.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:26.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:56.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:56.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:26.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:26.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:56.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:56.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:27.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:27.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:57.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:57.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:27.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:27.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:57.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:57.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:27.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:27.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:57.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:57.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:27.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:27.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:57.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:57.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:27.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:27.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:58.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:58.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:28.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:28.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:58.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:58.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:28.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:28.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:58.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:58.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:28.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:28.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:58.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:58.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:28.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:28.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:58.779 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:58.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:28.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:28.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:59.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:59.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:29.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:29.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:59.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:59.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:29.459 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:29.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:59.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:59.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:29.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:29.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:59.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:59.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:29.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:29.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:59.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:59.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:30.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:30.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:00.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:00.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:30.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:30.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:00.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:00.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:30.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:30.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:00.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:00.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:30.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:30.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:00.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:00.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:30.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:30.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:00.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:00.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:30.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:30.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:01.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:01.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:31.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:31.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:01.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:01.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:31.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:31.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:01.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:01.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:31.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:31.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:01.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:01.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:32.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:32.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:02.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:02.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:32.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:32.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:02.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:02.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:32.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:32.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:02.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:02.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:32.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:32.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:02.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:02.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:32.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:32.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:02.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:02.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:33.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:33.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:03.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:03.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:33.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:33.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:03.280 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:03.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:33.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:33.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:03.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:03.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:33.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:33.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:03.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:03.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:33.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:33.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:03.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:03.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:34.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:34.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:04.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:04.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:34.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:34.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:04.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:04.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:34.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:34.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:04.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:04.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:34.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:34.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:04.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:04.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:34.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:34.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:04.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:04.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:34.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:34.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:05.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:05.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:35.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:35.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:05.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:05.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:35.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:35.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:05.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:05.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:35.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:35.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:05.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:05.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:35.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:35.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:05.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:05.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:35.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:35.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:05.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:05.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:35.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:35.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:06.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:06.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:36.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:36.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:06.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:06.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:36.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:36.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:06.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:06.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:36.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:36.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:06.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:06.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:36.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:36.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:06.798 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:06.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:36.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:36.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:07.045 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:07.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:37.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:37.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:07.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:07.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:37.206 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:37.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:07.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:07.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:37.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:37.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:07.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:07.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:37.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:37.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:07.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:07.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:37.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:37.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:07.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:07.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:37.957 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:37.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:08.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:08.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:38.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:38.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:08.183 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:08.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:38.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:38.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:08.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:08.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:38.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:38.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:08.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:08.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:38.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:38.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:08.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:08.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:38.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:38.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:08.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:08.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:39.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:39.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:09.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:09.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:39.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:39.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:09.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:09.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:39.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:39.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:09.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:09.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:39.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:39.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:09.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:09.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:39.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:39.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:10.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:10.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:40.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:40.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:10.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:10.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:40.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:40.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:10.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:10.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:40.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:40.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:10.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:10.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:40.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:40.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:10.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:10.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:40.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:40.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:11.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:11.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:41.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:41.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:11.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:11.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:41.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:41.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:11.505 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:11.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:41.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:41.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:11.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:11.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:41.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:41.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:11.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:11.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:41.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:41.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:11.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:11.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:42.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:42.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:12.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:12.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:42.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:42.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:12.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:12.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:42.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:42.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:12.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:12.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:42.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:42.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:12.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:12.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:42.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:43.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:13.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:13.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:43.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:43.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:13.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:13.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:43.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:43.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:13.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:13.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:43.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:43.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:13.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:13.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:43.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:43.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:13.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:13.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:43.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:43.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:14.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:14.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:44.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:44.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:14.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:14.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:44.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:44.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:14.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:14.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:44.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:44.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:14.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:14.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:44.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:44.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:14.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:14.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:44.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:44.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:14.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:14.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:44.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:44.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:15.005 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:15.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:45.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:45.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:15.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:15.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:45.308 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:45.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:15.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:15.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:45.439 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:45.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:15.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:15.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:45.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:45.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:15.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:15.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:45.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:45.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:15.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:15.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:45.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:45.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:16.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:16.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:46.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:46.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:16.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:16.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:46.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:46.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:16.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:16.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:46.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:46.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:16.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:16.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:46.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:46.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:16.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:16.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:47.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:47.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:17.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:17.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:47.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:47.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:17.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:17.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:47.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:47.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:17.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:17.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:47.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:47.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:17.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:17.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:47.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:47.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:18.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:18.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:48.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:48.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:18.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:18.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:48.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:48.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:18.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:18.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:48.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:48.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:18.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:18.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:48.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:48.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:18.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:18.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:48.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:48.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:19.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:19.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:49.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:49.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:19.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:19.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:49.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:49.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:19.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:19.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:49.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:49.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:19.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:19.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:49.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:49.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:19.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:19.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:49.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:49.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:20.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:20.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:50.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:50.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:20.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:20.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:50.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:50.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:20.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:20.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:50.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:50.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:20.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:20.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:50.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:50.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:20.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:20.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:50.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:50.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:20.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:20.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:51.102 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:51.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:21.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:21.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:51.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:51.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:21.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:21.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:51.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:51.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:21.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:21.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:51.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:51.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:21.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:21.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:51.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:51.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:21.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:21.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:52.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:52.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:22.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:22.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:52.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:52.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:22.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:22.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:52.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:52.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:22.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:22.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:52.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:52.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:22.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:22.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:53.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:53.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:23.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:23.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:53.298 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:53.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:23.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:23.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:53.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:53.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:23.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:23.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:53.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:53.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:23.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:23.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:53.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:53.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:23.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:23.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:54.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:54.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:24.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:24.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:54.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:54.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:24.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:24.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:54.730 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:54.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:25.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:25.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:55.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:55.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:25.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:25.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:55.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:55.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:25.449 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:25.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:55.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:55.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:25.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:25.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:55.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:55.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:25.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:25.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:55.999 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:56.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:26.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:26.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:56.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:56.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:26.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:26.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:56.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:56.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:26.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:26.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:56.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:56.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:26.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:26.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:56.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:56.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:26.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:26.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:57.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:57.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:27.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:27.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:57.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:57.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:27.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:27.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:57.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:57.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:27.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:27.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:57.528 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:57.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:27.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:27.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:57.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:57.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:27.887 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:27.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:57.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:57.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:28.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:28.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:58.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:58.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:28.185 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:28.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:58.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:58.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:28.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:28.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:58.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:58.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:28.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:28.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:58.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:58.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:29.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:29.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:59.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:59.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:29.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:29.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:59.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:59.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:29.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:29.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:59.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:59.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:29.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:29.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:59.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:59.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:29.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:29.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:00.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:00.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:30.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:30.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:00.238 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:00.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:30.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:30.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:00.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:00.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:30.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:30.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:00.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:00.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:30.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:30.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:00.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:00.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:31.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:31.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:01.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:01.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:31.308 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:31.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:01.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:01.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:31.846 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:31.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:01.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:01.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:32.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:32.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:02.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:02.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:32.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:32.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:02.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:02.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:32.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:32.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:02.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:02.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:32.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:32.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:02.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:02.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:33.090 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:33.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:03.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:03.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:33.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:33.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:03.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:03.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:33.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:33.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:03.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:03.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:33.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:33.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:03.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:03.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:33.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:33.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:04.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:04.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:34.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:34.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:04.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:04.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:34.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:34.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:04.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:04.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:34.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:34.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:04.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:04.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:34.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:34.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:04.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:04.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:35.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:35.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:05.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:05.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:35.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:35.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:05.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:05.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:35.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:35.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:05.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:05.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:35.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:35.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:05.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:05.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:36.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:36.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:06.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:06.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:36.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:36.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:06.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:06.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:36.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:36.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:06.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:06.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:36.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:36.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:06.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:06.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:36.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:36.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:07.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:07.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:37.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:37.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:07.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:07.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:37.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:37.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:07.493 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:07.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:37.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:37.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:07.639 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:07.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:37.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:37.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:07.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:07.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:37.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:37.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:08.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:08.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:38.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:38.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:08.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:08.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:38.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:38.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:08.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:08.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:38.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:38.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:08.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:08.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:38.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:38.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:08.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:08.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:39.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:39.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:09.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:09.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:39.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:39.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:09.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:09.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:39.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:39.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:09.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:09.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:39.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:39.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:09.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:09.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:39.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:39.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:09.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:09.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:40.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:40.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:10.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:10.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:40.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:40.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:10.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:10.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:40.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:40.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:10.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:10.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:40.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:40.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:10.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:10.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:40.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:40.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:10.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:10.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:41.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:41.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:11.127 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:11.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:41.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:41.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:11.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:11.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:41.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:41.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:11.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:11.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:41.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:41.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:11.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:11.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:41.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:41.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:11.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:11.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:42.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:42.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:12.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:12.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:42.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:42.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:12.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:12.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:42.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:42.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:12.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:12.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:42.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:42.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:12.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:12.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:42.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:42.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:12.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:12.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:42.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:42.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:12.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:12.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:42.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:42.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:12.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:12.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:43.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:43.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:13.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:13.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:43.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:43.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:13.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:13.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:43.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:43.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:13.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:13.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:43.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:43.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:13.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:13.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:43.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:43.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:13.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:13.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:43.879 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:43.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:14.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:14.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:44.082 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:44.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:14.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:14.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:44.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:44.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:14.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:14.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:44.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:44.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:14.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:14.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:44.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:44.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:14.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:14.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:44.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:44.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:14.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:14.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:44.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:44.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:15.059 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:15.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:45.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:45.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:15.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:15.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:45.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:45.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:15.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:15.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:45.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:45.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:15.667 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:15.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:45.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:45.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:15.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:15.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:45.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:45.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:15.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:15.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:46.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:46.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:16.154 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:16.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:46.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:46.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:16.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:16.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:46.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:46.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:16.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:16.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:46.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:46.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:16.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:16.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:46.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:46.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:16.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:16.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:47.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:47.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:17.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:17.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:47.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:47.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:17.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:17.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:47.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:47.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:17.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:17.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:47.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:47.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:17.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:17.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:47.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:47.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:17.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:17.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:47.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:47.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:18.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:18.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:48.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:48.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:18.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:18.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:48.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:48.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:18.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:18.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:48.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:48.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:18.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:18.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:48.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:48.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:18.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:18.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:49.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:49.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:19.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:19.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:49.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:49.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:19.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:19.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:49.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:49.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:19.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:19.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:49.332 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:49.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:19.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:19.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:49.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:49.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:19.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:19.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:49.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:49.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:19.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:19.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:49.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:49.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:19.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:19.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:49.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:49.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:19.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:19.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:49.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:49.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:20.059 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:20.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:50.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:50.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:20.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:20.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:50.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:50.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:20.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:20.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:50.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:50.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:20.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:20.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:50.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:50.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:20.890 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:20.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:50.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:50.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:21.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:21.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:51.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:51.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:21.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:21.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:51.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:51.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:21.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:21.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:51.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:51.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:21.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:21.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:51.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:51.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:21.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:21.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:51.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:51.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:21.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:21.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:51.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:51.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:21.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:21.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:51.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:51.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:21.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:21.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:52.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:52.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:22.204 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:22.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:52.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:52.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:22.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:22.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:52.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:52.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:22.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:22.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:52.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:52.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:22.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:22.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:53.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:53.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:23.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:23.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:53.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:53.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:23.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:23.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:53.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:53.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:23.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:23.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:53.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:53.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:23.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:23.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:53.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:53.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:23.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:23.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:53.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:53.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:23.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:23.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:53.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:53.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:23.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:23.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:53.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:53.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:23.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:23.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:53.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:53.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:23.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:23.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:54.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:54.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:24.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:24.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:54.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:54.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:24.247 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:24.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:54.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:54.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:24.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:24.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:54.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:54.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:24.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:24.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:54.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:54.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:24.560 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:24.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:54.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:54.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:24.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:24.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:54.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:54.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:24.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:24.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:54.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:54.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:24.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:24.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:55.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:55.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:25.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:25.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:55.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:55.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:25.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:25.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:55.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:55.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:25.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:25.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:55.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:55.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:25.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:25.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:55.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:55.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:25.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:25.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:55.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:55.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:25.927 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:25.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:56.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:56.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:26.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:26.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:56.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:56.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:26.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:26.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:56.332 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:56.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:26.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:26.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:56.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:56.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:26.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:26.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:56.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:56.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:26.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:26.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:56.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:56.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:27.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:27.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:57.156 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:57.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:27.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:27.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:57.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:57.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:27.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:27.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:57.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:57.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:27.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:27.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:57.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:57.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:27.957 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:27.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:58.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:58.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:28.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:28.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:58.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:58.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:28.489 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:28.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:58.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:58.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:28.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:28.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:58.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:58.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:28.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:28.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:58.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:58.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:29.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:29.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:59.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:59.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:29.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:29.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:59.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:59.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:29.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:29.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:59.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:59.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:29.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:29.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:59.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:59.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:29.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:29.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:59.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:59.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:29.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:29.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:00.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:00.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:30.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:30.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:00.227 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:00.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:30.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:30.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:00.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:00.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:30.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:30.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:00.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:00.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:30.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:30.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:00.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:00.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:30.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:30.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:01.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:01.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:31.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:31.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:01.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:01.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:31.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:31.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:01.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:01.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:31.441 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:31.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:01.492 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:01.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:31.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:31.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:01.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:01.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:31.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:31.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:01.730 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:01.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:31.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:31.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:01.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:01.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:31.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:31.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:01.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:01.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:32.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:32.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:02.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:02.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:32.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:32.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:02.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:02.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:32.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:32.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:02.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:02.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:32.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:32.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:02.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:02.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:32.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:32.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:02.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:02.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:32.639 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:32.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:02.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:02.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:32.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:32.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:02.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:02.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:32.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:32.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:02.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:02.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:32.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:32.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:03.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:03.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:33.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:33.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:03.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:03.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:33.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:33.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:03.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:03.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:33.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:33.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:03.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:03.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:33.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:33.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:03.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:03.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:33.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:33.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:03.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:03.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:34.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:34.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:38.040 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-09T16:24:38.041 DEBUG:teuthology.task.console_log:Killing console logger for smithi018 2023-06-09T16:24:38.041 DEBUG:teuthology.task.console_log:Killing console logger for smithi081 2023-06-09T16:24:38.042 DEBUG:teuthology.exit:Finished running handlers